AWS TypeScript LangServe example

This example lives in the pulumi/examples repository. Check out just this directory to use it:

$ git clone --filter=blob:none --sparse https://github.com/pulumi/examples pulumi-examples
$ git -C pulumi-examples sparse-checkout set aws-ts-langserve
$ cd pulumi-examples/aws-ts-langserve

This example demonstrates how to deploy a simple LangServe app using Pulumi in TypeScript.

Prerequisites#

1. Install Pulumi
2. Configure AWS credentials
3. Install Node.js
4. Install Docker
5. Install the AWS CLI
6. Install the LangChain CLI

Deploying the example#

1. Create a new stack:

   pulumi stack init dev

2. Set the AWS region to deploy into:

   pulumi config set aws:region us-west-2

3. Set your OpenAI API key:

   pulumi config set open-api-key --secret # Enter your OpenAI API key

4. Install dependencies:

   npm install

5. Deploy the stack. This will show you a preview of the resources that will be created. After reviewing the changes, you will be prompted to continue.

   pulumi up

   The whole deployment process will take a couple of minutes. Once it’s done, you will see the URL of your LangServe app in the output.

   Outputs:
       url: "http://<dns>.elb.amazonaws.com"
   
   Resources:
       + 27 created

   You can now access the LangServe playground by adding /openai/playground to the URL you got from the output.

   [!NOTE] It may take a few minutes for the load balancer to be ready to accept requests. If you see a 503 error, wait a few minutes and try again.

Cleaning up#

To clean up the resources created by this example, run:

pulumi destroy
pulumi stack rm