AWS Python LangServe example

This example lives in the pulumi/examples repository. Check out just this directory to use it:

$ git clone --filter=blob:none --sparse https://github.com/pulumi/examples pulumi-examples
$ git -C pulumi-examples sparse-checkout set aws-py-langserve
$ cd pulumi-examples/aws-py-langserve

This example demonstrates how to deploy a simple LangServe app using Pulumi in Python.

Prerequisites#

1. Install Pulumi
2. Configure AWS credentials
3. Install Python
4. Install Docker
5. Install the AWS CLI
6. Install the LangChain CLI

Deploying the example#

1. Create a new stack:

   pulumi stack init dev

2. Set the AWS region to deploy into:

   pulumi config set aws:region us-east-2

3. Set your OpenAI API key:

   pulumi config set open-api-key --secret

4. Install dependencies:

   python3 -m venv venv
   source venv/bin/activate
   pip install -r requirements.txt

5. Deploy the stack:

   pulumi up

   This command will show you a preview of the resources that will be created. After reviewing the changes, you will be prompted to continue. Once confirmed, Pulumi will deploy your LangServe app to AWS.

   The whole deployment process will take a couple of minutes. Once it’s done, you will see the URL of your LangServe app in the output.

   Outputs:
       url: "http://<dns>.elb.amazonaws.com"
   
   Resources:
       + 27 created

   You can now access the LangServe playground by adding /openai/playground to the URL you got from the output.

   [!NOTE] It may take a few minutes for the load balancer to be ready to accept requests. If you see a 503 error, wait a few minutes and try again.

Cleaning up#

To clean up the resources created by this example, run the following commands. You will be prompted to confirm the deletion of the resources.

pulumi destroy
pulumi stack rm