AWS Go LangServe example
A minimal Langserve AWS Go Pulumi program
This example lives in the pulumi/examples repository. Check out just this directory to use it:
git clone --filter=blob:none --sparse https://github.com/pulumi/examples pulumi-examplesgit -C pulumi-examples sparse-checkout set aws-go-langservecd pulumi-examples/aws-go-langserveThis example demonstrates how to deploy a simple LangServe app to AWS using Pulumi in Go.
Prerequisites#
- Install Pulumi
- Configure AWS credentials
- Install Go
- Install Docker
- Install the AWS CLI
- Install the LangChain CLI
Deploying the example#
-
Create a new stack, which is an isolated deployment target for this example:
Terminal window pulumi stack init dev -
Set the AWS region to deploy into:
Terminal window pulumi config set aws:region us-west-2 -
Set your OpenAI API key:
Terminal window pulumi config set open-api-key --secret # Enter your OpenAI API key -
Install dependencies:
Terminal window go mod download -
Deploy the stack:
Terminal window pulumi upThis will show you a preview of the resources that will be created. After reviewing the changes, you will be prompted to continue. Once confirmed, Pulumi will deploy your LangServe app to AWS.
The whole deployment process will take a couple of minutes. Once it’s done, you will see the URL of your LangServe app in the output.
Outputs:url: "http://<dns>.elb.amazonaws.com"Resources:+ 27 createdYou can now access the LangServe playground by adding
/openai/playgroundto the URL you got from the output.[!NOTE] It may take a few minutes for the load balancer to be ready to accept requests. If you see a 503 error, wait a few minutes and try again.
Cleaning up#
Once you’re finished experimenting, tear down your stack’s resources by destroying and removing it:
pulumi destroypulumi stack rm