1. Packages
  2. AWS
  3. How-to Guides
  4. AWS YAML LangServe Example
AWS v6.54.2 published on Wednesday, Oct 2, 2024 by Pulumi

AWS YAML LangServe Example

aws logo
AWS v6.54.2 published on Wednesday, Oct 2, 2024 by Pulumi

    View Code

    This example demonstrates how to use deploy a simple app using Pulumi in YAML.

    Prerequisites

    To run this example, you’ll need the following tools installed on your machine:

    1. Install Pulumi
    2. Configure AWS
    3. Install Docker
    4. Install the AWS CLI
    5. Install the LangChain CLI

    Deploying to AWS using Pulumi

    Set the region with the following command:

    pulumi config set aws:region <region>
    

    Run the following command to deploy your LangServe app to AWS:

    git clone https://github.com/pulumi/examples.git
    cd examples/aws-yaml-langserve
    pulumi stack init <your-stack-name>
    pulumi config set open-api-key --secret # Enter your OpenAI API key
    pulumi up
    

    This last command will show you a preview of the resources that will be created. After reviewing the changes, you will be prompted to continue. Once confirmed, Pulumi will deploy your LangServe app to AWS.

    The whole deployoment process will take a couple of minutes. Once it’s done, you will see the URL of your LangServe app in the output.

    Outputs:
        url: "http://<dns>.elb.amazonaws.com"
    
    Resources:
        + 27 created
    

    You can now access the LangServe playground by adding /openai/playground to the URL you got from the output.

    [!NOTE]
    It may take a few minutes for the load balancer to be ready to accept requests. If you see a 503 error, wait a few minutes and try again.

    Clean up

    To clean up the resources created by this example, run the following command:

    pulumi destroy
    

    You will be prompted to confirm the deletion of the resources. Once confirmed, Pulumi will delete all the resources created by this example.

    aws logo
    AWS v6.54.2 published on Wednesday, Oct 2, 2024 by Pulumi