Deploy LocalAI and Flowise on AWS EKS

This example lives in the pulumi/examples repository. Check out just this directory to use it:

$ git clone --filter=blob:none --sparse https://github.com/pulumi/examples pulumi-examples
$ git -C pulumi-examples sparse-checkout set aws-ts-localai-flowise
$ cd pulumi-examples/aws-ts-localai-flowise

This example deploys LocalAI and Flowise on an Amazon EKS cluster using Pulumi in TypeScript.

Prerequisites#

1. Install Pulumi
2. Configure AWS credentials
3. Install Node.js

If you run Pulumi for the first time, you will be asked to log in. Follow the instructions on the screen to login. You may need to create an account first, don’t worry it is free.

Deploying the example#

1. Create a new stack:

   pulumi stack init dev

2. Set the AWS region to deploy into:

   pulumi config set aws:region eu-central-1

3. Install dependencies:

   npm install

4. Deploy the infrastructure:

   pulumi up

5. Port forward the Flowise UI. First, retrieve the kubeconfig file:

   pulumi stack output kubeconfig --show-secrets > kubeconfig.yaml

   As the program does not deploy a LoadBalancer, you need to port forward the UI to your local machine:

   kubectl port-forward svc/flowise-ui 3000:3000

Cleaning up#

Once you’re finished, destroy the resources and remove the stack:

pulumi destroy
pulumi stack rm