Deploy the kserve-inference helm chart on Digital Ocean Kubernetes Service

Question

Pulumi · Accepted Answer

To deploy the `kserve-inference` Helm chart on a DigitalOcean Kubernetes service using Pulumi, we will need to perform the following steps:

1. Provision a DigitalOcean Kubernetes cluster.
2. Deploy the `kserve-inference` Helm chart to the cluster.

We'll break down these steps with an explanation of each significant part.

Firstly, we need to provision a DigitalOcean Kubernetes service. The `digitalocean.KubernetesCluster` resource allows us to define and create a Kubernetes cluster in your DigitalOcean account. You would need to specify parameters such as the region, version, and node pool configuration according to your needs.

Once the cluster is up and running, we can deploy Helm charts to it. For deploying Helm charts, we use the `kubernetes.helm.v3.Chart` resource. This resource represents a Helm chart in the Pulumi ecosystem, which allows us to define and install Helm charts into Kubernetes clusters managed by Pulumi.

In the given program, a Helm chart for `kserve-inference` will be deployed. Replace `"kserve-inference"` with the correct Helm chart name if it's different, and additionally, provide the repository URL if it's necessary by setting `repo` attribute with the Helm repository URL.

Here's how the TypeScript program might look:

```typescript
import * as pulumi from "@pulumi/pulumi";
import * as digitalocean from "@pulumi/digitalocean";
import * as k8s from "@pulumi/kubernetes";

// Create a DigitalOcean Kubernetes cluster
const cluster = new digitalocean.KubernetesCluster("do-cluster", {
    region: "nyc1",
    version: "latest", // or specify your desired Kubernetes version
    nodePool: {
        name: "default",
        size: "s-2vcpu-2gb", // select the size that suits your need
        nodeCount: 3, // specify the number of nodes in the node pool
    },
});

// Use the kubeconfig from the generated cluster to interact with the cluster
const kubeconfig = cluster.kubeConfigs[0].rawConfig;

// Create a provider to install Helm charts into the cluster
const k8sProvider = new k8s.Provider("do-k8s", {
    kubeconfig,
});

// Deploy the kserve-inference Helm chart into the cluster
const kserveInferenceChart = new k8s.helm.v3.Chart("kserve-inference", {
    chart: "kserve-inference", // Replace with the correct Helm chart name
    // repo: "repository-url", // Uncomment and replace with the Helm repository URL if needed
}, { provider: k8sProvider });

// Export the cluster's kubeconfig to be able to interact with it from kubectl
export const kubeConfig = kubeconfig;
```

This program initiates by importing the necessary Pulumi packages. It then defines the cluster, specifying the desired region, Kubernetes version, and node pool configuration.

The `kubeconfig` object is an essential part of interacting with your Kubernetes cluster; it includes all the necessary information to connect to the cluster, such as endpoint URLs and authentication details.

The `k8sProvider` is then used to install Helm charts into your Kubernetes cluster. This provider uses the `kubeconfig` of the cluster we just created.

Finally, we define the Helm chart we want to deploy. We pass the `chart` parameter, which includes the name of the Helm chart, and an optional `repo` parameter, which would contain the URL of the Helm repository if the chart is not in the default Helm repo.

We've exported the `kubeConfig` which allows you to use tools like `kubectl` to interact with the cluster after running the Pulumi program.

To run this Pulumi program, you would execute `pulumi up` within the directory of the project, after [setting up Pulumi with TypeScript](https://www.pulumi.com/docs/intro/languages/typescript/) and configuring it for use with DigitalOcean. Make sure that you have an account with DigitalOcean and that you've [configured your Pulumi DigitalOcean provider credentials](https://www.pulumi.com/docs/intro/cloud-providers/digitalocean/setup/).

Keep in mind the deployed software and required resources might incur costs in your DigitalOcean account. Always review costs associated with resources and clean up resources that you no longer use to avoid unexpected charges.