Deploy the kafdrop helm chart on Digital Ocean Kubernetes Service

Question

Pulumi · Accepted Answer

To deploy the Kafdrop Helm chart on the Digital Ocean Kubernetes Service using Pulumi, you will need to perform two main tasks:

Create a Kubernetes cluster on Digital Ocean.
Deploy the Helm chart for Kafdrop onto the created Kubernetes cluster.

Here's a step-by-step guide to accomplish the above tasks:

Step 1: Create a Kubernetes Cluster on Digital Ocean

To create a Kubernetes cluster in Digital Ocean, we use the digitalocean.KubernetesCluster resource, which allows us to define the configuration for the cluster such as region, version, node size, and node count.

Step 2: Deploy the Kafdrop Helm Chart

After setting up the cluster, we will use the kubernetes.helm.v3.Chart resource to deploy the Kafdrop Helm chart. This resource is designed to work with the Helm package manager in a Kubernetes cluster and allows you to deploy applications packaged as Helm charts.

Before running the Pulumi program ensure you have:

Installed Pulumi CLI and set up the Digital Ocean provider.
A Digital Ocean Access Token configured for use with Pulumi.
Installed kubectl for interacting with the Kubernetes cluster.

Now, here's the TypeScript program to achieve the deployment:

import * as pulumi from "@pulumi/pulumi";
import * as digitalocean from "@pulumi/digitalocean";
import * as k8s from "@pulumi/kubernetes";

// Step 1: Create a Kubernetes cluster on Digital Ocean
const cluster = new digitalocean.KubernetesCluster("kafdrop-cluster", {
    region: digitalocean.Regions.NYC1,  // Specify the region for the cluster
    version: "latest",                  // Use the latest Kubernetes version
    nodePool: {
        name: "kafdrop-nodepool",
        size: "s-1vcpu-2gb",           // Specify the node size
        nodeCount: 2,                  // Specify the number of nodes
    },
});

// Step 2: Deploy the Kafdrop Helm Chart
const kafdropChart = new k8s.helm.v3.Chart("kafdrop", {
    chart: "kafdrop",
    version: "latest",                  // Specify the chart version
    fetchOpts: {                        // Define repository options where the chart is located
        repo: "https://obsidiandynamics.github.io/kafdrop/charts",
    },
}, { provider: new k8s.Provider("k8s-provider", { kubeconfig: cluster.kubeConfigs[0].rawConfig }) });

// Export the cluster's kubeconfig and Kafdrop service endpoint
export const kubeconfig = cluster.kubeConfigs[0].rawConfig;
export const kafdropServiceEndpoint = kafdropChart.getResourceProperty("v1/Service", "kafdrop", "status");

Here’s what each section of the code is doing:

DigitalOcean Kubernetes Cluster: We create the Digital Ocean Kubernetes cluster specifying the desired region, version of Kubernetes, and details for the node pool such as the size and count of nodes.
Helm Chart for Kafdrop: We're deploying the Helm chart for Kafdrop into our Kubernetes cluster. The fetchOpts field is configured with the Helm repository URL that contains the Kafdrop chart.
Kubernetes Provider: Pulumi needs to communicate with the newly created Digital Ocean Kubernetes cluster to deploy resources, and it does so using a Kubernetes provider with the cluster's kubeconfig.

The last lines of the code are exporting the kubeconfig, which you'll need to manage your Kubernetes cluster with kubectl or other Kubernetes tools, and the service endpoint for Kafdrop, which you'll use to access your Kafdrop UI once it's deployed.

To run this Pulumi program:

Save this code in a file with a .ts extension, for example, index.ts.
Open the command line in the directory containing your index.ts file.
Run the following Pulumi commands to select the desired stack or create a new one, preview the deployment, and then update your stack to apply the changes:

pulumi stack select <stack_name> or pulumi stack init <new_stack_name>
pulumi up

The pulumi up command will prompt you to review the infrastructure changes and confirm them. Once confirmed, Pulumi will proceed to provision the cluster on Digital Ocean and deploy the Kafdrop Helm chart into it.

After deployment, use the output kubeconfig to configure kubectl and the kafdropServiceEndpoint to access the Kafdrop UI in your web browser.