Deploy the kafka-helm-chart helm chart on Azure Kubernetes Service (AKS)

Question

Pulumi · Accepted Answer

Deploying a Helm chart onto an Azure Kubernetes Service (AKS) cluster involves several steps.

First, we would need to set up an AKS cluster, if one isn't already available. We will use Pulumi's azure-native provider to create an AKS cluster. This provider allows us to interact with Azure resources natively.

Next, we would need to configure the Kubernetes provider to interact with the AKS cluster. This provider is how Pulumi communicates with Kubernetes API servers and thus, manages resources in Kubernetes.

Then, we will use Pulumi's harness provider to deploy the Helm chart onto the Kubernetes cluster using a Helm resource. The harness provider enables the use of Helm charts for deploying applications on Kubernetes clusters.

Here is a TypeScript program that demonstrates how to achieve this:

import * as pulumi from '@pulumi/pulumi';
import * as azure_native from '@pulumi/azure-native';
import * as k8s from '@pulumi/kubernetes';
import * as harness from '@pulumi/harness';

// Create an AKS cluster.
const aksCluster = new azure_native.containerservice.ManagedCluster("aksCluster", {
    resourceGroupName: "myResourceGroup",
    // ... additional required fields and optional settings like node size, number of nodes, etc.
});

// Export the Kubernetes config and create a Provider.
const k8sProvider = new k8s.Provider("k8sProvider", {
    kubeconfig: aksCluster.kubeConfigRaw,
});

// Deploy the Kafka Helm chart onto the AKS cluster.
const kafkaHelmChart = new harness.service.Helm("kafkaHelmChart", {
  name: "kafka",
  appId: "<YOUR_APP_ID>", // You need to replace this with your actual app ID from Harness.
  // Set the chart details
  chart: "kafka-helm-chart",
  version: "latest", // specify the chart version here if needed
  namespace: "default", // specify the namespace where the chart should be installed
  // Values for the Helm chart
  values: { /* Put the Kafka Helm chart values here */ }
}, { provider: k8sProvider });

// Export the cluster's kubeconfig.
export const kubeconfig = aksCluster.kubeConfigRaw;

Make sure to replace "<YOUR_APP_ID>" with your actual application ID from Harness and provide the necessary configuration for the AKS cluster, such as the node size, number of nodes, and the name of the resource group in which you want the cluster to be created. Similarly, in the kafkaHelmChart.values field, provide the necessary Kafka Helm chart values that suit your requirements.

Once this program is executed with Pulumi (pulumi up), it will provision an AKS cluster and then deploy the Kafka Helm chart onto that cluster.

To run this Pulumi program, ensure you have Pulumi CLI installed and configured for Azure. Then, follow these steps:

Save the code to a file with a .ts extension (like deployKafka.ts).
Run pulumi stack init to create a new stack for your project if you haven't already done so.
Run pulumi up to execute the code and create the resources. Pulumi will show you a preview of the resources that will be created, and you can confirm to proceed.

This code will create a new instance of AKS and install Kafka on it using the specified Helm chart. The kubeconfig output can be used to interact with the Kubernetes cluster using the kubectl command-line tool. Remember to review and adjust chart version, configurations, values, and resource group as per your actual setup requirements.