Using kubernetes kafka.strimzi.io with bitnami.com

Question

Pulumi · Accepted Answer

To deploy a Kafka cluster on Kubernetes using Strimzi, which is an open-source project that provides container images and operators for running Apache Kafka on Kubernetes, you would typically start by creating the Kafka custom resources that Strimzi defines for managing Kafka clusters.

Before diving into the Pulumi program, ensure that you have the following prerequisites in place:

1. **Kubernetes Cluster:** You should have access to a Kubernetes cluster.
2. **Pulumi Setup:** Ensure Pulumi is installed and configured to communicate with your Kubernetes cluster.
3. **Strimzi Operator Installed:** You should apply the Strimzi operator to your Kubernetes cluster, which will handle the creation and management of Kafka resources. You can install it by following the instructions on the [Strimzi website](https://strimzi.io/quickstarts/).

Once you have the Strimzi operator set up, you can use Pulumi to declare a Kafka cluster. The example below will guide you through creating such a Pulumi program using TypeScript:

```typescript
import * as k8s from "@pulumi/kubernetes";

// Create a Kafka cluster resource provided by Strimzi.
const kafkaCluster = new k8s.yaml.ConfigFile("kafka-cluster", {
    file: "https://strimzi.io/examples/latest/kafka/kafka-persistent-single.yaml",
});

// This URL points to a resource definition for a Kafka cluster with a single broker.
// The default configuration may use ephemeral storage and is not suitable for production workloads.
// You can also apply a custom YAML file by specifying the path to your local file.

// Export the Kafka cluster name
export const kafkaClusterName = kafkaCluster.getResource("v1/Service", "my-cluster-kafka-external-bootstrap").metadata.apply(m => m.name);

```

This Pulumi TypeScript program does the following:

- **Import Pulumi Kubernetes SDK**: It is required for managing resources on a Kubernetes cluster.
- **Create Kafka Cluster Resources**: Declares a Kafka cluster resource using the `ConfigFile` class from the Pulumi Kubernetes SDK. This will take the Kafka cluster definition YAML (available on the Strimzi website) and apply it to your cluster.

After writing this program:

1. Use `pulumi up` to create the resources. This command will automatically apply the configurations to your Kubernetes cluster.
2. After the command succeeds, it will output any exported values, including the `kafkaClusterName`.

Remember to review the configurations in the YAML file and adjust them according to your cluster's requirements, such as storage, resource constraints, or the number of Kafka brokers.

Keep in mind that Kafka clusters have their own set of operational considerations. It's important to understand how Kafka works and what each parameter in the YAML file means before applying it to your cluster, especially for production scenarios.

Also, be aware that using Bitnami, you can find Helm charts for Kafka. Using Pulumi with Bitnami Helm charts would require including the Helm SDK from Pulumi and setting up the Kafka chart using Pulumi's Helm release resource. However, since your request specifically mentioned Strimzi, the example above assumes you preferred to deploy Kafka using the Strimzi operator.