Deploy the hadoop-deployment helm chart on AWS EKS

Question

Pulumi · Accepted Answer

To deploy the "hadoop-deployment" Helm chart on AWS EKS using Pulumi, we'll proceed with the following steps:

1. Set up the EKS cluster on AWS.
2. Install the Helm chart on the cluster.

### Setting Up EKS Cluster

First, we'll need an EKS cluster. Pulumi's EKS package simplifies the creation of EKS clusters. It handles the necessary heavy lifting, such as creating the VPC and the node group. We'll create an EKS cluster and a node group for our nodes using AWS's `eks.Cluster` resource.

### Installing the Helm Chart

After setting up the EKS cluster, we'll deploy the Helm chart to the EKS cluster. Pulumi's `kubernetes.helm.v3.Chart` resource from the Kubernetes package helps us deploy Helm charts.

Now, let's start writing our Pulumi program in TypeScript.

```typescript
import * as eks from "@pulumi/eks";
import * as k8s from "@pulumi/kubernetes";

// Create an EKS cluster for our workloads.
const cluster = new eks.Cluster("hadoop-cluster", {
    instanceType: "t2.medium",
    desiredCapacity: 2,
    minSize: 1,
    maxSize: 2,
});

// Export the cluster's kubeconfig.
export const kubeconfig = cluster.kubeconfig;

// Create a k8s provider that uses our EKS cluster's kubeconfig.
const k8sProvider = new k8s.Provider("k8s-provider", {
    kubeconfig: cluster.kubeconfig.apply(JSON.stringify),
});

// Deploy the "hadoop-deployment" helm chart using the k8s provider.
const hadoopDeploymentChart = new k8s.helm.v3.Chart("hadoop-deployment", {
    chart: "hadoop",
    version: "your-hadoop-chart-version", // Specify the chart version here
    fetchOpts: {
        repo: "https://charts.yourrepo.com/", // Put your Helm chart's repository URL here
    }
}, { provider: k8sProvider });

// Expose the resources generated by the helm chart, if needed.
export const helmChartResources = hadoopDeploymentChart.resources;
```

Let's explain the code:

- We create an EKS cluster named `hadoop-cluster` with the instance type `t2.medium`. We choose an instance size according to the requirements of your workloads.
- The cluster details, including kubeconfig, are exported so we can interact with the cluster outside of Pulumi.
- We create a Kubernetes provider using the kubeconfig of our EKS cluster to interact with our Kubernetes deployments.
- We deploy the "hadoop-deployment" Helm chart using Pulumi's Helm chart resource. Please replace `your-hadoop-chart-version` with the version of the chart you wish to deploy, and replace `https://charts.yourrepo.com/` with the repository URL where the Helm chart is hosted.
- Lastly, we export the Helm chart's resources for external use if required.

This program creates an EKS cluster and deploys the specified Helm chart. Remember to replace the placeholder values with the actual information for your Helm chart. After writing this program, save it in a TypeScript file (e.g., `index.ts`).

To run this Pulumi program, you'll need the Pulumi CLI installed and configured for AWS access. With that configured, run `pulumi up` to deploy your resources to AWS. This will provision an EKS cluster and install the Helm chart onto it.