How do I manage dynamic Logstash configurations in Kubernetes via ConfigMaps?

In this guide, we will manage dynamic Logstash configurations in a Kubernetes cluster using ConfigMaps. ConfigMaps allow you to decouple configuration artifacts from image content to keep containerized applications portable. We will create a ConfigMap to hold Logstash configuration files and then mount this ConfigMap into a Logstash Pod.

Key Points:

ConfigMap: Stores the configuration files for Logstash.
Pod: Uses the ConfigMap to configure Logstash dynamically.
Pulumi: Manages the Kubernetes resources.

Steps:

Define a ConfigMap with Logstash configuration.
Create a Logstash Pod and mount the ConfigMap.

import * as pulumi from "@pulumi/pulumi";
import * as k8s from "@pulumi/kubernetes";

// Create a ConfigMap to store Logstash configuration
const logstashConfigMap = new k8s.core.v1.ConfigMap("logstash-config", {
    metadata: { 
        name: "logstash-config",
        namespace: "default",
    },
    data: {
        "logstash.conf": `
            input {
                stdin { }
            }
            output {
                stdout { codec => rubydebug }
            }
        `,
    },
});

// Create a Pod that uses the Logstash configuration from the ConfigMap
const logstashPod = new k8s.core.v1.Pod("logstash-pod", {
    metadata: {
        name: "logstash",
        namespace: "default",
    },
    spec: {
        containers: [{
            name: "logstash",
            image: "docker.elastic.co/logstash/logstash:7.10.1",
            volumeMounts: [{
                name: "config-volume",
                mountPath: "/usr/share/logstash/pipeline/logstash.conf",
                subPath: "logstash.conf",
            }],
        }],
        volumes: [{
            name: "config-volume",
            configMap: {
                name: logstashConfigMap.metadata.name,
            },
        }],
    },
});

export const podName = logstashPod.metadata.name;

Summary:

In this example, we created a ConfigMap to store the Logstash configuration file and then created a Logstash Pod that mounts this configuration file. This setup allows you to dynamically manage Logstash configurations in your Kubernetes cluster using Pulumi.

Deploy this code

Want to deploy this code? Sign up for a free Pulumi account to deploy in a few clicks.

New to Pulumi?

Want to deploy this code? Sign up with Pulumi to deploy in a few clicks.