Secrets in Kafka

Store SASL credentials as secrets for Kafka sources and destinations.

  less than a minute  

Store SASL credentials as secrets for Kafka sources and destinations.

Kafka Source with SASL Authentication

Secret to create:

Secret NameDescription
kafka-sasl-passwordYour Kafka SASL password

Kafka Input Node:

- name: kafka_source
  type: kafka_input
  brokers:
    - kafka.example.com:9092
  topics:
    - logs-topic
  sasl:
    enabled: true
    mechanism: PLAIN
    username: kafka-user
    password: '{{ SECRET kafka-sasl-password }}'

Kafka Destination with SASL Authentication

Secret to create:

Secret NameDescription
kafka-producer-passwordYour Kafka producer SASL password

Kafka Output Node:

- name: kafka_destination
  type: kafka_output
  brokers:
    - kafka.example.com:9092
  topic: processed-logs
  sasl:
    enabled: true
    mechanism: PLAIN
    username: producer-user
    password: '{{ SECRET kafka-producer-password }}'

Multiple Kafka Clusters

If you connect to multiple Kafka clusters, create separate secrets for each.

Secrets to create:

Secret NameDescription
kafka-prod-passwordProduction Kafka password
kafka-dev-passwordDevelopment Kafka password

Multiple Kafka Connections:

- name: kafka_prod_source
  type: kafka_input
  brokers:
    - kafka-prod.example.com:9092
  topics:
    - prod-logs
  sasl:
    enabled: true
    mechanism: PLAIN
    username: prod-user
    password: '{{ SECRET kafka-prod-password }}'

- name: kafka_dev_destination
  type: kafka_output
  brokers:
    - kafka-dev.example.com:9092
  topic: dev-processed-logs
  sasl:
    enabled: true
    mechanism: PLAIN
    username: dev-user
    password: '{{ SECRET kafka-dev-password }}'

See Also