Kafka

This document explains the steps to configure Kafka as a source in Lemnisk.

Lemnisk provides Kafka as a source to send data to Lemnisk via your Kafka producers. With Kafka, you can handle large volumes of real-time data with ensured security and reliability.

Steps to configure Kafka as Source

Go to -> Data Pipeline -> Sources

Step 1: Click on +Create New Source

Step 2: Select the source type as Kafka and click Proceed

Image: Selecting Kafka as source

Step 3: Set up the source

Source name: Add a unique name to the source and click the "Create" button.

You can find the following details once the source is created.

• Host Name

• Port

• Topic Name

• Authentication Details

You can configure these details in your Kafka setup to produce messages to our Kafka.

A maximum of 3 Kafka sources can be added per account.

Step 4: Click the "Test" Button above the payload to test your integration.

Test the integration

To test the integration, configure the Kafka details shown and click on "TEST". Produce a Kafka event to the consumer and if we receive the event successfully, a success message will be shown indicating successful source configuration.

Payload: The correct format for the payload to send events will be displayed here. You can copy the payload and use it while sending Kafka events.

Image: Source-Kafka

Demo: Creating Kafka as Source