Learn about Apache Kafka and its ecosystem in 20 minutes.

What is Apache Kafka?

Learn how Kafka works, get a strong understanding of the different components

Kafka Fundamentals

Understanding Kafka

Starting Kafka

Learn how to use Kafka Command Line Interface (CLI)

Kafka CLI Tutorials

How to interact with Kafka programmatically?

Kafka Programming Tutorials

Practice using Kafka

Kafka Advanced Concepts

Series of advanced tutorials on important Kafka administration subjects

Kafka Administration

Next Level Kafka

Kafka Connect and creating a connector in Conduktor

Kafka Connect Create Connector

Kafka Connect Overview in Conduktor Screenshot

Kafka Connect Overview

Conduktor & Kafka Connect

kafka-topics.sh --bootstrap-server localhost:9092 --topic wikipedia.recentchange --create --partitions 3 --replication-factor 1

kafka-topics.sh --bootstrap-server localhost:9092 --topic wikipedia.dlq --create --partitions 3 --replication-factor 1

 ~/kafka_2.13-3.0.0/connectors  ls -R
kafka-connect-sse

./kafka-connect-sse:
connector.properties                            kafka-connect-sse-1.0-jar-with-dependencies.jar

name=sse-source-connector
tasks.max=1
connector.class=com.github.cjmatta.kafka.connect.sse.ServerSentEventsSourceConnector
topic=wikipedia.recentchange
sse.uri=https://stream.wikimedia.org/v2/stream/recentchange
errors.tollerance=all
errors.deadletterqueue.topic.name=wikipedia.dlq

key.converter=org.apache.kafka.connect.json.JsonConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=true
value.converter.schemas.enable=true
offset.flush.interval.ms=10000

# EDIT BELOW IF NEEDED
bootstrap.servers=localhost:9092
offset.storage.file.filename=/tmp/connect.offsets
plugin.path=/Users/stephanemaarek/kafka_2.13-3.0.0/connectors

connect-standalone.sh ~/kafka_2.13-3.0.0/config/connect-standalone.properties ~/kafka_2.13-3.0.0/connectors/kafka-connect-sse/connector.properties

Screenshot showing the process for starting your Kafka Connect Standalone Connector via CLI

Starting Kafka Connect Standalone Connector

kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic wikipedia.recentchange

Screenshot showing the wikipedia data flowing into the Kafka Topic via the standalone Kafka Connect connector started via the CLI.

Data Flowing into Kafka Topic via Kafka Connect Standalone Connector

Learn how to use Kafka Connect in standalone mode to write data into Apache Kafka.

Kafka Connect CLI Tutorial

Apache Kafka CLI Tutorial showing how to use Kafka Connect in standalone mode to write data into Apache Kafka.

Learn Apache Kafka CLI Tutorial for Kafka Connect showing how to use Kafka Connect in standalone mode to write data into Apache Kafka