Creating a Kafka Java Project using Maven (pom.xml)

Learn how to create a Java project using Maven that can interact with Kafka cluster

Before developing Kafka producers and consumers in Java, we'll have to set up a simple Kafka Java project that includes common dependencies that we'll need, namely:

  • Kafka dependencies

  • Logging dependencies

Follow these steps to create a Java project with the above dependencies.

Creating a Maven project with pom.xml and setting up dependencies

In IntelliJ IDEA, create a new Java maven project (File > New > Project)

Kafka Maven Java Project screenshot from IntelliJ IDEA when beginning a new Java Maven Project for interacting with a Kafka Cluster.

Then add your Maven project attributes

Screenshot showing the attributes for your Kafka Demo Java project in Maven ((pom.xl) via IntelliJ IDEA.

The build tool Maven contains a pom.xml file. The pom.xml is a default XML file that carries all the information regarding the GroupID, ArtifactID, as well as the Version values. The user needs to define all the necessary project dependencies in the pom.xml file. Go to the pom.xml file.

Defining the dependencies for Kafka Maven Client project in pom.xl xml file screenshot.

Define the Kafka Dependencies. Create a <dependencies>...</dependencies> block within which we will define the required dependencies.

Add a dependency for Kafka client as shown below

1 2 3 4 5 6 7 8 9 10 11 12 13 <project> ... <dependencies> <!-- --> <dependency> <groupId>org.apache.kafka</groupId> <artifactId>kafka-clients</artifactId> <version>3.0.0</version> </dependency> </dependencies> </project>

If the version number appears red in color, it means the user missed to enable the 'Auto-Import' option. If so, go to View > Tool Windows > Maven. A Maven Projects Window will appear on the right side of the screen. Click on the 'Refresh' button appearing right there. This will enable the missed Auto-Import Maven Projects. If the color changes to black, it means the missed dependency is downloaded.

Screenshot showing the Maven Projects window on the right for our Kafka Maven project.

Add another dependency for logging. This will enable us to print diagnostic logs while our application runs.

1 2 3 4 5 6 7 8 9 10 11 12 13 <!-- --> <dependency> <groupId>org.slf4j</groupId> <artifactId>slf4j-api</artifactId> <version>1.7.32</version> </dependency> <!-- --> <dependency> <groupId>org.slf4j</groupId> <artifactId>slf4j-simple</artifactId> <version>1.7.32</version> </dependency>

Now, we have set all the required dependencies. Let's try the Simple Hello World example.

Creating your first class

Create a java package say, io.conduktor.demos.kafka.HelloWorld

Screenshot showing how to create a new java class for our Kafka Maven project.

While creating the java package, follow the package naming conventions. Finally, create the sample application program as shown below.

1 2 3 4 5 6 7 8 9 10 11 12 package io.conduktor.demos.kafka; import org.slf4j.Logger; import org.slf4j.LoggerFactory; public class HelloWorld { private static final Logger log = LoggerFactory.getLogger(HelloWorld.class); public static void main(String[] args) {"Hello World"); } }

Run the application (the play green button on line 9 in the screenshot below) and verify that it runs and prints the message, and exits with code 0. This means that your Java application has run successfully.

Expand the 'External Libraries' on the Project panel and verify that it displays the dependencies that we added for the project in pom.xml.

Screenshot from IntelliJ showing that we have created a sample Kafka Maven Java project that includes all required dependencies.
All good!

We have created a sample Java project that includes all the needed dependencies. This will form the basis for creating Java producers and consumers next.

Was this content helpful?
PreviousJava Kafka Programming
NextCreating a Kafka Java Project using Gradle (build.gradle)