The Conduktor Blog
Data Integration - The What, Why, and Benefits
In this blog we'll go over Data Integration. What is it? Why is it? What are some of the benefits? Then, let's look at the how.
Kafka Playground: Two Free Clusters Without the Operational Hassles
We are proud to announce the launch of our Playground, giving Conduktor Cloud users access to two free Apache Kafka clusters for experimentation.
Topic as a Service: Automate Governance Decisions for Apache Kafka
Kafka's widespread usage has introduced problems related to governance, as different teams combine their Kafkas. Topic as a Service for the Conduktor Platform was built to help solve these issues.
KRaft Quorum: How to run Kafka without Zookeeper
In this article, we’ll discuss what Zookeeper is, what its role is, its limitations, and how KRaft mode mitigates those limitations.
Conduktor Monitoring and Alerting - Deep Dive
Monitoring and Alerts are vital for the long term health of systems, and Kafka is no different. Unfortunately, no solutions exist that have been configured especially for Kafka - until now. Conduktor Platform delivers seamless monitoring and instant alerts.
Data Lakes vs. Data Warehouses
Explore the difference between the two storage paradigms of data lakes and data warehouses. Learn the pros and cons of each and which situations they are suited for.
What is Data Streaming?
A primer on real-time data streaming, the innovation that empowers the modern internet. Get a high-level overview of how it works and the challenges faced.
4 key new features of Conduktor Console
What are the coolest things you can do with Conduktor Platform? Aside from testing, monitoring, multi-tenancy, chaos engineering, and all that? It's not just new solutions, as the core Kafka UI offers several amazing new features. Take a look below.
Conduktor Console: The Evolution of Kafka User Interfaces
Conduktor Console is the new user interface for Apache Kafka available in the Conduktor Platform. This blog will take a look at the features of the Console and how it can help your data exploration, Kafka operations, and troubleshooting.
Kafka Partition Assignment Strategy
Kafka consumers pull data from topic partitions, but what happens if a consumer dies? How will the partitions be reassigned, and what is the best method of reassignment? This article looks at the partition.assignment.strategy configuration and the different options it enables.
What is the Schema Registry and why do you need to use it?
Engineer Lorcan Cooke looks into what Schema Registry is and why you should use it for your Apache Kafka. In part 3, Lorcan demonstrates how to set up an Aiven Karapace registry with Conduktor Platform
Security for Apache Kafka in Conduktor Platform: A Deep Dive
A look at the Apache Kafka security features available for users of the Conduktor Platform.
Getting Started with Data Pipelines and Data Pipeline Architecture
In this blog, we’ll look at data pipelines and the various potential pipeline architectures. We’ll also explore the technologies behind data pipelines, their features, and how they are constructed.
The Conduktor Team in Milan
In the final week of September, the entire Conduktor team gathered in Milan as we launched the Platform. Take a look at some of the best pictures from the event.
Conduktor Testing - Deep Dive
Conduktor Testing provides a simple, visual interface for testing applications that incorporate Apache Kafka. Find out more in our deep dive
Introducing the Conduktor Platform
The Conduktor Platform is a new product that will transform your approach to Apache Kafka, providing solutions for Kafka management, testing, monitoring, data quality, security, and data governance.
Building Real Time Applications with Kafka Streams
Kafka Streams is a simple library built on top of Kafka that enables you to build real-time applications. In this article, we'll look at how Kafka Streams can be used.
Understanding Kafka's Internal Storage and Log Retention
Apache Kafka is a commit-log system. Kafka allows us to optimize the log-related configurations. These configurations can impact broker performance, and we'll show you how to optimize settings in this article.
A distributed system is a computing system in which the various components are spread out across a network of devices. The majority of modern computing involves distributed systems in some way and we'll look in more depth below.
Conduktor Now Offers Topic-Level RBAC
We're pleased to announce that topic-level role-based access control is now available in the latest versions of Conduktor.
Validating Event-Driven Architectures
Demonstrating how to use our latest product to validate workflows and test data integrity at each stage of your system architecture.
Understanding the Apache Kafka Architecture
Apache Kafka offers a simple yet powerful architecture that can handle a wide variety of use cases. In this article, we will explore the details of Kafka's architecture.
Comparing Apache Kafka and Apache Pulsar
Apache Kafka and Apache Pulsar are both open source messaging solutions that can cover many of the same use cases, but with some key differences. We'll examine their strengths and weaknesses below.
Comparing Apache Kafka, ActiveMQ, and RabbitMQ
Apache ActiveMQ, RabbitMQ, and Apache Kafka are generally considered messaging middleware. This article explores each technology, compares and contrasts the differences, and concludes with intended use cases.
Testing your Apache Kafka Data with Confidence
In this post, we’ll explore some methods you can use to test components within your Apache Kafka architecture.
Managing your Kafka Topics with Conduktor
A look at how Conduktor helps you manage the Topics on your Kafka cluster.
Kafka & Spark - A match made in data
A look at how Apache Kafka & Apache Spark perfectly complement each other to solve for many use cases.
The Fastest Way to Start Kafka Ever
Conduktor allows you to start a local Kafka cluster in just a couple of clicks.
Capturing MySQL database changes using Debezium, Kafka, and Conduktor
Using Kafka Connect in Conduktor and specifically how to use Debezium to monitor the changes in a MySQL database.
Kafka vs Kinesis: Comparing Across Five Dimensions
In this blog, we deep-dive into Kinesis vs Kafka, evaluating the data event streaming solutions across 5 dimensions.
Ensuring Maximum Security with Conduktor Desktop v2.20.1
Our latest release updates a number of dependencies to ensure maximum security for Conduktor Desktop users.
Conduktor raises $20M Series A
We’ve just raised $20M Series A funding and we’re super excited about what that means for our community.
Open Sourcing our API Template
We'd like to help the community and share our best practices when coding an API in Scala.
Real-time data visualization
See how Conduktor helps extracting and visualization interesting insights out of your data.
Why use Kafka Connect?
Using Conduktor to stream data between Apache Kafka and other data systems in a reliable and scalable way.
How Replication and ISR work in Apache Kafka
Kafka works on the basic model of decoupling the source system and target system, so instead of Source systems (Producers) directly sending data to the target system, now Source systems publish data to Kafka and Target systems or Consumers subscribes to these events to get data directly from Kafka.
How to Produce and Consume Protobuf Records in Apache Kafka
Protobuf is a powerful alternative to Apache Avro when it comes to data serialization and schemas compatibility.