© 2019 DataCumulus OÜ - All Rights Reserved

Apache, Apache KafkaKafka, and associated open source project names are trademarks of the Apache Software Foundation
Conduktor is not affiliated with, endorsed by, or otherwise associated with the Apache Software Foundation (ASF) or any of its projects.

 us on Twitter to get the latest news in real-time

- decimal types (bytes) renders as number as strings
- timestamp-millis (long) rendered as string
A FIRST CLASS CITIZEN

Apache Avro is a first-class citizen within Conduktor.

When we consume Avro data, Conduktor renders it as JSON to be human-readable. But Avro is more complex and has special types (logicalTypes) that need special handling.

 

Hopefully, Conduktor understands them and make them human-readable. No "bytes" or timestamps, but friendly formatted strings.

Schema registry

Conduktor has a great support of the Schema Registry and Avro.

It supports complex schemas, displays and group all the records part of the same subject. It also build an inverted view to be able to identify which schemas are repeated, which ones are using the same name, how many variants of a schema there is. You can be aware of potential conflicts and issues at a glance.

This is  part of a large effort to help governing the data safely in  an enterprise.

Consuming data

Conduktor offers a LOT of ways to consume and work with your data.

It's possible to consume from data from the last hour only, from today, from a specific date, or totally from the beginning of the topic! For more advanced usages, it's also possible to consume using specific offsets and from an existing consumer group.

You are interested in messages containing only some data, or only by a specific key? It's possible to filter by key, value, or header. 

Also, Conduktor displays in real-time the consumption per partition. It's useful to understand how Kafka works, to see if some partitions or brokers are running into troubles, or to tune consumer configuration to be faster.

Note that Conduktor will never commit anything to your cluster, it does not use any consumer group: it does not leave any traces on your cluster. You can use it safely.

Multi Kafka Connects

Kafka Connect makes it easy to integrate Kafka with external systems such as databases, key-value stores, search indexes, and file systems.

It's possible to have several Kafka Connect clusters working on the same Kafka Cluster. Each of them maintained by a different team, or dedicated to a special type of connectors

It's now possible to manage multiple Kafka Connects within Conduktor. It will visually "merge" everything to abstract from which Kafka Connect the connector comes from. Conduktor will warn you when clusters or connectors are down.

PERFORMANCES & Friendliness

Finally, a long-due feature! Copy text displayed in Conduktor. In a web-based environment, it's a given. But we are not web-based, so we needed some more work. Right-click when there is something interesting to grab and a context menu will appear.

 

 

Also, it's now possible to configure what is displayed inside Conduktor (per cluster), and prevent it to consume tons of memory, CPU, be slow, make lots of IOs etc. by just disabling some features you don't need (or if you cluster is huge). It's also possible to configure the Kafka options used by the consumers, producers, and admin used within Conduktor (for more advanced use-cases).

LOGIN

To use Conduktor, you now have to log in. An Internet Connection is therefore required. You will have the option to use a classic account (email, password) or instead use your Twitter/Github/Google account.

These changes are necessary so that we can prepare to offer you enterprise features, team management, work on the same configuration as your colleagues, offer subscriptions, and much more!

As of today, nothing changes except you are logged in, and we will accurately know how many people are using Conduktor on a regular basis (something we're dearly missing). 

We take data privacy seriously and we are only requiring a minimal set of information. Please check out our TOS and Privacy Policy pages if you have doubts. 

We are a small team and are working very iteratively to offer you new features as fast as we can. Login is the first step, and we are so excited of the many features to come.

Thanks for your help and your continued support!

The Team of Conduktor

Stéphane & Stéphane