Changelog

• Fix Consumer using Protobuf data format

• Detect kafka version 3.2.x
• Fix managed cluster not starting when system environment has a CLASSPATH variable [fix]
• Fix Redhat Streams for Apache Kafka creation wizard

• Improve Producer popup behavior regarding topics and subjects
• Improve AWS support
• Fix protobuf schema viewer
• Improve Confluent cluster integration wizard
• Adding SSO and automated service-account creation to Redhat integration wizard
• Fix Kafka Connect JDBC plugin for older versions
• Support resetting consumer groups offset to specific values
• Fix column width in topic detail screen on autorefresh
• Use Network trusted certificates for Kafka Connect
• Format records from '__transaction_state' in a readable way
• Closing pop-ups when closing main window
• Keys can be copied from Most frequent keys mode in consume popup

• Add Protobuf serializer in producer
• Fix consumer Overall Lag

• No more Microsoft Defender SmartScreen alerts during installation/upgrade
• Fix user feedback dialog
• Fix ksqlDB query execution
• Use Network trusted certificates for Kafka and Schema Registry
• Fix possible connection errors with AWS
• Improve Windows support for Managed Kafka clusters
• Improve JDBC connector support in the Kafka Connect wizard
• Add Network option to allow non-trusted certificates automatically
• Display a loading state when computing the lag of a Consumer Group
• Dates can be displayed as Local or UTC
• Improve Aiven url support in the Aiven wizard
• Create a consumer group from the topic view
• Fix consumer view save/restore with custom schema inputs

• Add ksqlDB multiplexing limit configuration settings.
• Support ksql timestamp type.
• Support AWS Glue Registry deserializer without plugins

• Display Topics view when connecting to a cluster
• Improve visibility of text tips in dark mode
• Fix Similar Config widget reporting false differences under Kafka 3.x
• Add support of Avro Schema coming from RedHat Apicurio Registry via Conduktor Plugins
• Add support of Avro Schema coming from AWS Glue Schema Registry via Conduktor Plugins

• Fix error on producer when using AVRO schema and the default topic name strategy
• New Redhat Openshift Apache Kafka configuration wizard

• Fix error on producer when using random data generator
• Fix bad filtering on acl principal
• Improve handling of ksqlDB connection errors
• Improve the schema creation UI by making the record name derived from the schema

• Set default Subject Name Strategy to 'TopicNameStrategy'
• Fix an issue where some symbols could not be written in JSON textfields on macOS
• Fix topics sort order using smart groups
• Improve Redpanda support
• Update the Confluent Cloud cluster creation wizard

• Fix random freeze of the application on Mac M1
• When exporting an invalid configuration, point out the affected component
• Create a consumer group for selected topics

• Add timestamp to Consumer options
• Disable replication factor modifications for Confluent Cloud and Red Hat OpenShift Streams for Apache Kafka
• Option to copy record key, value or both in topic consumer view
• Clusters list can be filtered

• Allow milliseconds precision for Consumer Start and Limit
• Support consuming Protobuf without custom plugins
• Introduce Kafkademy in Conduktor to learn Apache Kafka

• Fix unexpected error when using Consumer custom deserializers
• Fix Consumer using filtering on Schema ID
• Fix Consumer Group not visible in the ACLs
• Improve the error message when the user tries to use a Custom Deserializer from a plugin jar that is not a fat jar

• Allow to resize Broker Id column
• Launch Kafka like never before 🚀

• Improve Consumer Configuration UX
• Fix error when importing a github config with spaces in the filename

• Fix more security issues regarding log4j (CVE-2021-44228)
• Producer now produces minified JSON

• Consumer Group Reset Offsets was not working anymore
• Fix Schema Viewer for Protobuf
• Disable Advanced Topic operations when none are available
• Improve Welcome Screen UI/UX
• Improve ClusterID UX
• Prevent the mouse wheel from changing numeric fields
• Limit the size of the producer's random string to 10MB
• Add new views to help understand ACLs
• When importing a CSV into a Topic, display how many records were produced
• When creating a Subject, make it easier to look for topics
• Fix the hidden Reset Offsets button in the Connectors view

• Fix regression in offset selection by time
• Fix Brokers ordering by size
• Hide unnecessary Cluster Authorization errors
• Improve Consumer Group performance
• Cluster Configuration dialog size can be too small
• Fix in producer: Avro strategy and schema are not readable
• Fix indicators visibility in the menu
• Use new Conduktor logo
• Fix a bug when deserializing a protobuf message containing well known type

• Rename "JSON field" to "Field selection" in consumer filters view

• Fix a bug when exporting a cluster configuration with additional properties contains empty lines
• Fix cluster colors in clusters list

• Fix serialization of Kafka Connect configuration when the field is empty.

• Security patch: Update Logback from v1.2.8 to v1.2.9

More information about the security patch, see: https://www.conduktor.io/ensuring-maximum-security-conduktor-desktop-v2.20.1

• Security patch for CVE-2021-42550
• Improve the user experience when feature management is enabled

More information about the security patch, see: https://www.conduktor.io/ensuring-maximum-security-conduktor-desktop-v2.20.1

• Fix a crash happening in the broker details view
• Fix producer when used with avro & schema registry

• Upgrade AWS MSK libs and include required libs for SSO support

• Consumer can now display aggregate value count by key

• New feature: custom deserializers are now available to consume your topics

Custom deserializers documentation: https://docs.conduktor.io/features/consuming-data/custom-deserializers
Plugins documentation: https://docs.conduktor.io/kafka-cluster-connection/setting-up-a-connection-to-kafka#plugins-aka-custom-jars

• Deprecate Brokers Restart and Decommission features

• Minor performance fixes

• Fix partitions spread indicator
• Performance improvement: lazy loading of kafka consumer group details.

• Allow to combine several filters with and/or semantic on consumers
• Don't loose parameters when switching back and forth between consumer filter/from/limit types

• Fix loading of Consumer views containing a 'And' filter

• Fix Consumer & Producer unexpected error

• Fix the Test Connectivity feature
• Support dark mode in Security Graph

• Fix schema diff, security graph and ksql queries rendering for offline users
• Display an error when setting an invalid topic or broker configuration
• Consumer: stop fetching from a partition when the limit is reached
• Import/Export multi clusters encrypted configuration
• Fix: Last by key option in consumer could loose some keys
• Embed certificate files in cluster export

• Added the ability to request a new verification email from the main view

• Remove the "Read-only" mode in profit of the Cluster Permission system
• Fix kafka connect connection test with confluent cloud

• Make the Producer view type selection work again

• Fix the "reset source offsets" window (Kafka connect) that no longer opens
• In the Record details, sort headers alphabetically

• Improve style of SchemaRegistry and Plugins config screens

• New feature: You can now extend Conduktor capabilities with plugins (aka “custom jars”)
• Allow access to Schema Registry even when connected to a different Apache Kafka cluster

• Fix style for "Additional Properties"
• Fix default connection timeout (30s)
• Fix Consumer Offsets Reset: Timezone shift when resetting by datetime

• Fix an error occurring when saving configuration
• Fix potential error when clicking on the the 'producer' button

• Improve stability and performances
• Fix export on consumer group view

• Fix Consumer custom schema strategy
• Fix InvalidKey error that may happen for certain users
• Improve Kafka Connect task status readability
• Producer: Add void serializer

• Improve stability and performances

• Fix possible crash on Windows

• Fix randomly generated string size configuration in the producer
• Fix Jolokia integration on Aiven clusters
• Fix the partition layout in the consumer

• Fix an error occurring when leaving a cluster

• Reduce memory usage of the Consumer view
• Fix an issue occurring for Avro subjects wrapping a single record in an Union
• Reduce memory consumption
• Display more metrics related to ACLs in the Security tab

• Fix a potential memory leak when connecting to a cluster fails

• Be robust to absence of a Coordinator in Consumer Group View
• We can now save Consumer configurations into Views

• Bug fix: kafka consumer may not be stopped and export file may be incomplete
• Fix bug: When exporting topics, metadata did not take custom column into consideration
• Fix bug: On Mac, when exporting some data from a consumer, the exported file was not having the correct extension.
• Fix bug - Consumer Group: "Specific datetime" reset offsets datepicker doesn't update the value in the field
• Improve JSON highlighting theme
• Disable JSON highlighting for large JSONs
• We now detect cluster versions up to Kafka 2.8.x
• Subject "current version" now filters out deleted version and displays the first non-deleted version
• Add an hexadecimal view to display binary data in the consumer
• Fix bug: Consumer Groups list is empty when we refresh with favorites only
• Introduce circuit breaker to avoid user credentials to be banned by kql server.
• Consumer Record Details: copy headers
• Prevent misconfigurations by validating the cluster id of Connectors, Schema Registry and KsqlDB
• Fix Jolokia integration
• Fix the metrics not loading on leaving/re-entering cluster
• DatePicker is now more usable in dark mode

• Fix bug in consumer (error popup) when stop condition is met
• Reduce overhead when opening Producer and Consumer popups with lots of topics

• When selecting a custom topic property to display in topics view, the full list is now browsable
• Fix the "Consumed from ..." windows format options being slow to update. (#99)
• Fix the "Consumed from ..." windows options being overridden when the loading of the topics is slow. (#87)
• Display the clusterId in the brokers view
• In Schema Registry, when a Subject doesn't have any CompatibilityLevel configuration, show inherited CompatibilityLevel
• Provide a "Duplicate" action on existing Kafka Connect connectors
• Add the cluster name to title when editing the cluster (#80)
• Remove the Performance menu (will be back later)
• Make sure configuration settings can't produce corrupted files when save process is interrupted

• Reduce memory pressure when monitoring is enabled
• When a topic uses a schema and a projection is restored, we now display the projection when opening a "Consume from Topic" window
• When reassigning Topic Partitions, handle any kind of input in "new replication factor" instead of displaying an error message
• Improve the Schema Registry Structure tab and fix some edge cases
• Fix a potential issue with the backward/forward navigation controls

• Support IAM Access Control for Amazon MSK clusters

• When you enter a badly formatted input into a datetime field, the error is handled and the last valid date is put back
• Cancel connectivity tests on window close
• Added support for generating data from a recursive avro schema
• Ask confirmation on consumer/producer closing when triggered by escape key
• Display a message when doing ksqlDB INSERTs instead of nothing
• Support the Fixed avro datatype and fix bytes encoding in example payloads
• In the ACLs, fix an issue where a Principal could be empty
• In the Schema Registry, minor issues were fixed when parsing tricky schemas, and a structural view was added

• In the subject details, add a button to quickly look at its latest version
• Fix default double generation in avro records
• Improve Topics UI to make it easier to capture essential information at a glance
• Fix minor Dark mode color issues
• Add typeahead dropdowns in the Producer along with many UI improvements

• Support ksqlDB 0.17
• It's now possible to synchronize a cluster configuration from GitHub (enterprise)
• Add a Notification system within Conduktor to notify you of external events or cluster events
• Add a dark version of the treeview and SQL viewer
• Fix producer generating 'Infinity' for doubles
• Add more realtime metrics for the brokers & topics
• Improve Welcome Screen UI
• Update metrics in realtime
• Handle topics reset for Connectors
• Large performance improvement for the Producer's random generation
• Fix Avro error messages

• In the Producer, we can now generate random content in the payload
• Improve support of non-record Avro schemas
• Fix lost data when duplicating producer templates
• Prevent producer from failing silently
• Fix ACL set for Consumers
• Add back the ALL operation type for custom ACLs

• Address Kafka Connect performance issues and add a parallelism configuration
• Fix producer re-encoding base64 payloads
• Improve & Simplify the Consumer dialog
• Simplify and improve the Producer layout UI
• It's now possible to consume Avro records with embedded schemas (binary Avro files, Apache Nifi, ...)
• Improve controls hovering state visibility
• Greatly improve the Consumer options UI
• Improve Avro support when consuming data with custom subject/schemas

• Fix producer sending empty keys instead of null when clearing field
• Display inactive Consumer Groups in Topic(s) views and improve performances
• Fix produce from CSV emitting only one record

• Improve JMX metrics error handling
• New "Flow" feature for the Producer: produce multiple records at once or automatically at a specific interval
• Improve Brokers config differences analysis
• Allow producing and consuming null root avro records
• Fix Unhandled Serializer error blocking the Producer UI
• Improve Conduktor resiliency when some Kafka Connect instances fail
• We can now export data to JSON in the Consumer

• Improved the dark theme and fixed related visual artifacts
• We can now import CSVs into topics

• In the Consumer, we can now save the records into a .csv without restarting
• Revamp our Producer to be able to generate random payloads according to the types/schemas used. Way more features to come in this area!
• It's now possible to remove committed offsets for specific topics on a Consumer Group
• Update the Confluent Cloud integration wizard (#25)
• Synchronize ACLs resources and operations
• Improve message when producing data without acks.
• Fix header key/value copy in the Consumed record dialog that was copying the whole record instead
• Make the title of the consumed record dialog more useful by adding more details
• Fix error occurring when fetching the current throttle rate

• Fix crash on startup when a producer template has a Byte serializer

• Allow to Increase Topic Replication Factor
• Rate limit calls to the Schema Registry (default 20)
• Reduce CPU & GPU overhead. Can also fix some Windows freezing situations.
• Show the refresh duration in the Refresh button (to know it's active)

• It's now possible to throttle inter-brokers network traffic when Reassigning Partitions
• Allow to remove members from a Consumer Group
• Fix how the Avro unions with many subtypes are displayed in the Schema Registry
• We now detect cluster versions up to 2.7.x

• Improve performance of the topic view
• We can now reassign partitions without Zookeeper
• Add "offline login": login without Internet connection (for air gapped networks; enterprise only)
• Prevent excessive max activations errors
• Improve Consumers table layout when resizing
• We now detect cluster versions up to 2.6.x
• Improve Copy/Save of consumed records for all content types
• Favorite topics are now displayed first

• Add a config for the max visible record count in Consumer
• Allow cancelling service connectivity tests
• Fix Escape keypress in Consumer/Producer not removing window from dropdown
• Add support for JMX TLS connection

• Fix producer/consumer not stopped when closing producer/consumer window

• Help connecting to Confluent Cloud ksqlDB. Enable ALPN for https ksqlDB queries.
• It's now possible to pass extra headers to Kafka Connect & ksqlDB

• Conduktor has now a dark theme. We will stop spoiling your eyes if you're sitting out there in the dark!

• List the existing Consumers/Producers dialogs to quickly focus back to them
• Auto-detect system proxy
• It's now possible to add a color to differenciate clusters
• Add a new filter when consuming to detect large records (in bytes)

• It's now possible to import/export cluster configurations for enterprise users
• Fix Avro root union schemas parsing in the Schema Registry details
• Default the scale of Avro decimals to 0 when unspecified in a schema, as per the Avro spec

• Fix Developer access

• Fix ksqlDB 0.14 compatibility
• Handle wrapped unions when producing Avro data
• Prevent Conduktor to sometimes take focus when in the background
• Clarity the upgrade message for Essential license usage

• Improve the JSON-schema support when listing all its fields in the Schema Registry
• It's now possible to copy the path of the fields from any schema in the Schema Registry
• Improve error handling when resetting the source offsets of a Kafka Connect connector
• Reduce memory footprint

• We can now give a name to the Producer template created by a consumed record
• We now parse Protobuf & JSON schemas in the registry to display their nested structure
• It's now possible to update subjects with Protobuf or JSON schemas
• Show the schema types in the Registry if supported (Avro, JSON, Protobuf)
• In the Schema Registry, hide the soft-deleted schemas by default now
• It's now possible to create JSON or Protobuf schemas in the Registry
• Add support of Protobuf schemas using references, when inspecting subjects
• Fix Consumer bug where the "until timestamp" condition does not stop the consumer when met
• Simplify error messages when deserializing data using a Schema Registry deserializer for unsuitable data

• Append Conduktor logs to a proper log file on the system
• Add Producer templates options
• Improve UI and performance of the Schema Registry view, and prevent auto-loading of all the details for large Schema Registries
• Keep left menu collapsed between sessions
• Fix Smart Groups edge case with regex containing ungrouped conditional terms
• Revamp Schema Registry Subject creation dialog to help with strategies
• Add a new filter "by Schema ID" for the consumers. Useful to know if a schema from the Schema Registry is used.
• Simplify Create Topic dialog
• Add new options to the cluster selection screen to prevent auto-ordering by last usage, which is not always desired
• Fix Aiven integration wizard when creating a cluster
• Fix Kafka Streams global stores redirection to the underlying topic

• Fix an issue occurring with ksqlDB collection names in lowercase
• Reword the different errors related to licensing that may occur when selecting a cluster
• Improve stability and performances (bump Kotlin & Kafka libraries versions)
• Fix a possible issue occurring when the Topic Reassignment dialog is opening
• Improve ksqlDB error reporting and prevent false negatives
• Fix logging issue on macOS Big Sur

• Add Kafka Connect multi-selection to do bulk operations on them
• Fix Schema Registry multi-actions menu visibility
• Improve Welcome Screen layout
• Limit how many topics are visible in Kafka Connect, add visibility options, and add the whole list in the details
• Allow the Producer templates list to be resized to display long names
• Fix an error occurring with untyped arrays in JSON Schemas
• Do not represent property group.max.size as bytes

• In the Producer, auto-select newly created template (add or duplicate)
• Show Favorites Topics in Consumer/Producer topics dropdown, easier on the eyes
• For Kafka Connect, the Topics column is now way more exhaustive. We also improved the global layout of the table.
• In the Create Topic dialog, improve layout and fix an issue occurring when the broker configs are unavailable
• Make the error dialog more friendly

• It's now possible to skip validation of SSL certificates for Kafka Connect. Do not use.
• Add links & menu to our incoming Account Management web portal
• Greatly improve loading speed for Kafka Connect
• It's now possible to consume topics using the Schema Registry JSON schemas
• Manage JSON Schemas from the Schema Registry
• Disable topics last-writes realtime collection when the column is disabled (could cause perf issues on very large clusters)
• Save & reload the window state (maximized or not) when switching clusters
• Fix Kafka error log file name for Windows
• Ignore more properties to not flag them as broker config differences

• Protobuf schemas are now viewable in the Schema Registry
• It's now possible to copy the ksqlDB query results (selection or right-click)
• We now support custom keystore & truststore for ksqlDB
• Fix Conduktor logging issue
• We now display the previously deleted schemas of a Subject in the Schema Registry, and it's possible to delete them permanently
• Support instant hard-delete of subjects for Confluent Schema Registry
• Show the deleted Schema Registry subjects, add an option to filter them, and the possibility to permanently delete them
• Add topics export to Terraform (configuration)
• Fix the "until timestamp" condition in the consumer that was ignoring timezone offset
• Prevent Kafka Connect wizard issues when Kafka Connect is slow to respond
• We now support consuming Protobuf topics using the Schema Registry
• Update Producer placeholders to clearly identify the fields

• Minor improvements around the additional properties in the Cluster Configuration
• It's now possible to update a Connector by directly providing a JSON
• In the Connectors, improve how we display the large properties (transforms, customs)
• Prevent backslash removal when updating a Kafka Connect Connector (often used in regexes)

• Revert: do not force the ":port" for Schema Registry / Kafka Connect / ksqlDB to avoid validation & duplicate issues for existing configurations

• It's now possible to pass custom properties to the JVM (-D), see documentation
• Force host:port in ksqlDB configuration to avoid ksqlDB query issue
• We can now create several Kafka ACLs in a row
• It's now possible to import/export ACLs. Follows the format of Kafka Security Manager.
• When resetting consumer offsets, do not display both success and error dialogs when it failed.

• Detect consumer groups subscribing to several topics using the default "range" strategy, warn the user of possible unbalanced situations
• In the producer, it's now possible to send Avro specific types from a simple JSON representation (bytes as base64, decimal logicalType as number or string, etc.). We're covering the cases in our documentation.
• Improve support of old ksql versions
• Support ksqlDB 0.10 and drop previous versions support for queries

• Add a clear button on search fields
• Backup the existing Conduktor's configuration in case of IO errors
• Avoid displaying an error when the security graph can't be rendered
• Display Avro bytes without logical types as base64 instead of gibberish
• When consuming data, save the jq projection into the CSV export, instead of the full value

• Add Kafka Connect authentication using a token and improve its configuration screen layout
• Prevent displaying a blank area in the consumed record details when it's not the expected json-ish format
• In the topic details, display how many subjects fits the TopicRecordNameStrategy if used
• Improve format detection when consuming an Avro topic to auto-select Avro (Schema Registry)
• It's now possible to change the compatibility of multiple subjects at once
• Fix weird columns resizing that can happen for topics and schema registry views
• Avoid displaying an error when Conduktor starts and the Schema Registry is configured but not up

• Improve Topics table layout
• We also added a Json Path filtering for keys and values, easier to filter nested data
• We now support a Regex filter in our consumer. Note that it can impact performance.
• Make the Reset source offsets connector wizard working with large offsets topics
• Display topics marked for deletion if Zookeeper integration is enabled
• Bump dependencies

• Improve Kafka Connect connectors list loading time when we have many
• Minor UI improvements
• New wizard to reset the source offsets of a connector
• It's now possible to open multiple consumed record dialogs (detached mode), useful to compare records
• In the upgrade dialog, display the last 10th changelogs (instead of only 5) when the version is really old

• Improve how we display the JSON-ish view for logicalTypes not part of unions
• Handle older KSQL versions when checking for healthiness
• Add new Avro deserializers to work with custom subjects or schemas. It's also possible to provide a custom schema to deserialize the data and bypass the Schema Registry.
• Cleanup and improve Consumer layout to prepare for more options
• Fix buggy columns resizing that can happen when refreshing topics view

• Add JMX username/password authentication
• Display the reason why Conduktor fallback to free mode (no seats available, too many activations...)
• For topics, it's now possible to add a custom column to compare their configuration all at once (retention, segments, intervals etc.)
• Strongly suggest the user to upgrade Conduktor when he has an old version

• Sign Windows installer 🔐

• When rolling restarting a cluster with Conduktor, handle start/stop commands errors gracefully
• Fix some cases where the topic/partitions last writes metrics failed repeatedly
• Ensure that critical Conduktor's Kafka properties take precedence over the cluster configuration additional properties
• Fix the sorting of the Consumer "lag" column in the details and improve columns layout

• Add basic authentication for Jolokia metrics endpoints and make it Aiven compatible
• Handle special characters with ksqlDB resources
• Fix error occurring when creating a topic with Smart Groups enabled
• ACLs: be more clear when the pattern type is prefixed

• Add ksqlDB initial integration within Conduktor

• Refresh the user info when Conduktor starts to avoid logout/login cycles
• In topic details, show the overall count of records ever sent, and relayout a bit the info displayed
• Avoid displaying negative lag in Topics details when we're still fetching offsets
• Handle more gracefully/transparently authorization errors when the user doesn't have access to the consumer groups
• Reduce GPU usage when consuming data

• Avoid displaying negative lag value for Consumer Groups when we couldn't fetch all necessary infos
• In the Cluster Configuration, allow Zookeeper urls containing a chroot path
• Add a note when removing topics that it's not always immediate
• Fix an error occurring when the brokers version can't be determined
• Fix possible inconsistency issues when deleting Schema Registry subjects

• Fix an issue where producing data was not done with the latest schema version after a Schema update
• Fix an issue occurring with Smart Groups when there is no value to display for a group
• Fix an error occurring when updating a subject without schemas
• It's now possible to remove a particular version of a Schema Registry Subject (unsafe!)

• Improve the heuristics detecting topic last writes to reduce the strain on the cluster
• It's now possible to quickly switch to another cluster without going back to the welcome screen
• Improve Enterprise floating licenses token refresh

• Fix an error occurring with Aiven's Schema Registry (Karapace)
• Fix Consumer time shift with the different "from" based on time
• Display the ACLs in a graph to see relations holistically
• Show the local cluster onboarding button only when the user is logged in

• Producing records based on an Avro root union schema now works
• Partially fix an error occurring on the Producer when switching templates / partitions. A larger revamp is in progress.
• Improve Schema Registry data layout
• In the topic details, we now link to its Schema Registry subject(s) if defined
• Like with Topics, we can now flag Consumer Groups as favorite to easily find them
• We now detect cluster versions up to 2.5.x

• When contacting our support due to an error, we now expect our dear user to explain the context
• Fix an issue where a change of the Consumer "start from" datetime picker was not taken into account
• Refresh the Schema Registry subjects list when we create a new one
• Bump dependencies: performances and stability improvements
• It's now possible to update the schema of an existing Subject from its detailed view
• Strengthen the Schema Registry Global Compatibility change message, to ensure the user knows what's going to happen
• Fix an issue where the consumed topic was still not the right one after changing it in the dropdown

• Improve Proxy dialog layout
• It's now possible to create a producer template from a consumed record
• More serializers have been added on the producer side

• It's now possible to navigate back and forth through screens
• Always display all infos in topic details (no matter the hidden columns on the main list)
• It's now possible to hide Replication Factor and Partition Count columns for topics

• Improve certificates import strategy into Conduktor's own truststore
• Retry fetching new topic after its creation. Kafka sometimes takes its time.
• Fix edge case with Smart Groups and non-named groups
• Improve the wording of the Upgrade messages
• Fix a Consumer Group issue occurring when committed offsets are missing

• Add trusted certificate import within Conduktor, to avoid keytool manipulations
• Add a link to the documentation when an error occurs

• Fix parsing of recursive Avro schemas
• Add Kafka Streams settings to configure the topology viewer and the refresh interval
• Fix Kafka Streams metrics sometimes not updated with the latest state
• Always log the Kafka connection errors even if we handle them gracefully
• Fix a too short timeout causing connectivity issues with "slow" clusters
• Clarify the usage of SSH in Conduktor. It is not for SSH tunneling but direct connection (for now)
• Prevent Kafka Streams columns to resize oddly when resizing the window
• Improve metrics error handling (Jolokia, JMX)

• Fix an issue where the Kafka logs file was not generated on Linux
• Update our documentation url to https://docs.conduktor.io/
• Improve error message when connection to Kafka fails
• Add Smart Groups feature for topics and schema registry. It's now possible to cleanup long names visually and create dynamic columns based on parts of the names.

• It's now possible to download consumed binary data into file
• Make it clearer the read-only mode is enabled or not
• Make it clear the "bytes" deserializer exposes base64
• Handle listener names in bootstrap servers connection strings
• Improve Avro default value formatting
• Fix realtime updates when partitions are missing their leader
• Handle Enterprise monthly seats subscriptions

• Fix a UI issue that may cause issues under Linux
• Fix an issue occurring when Zookeeper watching jobs are cancelled
• Add more details about the error in the error dialog and improve the contact to our support

• Add links to our documentation in the Cluster Configuration screen, in case of troubles.
• Fix a case where the Kafka connectivity Test button did not display the error if there was
• Expose the logs within the Configuration dialog to understand Kafka connections errors
• Output Kafka errors in a dedicated logfile to investigate more easily

• Rework the topic and partitions last writes to be reactive and to expose trusty values

• Use the JSON viewer when exporting a Kafka Connect connector configuration
• Remove dependencies to lighten the installer
• Sign macOS installer 🔐

• Reduce memory footprint when consuming data
• New option when consuming topic(s): we can keep only the latest (by time) occurrence of the keyed records we are consuming.
• Fix Kafka Streams state store column links. Now pointing to their proper changelog topic.
• Make the Avro compatibility tester available on Subject. This helps testing transitive compatibility.
• Fix an opacity issue with the tooltips on the Overview screen
• Add changelog link to website in the Upgrade dialog to see all versions
• Add an Avro check compatibility tool to compare two schemas. The next step will use existing Subjects as baseline.
• Fix the false assumption that the topic of a subject using RecordNameStrategy does not exist

• Display the Schema Registry Subjects without their related topic (probably deleted since)
• Stop the check background job when we close a running Kafka Streams reset dialog
• Add multi-selection on Schema Registry. It's now possible to mass-delete them (!).
• Fix the error occurring when a user creates a Topic but doesn't have access to the brokers config
• Reduce installer size

• It's now possible to export Partitions per broker metadata into JSON or CSV
• Fix "Type" column size in Subject details which was too narrow
• It's now possible to export Topics and Consumers metadata into JSON or CSV
• Fix an issue with Support for users logged in with Twitter
• Conduktor now offers a free trial with all the features available
• Connect Conduktor support to our support system for a better and faster service
• Display JVM arguments in Settings dialog

• Reduce the installer size by removing some dependencies
• Tune how we start Conduktor (like JVM Max Heap which is now fixed at 2G)
• Add details about the running JVM, heap sizes etc. in the Settings dialog
• Add Restart all Tasks (not the connector itself) in Kafka Connect
• Add nonProxyHosts property for proxies and initialize it on startup if needed

• Use a new error dialog to avoid Linux issues (tiny, not resizable) and to add features ("send to support")
• Fix unnecessary double-click on all Ask Us Anything buttons
• We can export Kafka Connect connector properties as JSON from its "Configuration" pane
• Add a JSON to Avro Schema tool in the Schema Registry screen

• Add HTTP Proxy configuration within Conduktor to avoid setting up the JVMOptions manually
• Wrap long messages in the error dialog

• When consuming in tabular view, explode headers as distinct columns
• In the consume dialog, add the ability to show/hide columns in tabular mode
• In the consume dialog, add "yesterday" as consume from start date. It's a common use-case.
• Remove intermediate topics metric in Kafka Streams. It's not that useful.
• On Windows, copy the old configuration file of Conduktor to the new place; to avoid starting from scratch.

• There is now a complete wizard to help resetting Kafka Streams applications.
• Improve error management when we fail connecting to clusters

• It's now possible to consume multiple topics at the same time in the same Consumer dialog

• Rename "desktop" to "conduktor" in .zip distribution to be clearer
• Make Conduktor compatible for Java 11 minimum

• When upgrading Conduktor, download the package for macOS (pkg) & Windows (msi) instead of just opening the Download page.
• Display new menu: Kafka Streams
• Add refresh button after verifying email to avoid logout/login again.
• Auto-focus to Conduktor after login/logout
• Add terms agreement button when signing up

• In the record details, display the Avro schemaId even when we fail to fetch it

• Properly display schema registry fetching errors in the consume dialog
• Prevent multi-toggle-buttons to be disable all at once and cause issues (acls, SR config, ...)
• Shortcuts using Shift+X are replaced by Shift+Alt+X to avoid triggering them when typing Shift+X in a textfield.

• Display a warning for static broker config values not conveyed by Kafka.

• It's now possible to filter Schema Registry Subjects by schema ID. This can return multiple results, when the same schema is used in multiple subjects.

• Changing broker configuration could lead to errors
• Editing a Kafka Connect connectors not fully loaded could lead to an error

• Show when an update is available at different places
• Manage expired subscription

• Fix multiplatform shortcuts (most shortcuts where working only on MacOS due to the "Meta" key usage)

• Improve release process

• Do not depend upon Github to check updates

• Display changelog of multiple versions

• Revamp Security (ACLs) rendering and error management.

• Add "transitive" modes to the Schema Registry possible compatibilities.
• Revamp Schema Registry compatibility dropdown UX and protect against misuses.

• Format JSON when copied from consumer details or Avro schemas viewer
• Add the Schema ID when viewing the Schema of a given consumed Avro record

• Multi-selection of consumer groups to mass-remove them (like topics view)

• Improve a lot the consumer performance and memory pressure
• When deserializing Avro, null elements in arrays were misinterpreted.
• In the consume window, the "Does not contain" filter was not working properly on headers

• Improve the performance when consuming (preventing locks)
• Do not display topic count when not fully computed

• Migrate the user Kafka Consumer config to the new defaults if they are unchanged (they were too large).

• ConsumeFrom configurations are now saved per topic. This will prevent the users to always select the same thing over and over for the same topic. (as we do with the serde and jq pattern)

• Check missing native weblibs on startup and display a warning icon in the status bar with the error (for now).
• Remove border radius on tooltips because it's buggy on the edges of the window.

• Float and Double serde in the consumer

• Experimental tabular view when consuming data (experimental because we still have features to add, but it's a good first iteration)
• Redesign of the "consume from" combobox to a nice organized panel, that we will replicate to other fields to provide a better UX.

• When converting Avro data to JSON, we now parse and stringify Avro's logicalTypes to "human" format (no more timestamps, no more "bytes").

• We can load custom jars into Conduktor
  • to enjoy enterprise features from Confluent (acl.jar for instance, for specialized auth methods not in AK)

• Support for Avro UNION as root records
• Support for nullable UNION with null second (instead of first generally)

• Introduce max parallelism settings when fetching the Schema Registry, to prevent overloading it.

• Shortcuts everywhere. Hover buttons or links to discover if there is a shortcut. We made it consistent through "zones":
  • Left menu: Cmd+...
  • Consumer/Producer: Shift+Cmd+...
  • Inside views: Ctrl+Cmd+...
• We allow not only .pem files in the SSH configuration.

• Allow topics multi-selection and multi-actions
• Simplify UI (less containers), remove some padding to have more display space

• Produce with an Avro key was not using the right schema

• A read-only mode. It hides all controls and options which can impact the Kafka cluster, Kafka Connect etc.

• New consumer prop in the settings: FetchMaxWaitMs.
• Prevent a misconfigured "null" hostname Kafka Connect to be taken into account.
• Some editing bugs in the Kafka Connect configurations screen.
• When we quickly start & stop consuming to topic, it was possible to show some WakeUpException error.

• When consuming, fallback on latest offset when a given timestamp doesn't exist in a partition.
  • It is used when using today, last hour, specific timestamp.

• Shows the partitions progression when consuming a topic.
  • The max offsets are regularly fetched in the background, for topics ingesting new data in real-time.
• The layout of the consume popup buttons has been slightly changed to adapt to the new partitions feature.
• In the Consumer Group view, we've added a "(must be inactive)" for buttons that are only active when the consumer group is inactive (Reset Offsets or Delete), for the user to know.

• It's now possible to consume from an existing Consumer Group
  • It's not yet user-friendly (popup errors in the consumer group has not committed offset on the topic for instance), but it works.
  • It will consume only the same partitions the consumer group committed into.

• Conduktor now manage multiple instances of Kafka Connect in the configuration.
  • When creating a Connector, if the cluster has multiple Connects, we now need to pick which Connect to use
  • If the cluster has multiple Connects, a new column appears in the Connectors view, to know on which instance the Connector is running on.
  • A new metrics appears "Connect Instances" up/down.
• We now always display help videos & links on the cluster configuration screen, not at creation time anymore.

• The consume view now renders by timestamp desc automatically (before it was the original consumed order, where we have no control)
  • We made large improvements for reduce the memory impact while consuming lots of messages.
• Default consumer settings were reduced because they were too large (?) (and caused client timeouts)

• Improve the error message when we try to send data not matching the Avro subject.
• Prevent error when we fail to send an error (!)

• We can now update existing Connectors (using the Wizard)

• Change default consume mode to latest instead of earliest
• Relayout and rephrase a bit the consume popup content to make things clearer

• We can now filter records by header (key and/or value)

• We now display Connector's properties with a "null" group.

• We built a new model around the Schema Registry data (json is automatically migrated) to structure the properties (previously in additionalProperties) and display auth methods properly.

• Introduce the one-time login for users.
• The login process now relies on an OpenID JWS token, and it's now possible to start Conduktor offline.
• The OpenID token will automatically be updated at runtime (using the refresh token) when necessary (when its expiration is coming)
• Logout revokes the refresh token

• Add original auth error as query string in the failure page
• Send auth error to Sentry

• Optimize the layout (and memory footprint) of the consume popup (and other minor places).
• When we change the schema registry properties and come back to the cluster, the changes were not taken into account.

• Display hints when resizing table columns.

• Restructure a bit the expand/collapse left menu
• Error when adding characters in a numeric spinner and trying to use the +/- buttons

• Relayout the consume button in the topic list, because nobody is using the right one and because it's the "main" feature.
• Use smarter resizing columns in topics & consumers views

• Add options Settings to hide Schema Registry columns and prevent tons of slow I/O with bloated Schema Registries.

• Add check/uncheck all options in Settings to be explicit about the result.

• We can now duplicate clusters from the Cluster Configuration popup
• Relayout and uniformize the Cluster Configuration popup content

• kfoenix UI dependency: we were barely using it so we switched back to original controls.

• Always compute and show offsets & count in the topic detailed view (no matter the flag "Show count" in the preferences)

• Add Copy/Paste via a Right-Click context menu on most useful values

• Use the command first when browsing on Linux. It appears the Java Desktop can freeze the app (and the OS) when calling .browse().

• In the producer popup, sometimes the JSON update fails for odd concurrent reasons. We retry.

• Introduce Settings to configure the visibility of the main columns in Conduktor, and some Kafka Producer/Consumer/Admin flags.

• Connectors: Always take into account the fields which have changed even when we fallback on the default value. This is to prevent some bug in connectors which are not taking their default value into account. (we don't send default value, we are relying on what the connector is telling us)

• We must have to login into Conduktor now. We are integrated with auth0, using a Native app with PKCE oauth flow.

• Improve browser detection to open links (specially for Linux)
• Menubar button with classic menus (settings to complete, about etc.)

• Easter egg

• Reverted the previous improvement: it prevented the popups to be opened on another screen than its owner (on macos at least).
• The visibility of the expand button in consume popup
• Open the producer/consumer popup on the same screen at the origin UI

• If available, display the key/value Avro schema in the record details (consumer popup)
• Hide GA errors in the logs

• The visibility of the expand button in consume popup
• Make the consume popup owner of its feedback popup to avoid screens issues