Solution icon
Governance - Cold Storage

Reduce your Apache Kafkastorage costs

Conduktor's Cold Storage enables data to be stored at low cost for as long as you need

Arrange a demo

Apache Kafka storage costs can get out of control... not anymore

Cold storage lets you use much cheaper storage without changing a single thing in your applications

  • Feature
    Reduce storage costs

    Utilize any storage compatible with S3 Api like GCS, Minio, Nutanix, Netapp etc.

  • Feature
    Enable infinite retention

    No need to age out data for cost reasons, economically store your events for as long as you'd like

  • Feature
    Enable large messages

    Stop worrying about rearchitecting your applications to support large messages. Just use the Kafka client you're already using

  • Feature
    Rapid Recovery

    When a broker goes down, new brokers need to copy much less to get started

  • Feature
    Lower networking costs

    Previously, sending 1 gb in, storing it and having 3 different reads would mean you pay for 4gb. Not anymore...

  • Feature
    Compatible with multi-tenancy

    Everything is more efficient, with more Kafka clusters and lower storage requirements per machine

How does it look?

Let's walkthrough some of the magic

  • Activate

    You're one API call away: a single change to your Kafka setup gets you started with cold storage.

    Use cold storage per topic or for your entire Kafka.
    Keep your Kafka messages anywhere you like to save costs

    $ curl --request POST http://conduktor-platform/london --data-raw '{ "type": "COLD_STORAGE", "topic": "jack-topic" }'
  • Send Large file

    Use any Kafka client under the sun and send whatever messages you need to.
    You won't need to worry about size limits.
    We can send 150Mib to S3, no problem

    $ kafka-producer-perf-test --topic jack-topic --num-records 1 --record-size 157286400 --producer-props bootstrap.servers=conduktor:9092 max.request.size=162529280 buffer.memory=162529280 --producer.config london-jack.properties 1 records sent, 0.3 records/sec (34.98 MB/sec), 3208.0 ms avg latency, 3208.0 ms max latency.
  • Confirm

    Our 150MiB message is stored in AWS S3. We won't need to worry about it anymore, and can keep it forever

    $ aws s3 ls s3://my-bucket --human-readable 2022-09-20 23:14:36 150.0 MiB jack-topic/1f4fbc2e-fd2a-40c1-8b27-f4ce5334785c

Reduce storage costs and remove friction without lifting a finger

Arrange a demo