Digital Developer Conference: Cloud Security 2021 -- Build the skills to secure your cloud and data Register free

IBM Developer Blog

Follow the latest happenings with IBM Developer and stay in the know.

See what's going on in the Kafka community this month


This is the 42nd edition of the Kafka Monthly Digest. In this edition, I’ll cover what happened in the Apache Kafka community in July 2021.

For last month’s digest, see Kafka Monthly Digest: June 2021.

Releases

3.0.0

The release process for Kafka 3.0.0 continued. Code freeze happened on July 20. There are currently a handful of blocker JIRAs that need to be fixed. Once these are addressed, Konstantine Karantasis will start building the first release candidate.

KIPs

Last month, the community submitted 6 KIPs (KIP-760 to KIP-765), and these are the ones that caught my eye.

  • KIP-762: Delete Committed Connect Records. Because Kafka Connect offers connectors for so many systems, it’s possible to use it to move data from a system directly into another. In such pipelines, Kafka is just incidental and there’s no need to keep the data in it. The goal of this KIP is to provide a mechanism to improve this scenario and have Connect automatically delete records once they have been written to the target system.

  • KIP-763: Range queries with open endpoints. In Kafka Streams, a state store can be queried using a range. However, Kafka Streams only accepts closed ranges, where both the from and to keys are specified. This KIP proposes to allow passing null for either bound to support use cases wanting to query records with a key smaller or greater a certain constant.

Community Releases

In this section, I will cover releases of some community projects. This only includes projects that are open source.

None of the projects I follow have made a release in July. If you know a popular community project that I don’t cover, please let me know.

Blogs

Get started with Kafka

IBM Event Streams for Cloud is Apache Kafka-as-a-Service for IBM Cloud. Get started with IBM Event Streams today.