Kafka Monthly Digest – July 2021
See what's going on in the Kafka community this month
This is the 42nd edition of the Kafka Monthly Digest. In this edition, I’ll cover what happened in the Apache Kafka community in July 2021.
For last month’s digest, see Kafka Monthly Digest: June 2021.
The release process for Kafka 3.0.0 continued. Code freeze happened on July 20. There are currently a handful of blocker JIRAs that need to be fixed. Once these are addressed, Konstantine Karantasis will start building the first release candidate.
Last month, the community submitted 6 KIPs (KIP-760 to KIP-765), and these are the ones that caught my eye.
KIP-762: Delete Committed Connect Records. Because Kafka Connect offers connectors for so many systems, it’s possible to use it to move data from a system directly into another. In such pipelines, Kafka is just incidental and there’s no need to keep the data in it. The goal of this KIP is to provide a mechanism to improve this scenario and have Connect automatically delete records once they have been written to the target system.
KIP-763: Range queries with open endpoints. In Kafka Streams, a state store can be queried using a range. However, Kafka Streams only accepts closed ranges, where both the
tokeys are specified. This KIP proposes to allow passing
nullfor either bound to support use cases wanting to query records with a key smaller or greater a certain constant.
In this section, I will cover releases of some community projects. This only includes projects that are open source.
None of the projects I follow have made a release in July. If you know a popular community project that I don’t cover, please let me know.
- Build an event-driven app with Micronaut, Kafka, and Debezium
- From On-Prem to Cloud-Native: Multi-Tenancy in Confluent Cloud
- A Practical Guide for Kafka Cost Reduction
- Benchmarking Kafka producer throughput with Quarkus
Get started with Kafka
IBM Event Streams for Cloud is Apache Kafka-as-a-Service for IBM Cloud. Get started with IBM Event Streams today.