Apache Kafka
LinkedIn · 2010
Kafka is a distributed, open-source event store and stream-processing platform developed at LinkedIn and open sourced in early 2011. It uses a binary TCP-based protocol and a 'message set' abstraction to optimise efficiency, enabling linear writes from bursty streams. It guarantees ordering within partitions, retains messages in a durable append-only log, supports manual offset management, and introduced share groups in 2025 for queue-like semantics. Kafka Connect and Kafka Streams were added in versions 0.9.0.0 and 0.10.0.0 respectively.