Tansu.io reimagines Kafka for lean, stateless data operations

At QCon London 2026, Peter Morgan unveiled Tansu.io, a groundbreaking tool that reimagines Kafka for lean operations. This open-source, Kafka-compatible broker operates without a leader and can scale to zero, making it…

3 min readInfoQ
Tansu.io reimagines Kafka for lean, stateless data operations

Tansu is the most practical rethinking of Kafka we've seen in years, and it's not because of the usual hype around "next-generation" infrastructure. Peter Morgan's project addresses a real inefficiency: the assumption that a message broker must hold state, manage leaders, and consume resources even when idle. Tansu's stateless, leaderless design flips that assumption on its head. For anyone who has operated a Kafka cluster that sits mostly empty between bursts, or who has paid for idle nodes to maintain high availability, this is a direct answer to a costly problem.

What makes Tansu worth your attention is the combination of its resource footprint and its pluggable storage. It runs on 20MB of RAM and starts in 10 milliseconds. That is not a benchmark claim; it is the result of writing the broker in Rust and removing the need for a built-in storage layer. You can back it with S3 for cost-effective scaling, SQLite for local development, or Postgres for operational familiarity. The broker itself becomes a thin, stateless relay. This changes how you think about deployment. Instead of provisioning clusters based on peak throughput, you can scale to zero when no messages are flowing and spin up a broker in milliseconds when needed. For teams running Kafka in development, testing, or event-driven microservices with intermittent traffic, that is a meaningful reduction in complexity and cost.

The direct-write capability to Iceberg and Delta Lake is another practical addition. Instead of routing messages through a connector pipeline, Tansu can write directly into Apache Iceberg or Delta Lake tables. That simplifies the architecture for teams building lakehouse pipelines. Combined with broker-side schema validation, you catch malformed data before it ever reaches storage. These are not flashy features; they are the kind of quality-of-life improvements that reduce debugging time and operational overhead.

We see Tansu as a signal that the Kafka ecosystem is ready for lighter, more composable alternatives. It does not replace Kafka for every use case, if you need exactly-once semantics across a globally distributed cluster, you still need the full Kafka stack. But for the majority of teams that use Kafka as a simple message bus, especially in stateless or bursty workloads, Tansu offers a path to lower costs and simpler operations. The project is open-source, written in Rust, and available today. That is a concrete option worth exploring, not a promise about the future.

From InfoQ

Peter Morgan introduced Tansu at QCon London, an open-source, Kafka-compatible, stateless, leaderless broker that scales to zero, with pluggable storage (S3, SQLite, Postgres), broker-side schema validation, and direct writes to Iceberg and Delta Lake. Written in Rust, it uses 20MB of RAM and starts in 10 milliseconds.

Read the original at InfoQ