Tansu: Stateless Kafka Reinvented for Lean Ops

Beyond Kafka: A New Paradigm for Event Streaming

Tansu.io presents a compelling vision for a more operationally lean and potentially cost-effective messaging broker by decoupling state from brokers and delegating durability to external storage. The core innovation lies in its stateless broker design, allowing for rapid scaling, including scaling to zero, and significantly reduced resource consumption (20MB vs Kafka's 4GB heaps). This approach fundamentally shifts the operational burden from managing complex, stateful Kafka clusters to leveraging existing, robust storage solutions like S3, PostgreSQL, or R2. The integration with PostgreSQL, particularly the use of the COPY FROM protocol and direct transactional outbox pattern elimination, is a major technical highlight, addressing common pain points in event-driven systems by bringing streaming data closer to its analytical destinations. Furthermore, Tansu's built-in, broker-side schema validation and direct writing to open table formats (Iceberg, Delta Lake, Parquet) are significant advancements, simplifying data pipelines and ensuring data consistency at the source.

Key Points

• Tansu.io is an open-source, Kafka-compatible messaging broker that rethinks durability by making brokers stateless and relying on external storage.
• Brokers are designed as 'cattle' (stateless, low memory footprint, scalable to zero) rather than 'pets' (stateful, high memory, long-running).
• Offers pluggable storage backends: S3 (for diskless), SQLite (for dev), and PostgreSQL (for direct database integration).
• PostgreSQL integration leverages COPY FROM for high-throughput ingestion and eliminates the transactional outbox pattern via stored procedures.
• Broker-side schema validation (Avro, JSON, Protobuf) is enforced before writing data.
• Can directly write validated data to open table formats like Apache Iceberg, Delta Lake, and Parquet.
• Can act as a proxy for existing Kafka clusters with high performance and low latency.

---

📖 Source: QCon London 2026: Introducing Tansu.io — Rethinking Kafka for Lean Operations