About this session
In this session, we’re going to discuss the story of iceberg-rust, the official Rust implementation of Apache Iceberg. It began when Xuanwo started a project named Icelake. At that time, he was a database engineer at Databend, and he wanted to build a Rust-based open lake implementation, especially for Apache Iceberg. He was then joined by the RisingWave team, along with other open-source community members, and Icelake grew quickly. At the same time, the Apache Iceberg community was also looking for a Rust implementation of Iceberg, so they collaborated with the Icelake community and officially started iceberg-rust as part of the Apache Iceberg project.
Icelake was then sunset, and users migrated to iceberg-rust, which is now a thriving project with around 199 contributors, 1.4K GitHub stars, and 11 releases, and is used by many successful projects for Iceberg implementations, including RisingWave, Lakekeeper, Spice AI, Apache DataFusion Comet, Databend, and many more.
In the end, we’ll also have a demo on how to build a streaming Rust lakehouse using RisingWave to create Iceberg tables through the REST-based Lakekeeper catalog and query them with Doris to demonstrate the interoperability of the Apache Iceberg lakehouse.
