Running Apache Doris Decoupled Mode on Azure Kubernetes Service: Production Lessons and Best Practices

About this session

Compute-storage decoupling makes Apache Doris an attractive architecture for building scalable analytical platforms on cloud infrastructure. But running Doris in decoupled mode on Kubernetes introduces a different set of considerations around infrastructure design, ingestion, performance, observability, and disaster recovery. In this session, I will share practical lessons from deploying and operating Apache Doris Decoupled Mode on Azure Kubernetes Service (AKS). The session will cover infrastructure and workload isolation, node-level OS optimizations, high-volume data ingestion using Broker Load, historical data migration using Doris Catalogs, and data modelling and bucketing strategies for write performance. I will also discuss disaster recovery and backups, including the protection and recovery of metadata stored across FoundationDB and Doris FE, along with single-region and multi-region recovery strategies. The goal is to provide a practical, production-oriented view of the decisions and lessons involved in taking Doris Decoupled Mode from an architecture diagram to a reliable cloud-native analytical platform.

Speaker

Nilanjan Sarkar

Data Engineer · Tesco

LinkedIn ↗ · Nilanjan Sarkar