Observe the Agent: Real-Time Observability and Evaluation with Litefuse and Apache Doris

About this session

Your agent runs, nothing throws an exception, but the answer is still wrong. These failures are invisible to every monitoring tool you already own. This talk introduces Litefuse, an agent observability and evaluation platform built on Langfuse and Apache Doris, and the shift it enables: from test-driven development to evaluation-driven development — observe, evaluate, improve. Then we go a layer deeper, because agent observability is really a real-time analytics problem. Inverted indexes, clustered trace storage, columnar JSON via VARIANT, and storage-compute separation deliver 10x faster full-text search over traces and up to 88% lower storage cost.

Speaker

Jack Jiang

Apache Doris Committer · Senior Software Engineer · VeloDB