The One-Line Fix That Eliminated a Full Sort Mar 25, 2026 One optimizer pass was silently destroying work that another depended on. The fix was a single line. rust query-optimization datafusion
IN-Lists Don't Have to Break Your Sort Order Mar 21, 2026 How we eliminated expensive full sorts in our live data engine by splitting IN-list filters into per-value partitions — and updated the cost model to match. rust query-optimization datafusion
10x Faster Protobuf-to-Arrow by Ditching Reflection Feb 13, 2026 How replacing prost_reflect's DynamicMessage with static decoding yielded an order-of-magnitude throughput improvement in our streaming data engine. stream-processing rust protobuf arrow
Time-Varying Filters: Delayed Emission in Streaming SQL Jan 20, 2026 How I built watermark-driven temporal filters to delay message emission in a DataFusion-based streaming engine — from SQL semantics to custom optimizer rules to the physical operator. stream-processing rust datafusion sql