A walkthrough of the backpressure-aware ingestion pipeline in EvidenceLens: durable consumers, manual acknowledgment, how a 60-second ack_wait caused a redelivery storm under load, and a backpressure loop that pauses consumption when the downstream indexer falls behind.
An end-to-end flight delay prediction platform spanning medallion lakehouse, calibrated LightGBM with SHAP explanations, Spark Structured Streaming, dbt reliability marts, FastAPI serving, and a SvelteKit dashboard — built entirely on public BTS/NOAA/OpenSky data, self-hostable for $0/year, with a contract module that enforces leakage prevention across every pipeline stage.
EvidenceLens unifies 20+ fragmented medical literature sources into a single hybrid-ranked interface, surfaces author conflict-of-interest badges from public CMS Open Payments data, and runs answer synthesis entirely on the user's own inference key — zero recurring backend cost.
