ETL

Building a Multi-Stage ETL That Doesn't Lose Work Under Failure with NATS JetStream

A walkthrough of the backpressure-aware ingestion pipeline in EvidenceLens: durable consumers, manual acknowledgment, how a 60-second ack_wait caused a redelivery storm under load, and a backpressure loop that pauses consumption when the downstream indexer falls behind.