Tag: Airflow

SQL Analytics You Can Actually Trust: Building Reliability Marts with dbt

dbt turns SQL SELECT statements into tested, documented, dependency-aware data models. This tutorial builds the flight reliability marts used by the dashboard — airport, route, and carrier delay rates — starting from a staging view and layering on not-null, uniqueness, relationship, and range tests that catch data quality problems before they reach the API.

Python Automation Web Development

Flight Disruption Intelligence: A Full-Stack Delay Predictor on Public Data and Free Infrastructure

An end-to-end flight delay prediction platform spanning medallion lakehouse, calibrated LightGBM with SHAP explanations, Spark Structured Streaming, dbt reliability marts, FastAPI serving, and a SvelteKit dashboard — built entirely on public BTS/NOAA/OpenSky data, self-hostable for $0/year, with a contract module that enforces leakage prevention across every pipeline stage.

Python Apache Spark dbt LightGBM +12 more