teams-league-airflow-elt. The goal of this article is showing a real world use case for ELT batch pipeline, with Cloud Storage, BigQuery, Apache Airflow and Cloud Composer : The Extract part is managed in Cloud Storage The Load part is managed from Cloud Storage to BigQuery The Transform part is managed by a BigQuery SQL query Everything is orchestrated by Airflow

github.com/tosun-si/teams-league-airflow-elt

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.