BigData-Pipeline. BigData Pipeline is a local testing environment for experimenting with various storage solutions (RDB, HDFS), query engines (Trino), schedulers (Airflow), and ETL/ELT tools (DBT). It supports MySQL, Hadoop, Hive, Kudu, and more.

github.com/Pirate-Emperor/BigData-Pipeline

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.