dbt-with-spark-thrift-server. This project provides an open-source framework for building modern data lakehouses by integrating Hive Metastore for schema management, Spark Thrift Server for distributed query execution, and DBT for SQL-based transformations. Designed for development and experimentation, it also includes MinIO as a local S3-compatible object store.

github.com/ArthurKretzer/dbt-with-spark-thrift-server

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.