Sung Won Chung

airflow-toolkit. Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) :desktop_computer: >> [ :rocket:, :ship: ]

iot-python-webapp. Live, real-time dashboard in a serverless docker web app, and deployed via terraform with a built-in CICD trigger

airflow-dbt-cloud. dbt Cloud pipelines in airflow examples

fst. fst: flow state tool | smooth where you want it, friction where you need it when data engineering

dbt_bigquery_example. How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES :notebook:

serverless-data-pipeline-gcp. :factory: Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and pub/sub

schedule-python-script-using-Google-Cloud. :clock4: Schedules a Python script to append data into Bigquery using Google Cloud's App Engine with a cron job

aws-lambda-based-etl. :file_folder: Process individual files and perform data normalization: s3->secrets manager->RDS & s3

jaffle_shop_duckdb. Fun times!

sqlmesh-demos. SQLMesh project for live demos - provides instructions so you can run this on your own!

airbyte-dbt-toolkit. Deploy an airbyte instance with dbt models in Google Cloud in 5 minutes

image-labeling-and-translation-data-analysis-Google-Cloud. :label: Invokes cloud vision and translation APIs with Python

datafold_demo. Python

jaffle_shop_neon. I see the glimmers of dbt uniting software and data engineers

dev-containers. Repo starter template. Docker files used to create images for various development workloads. This evolves with me!

terratest. Terratest is a Go library that makes it easier to write automated tests for your infrastructure code.

demotron. CLI to delight real people with live demos

sqlmesh. Efficient data transformation and modeling framework that is backwards compatible with dbt.

sqlmesh-cli-crash-course.

prefect-dbt-cloud. dbt Cloud pipelines in prefect 2.0 examples

bpt. blueprint: write and update schemas for your dbt models, less time doing toil == more time feeling royal

3D-rendering-pythonic. Render live simulations in 3D with Python!

dbt-bigquery-example.

prefect-examples. personal examples for prefect