I architect pipelines you forget exist.
slothdb. An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
440automated-view-ddl-creation. Creating automated Views for use in Aggregation Layer of any reporting tool(Power BI, Qlik, QuickSight) and to reduce manual effort of writing the views to nil. This activity has reduced resource focusing on writing SQL Queries by 100%. The Views are created from a CSV file as an input and the Output is the SQL View File and can be run in any Google BigQuery Instance.
2GCP-BigQuery-auto-ddl-generator. Creating automated Google Cloud Big Query DDL Statements for Table Creation. This activity has reduced the manual efforts by 100% to create BQ DDL Insert/Append Queries. This is a Dev/Test only activity/for personal use only.
2Talend-quality-control-framework. Talend Quality Control Framework is an automated code analysis tool to motivate Talend developers and ETL Testers to design Talend Projects that adheres to a Strong and Solid coding standard.
2GCP-airflow-variable-setter. Creating automated YML to set Variables in Apache Airflow (Composer) to reduce manual effort to 0. This activity has reduced resource focusing on Manual Tasks by 99%. Fault tolerance is 1% in case of wrong input passed by triggers.
2GCP-data-modelling-from-YML. Creation of Data Modelling Sheet in an automated fashion from GCP Composer Airflow Variable setters. This activity has reduced dependency of Data Modelling Team to prepare Mapping Sheet from 100% to 0%.
2accenture-recruitment-check-bot. Are you frustrated to check your Application Status after interviewing? Fret Not! This is a python script to automatically login in to your Accenture in India account and print your current status on 30 Seconds interval to your console. So that you never miss an update from them ;)
1taldbt. Convert legacy Talend ETL to modern dbt SQL using semantic AI transpilation.
1SCD2-GCP-airflow-variable-setter. Creating automated YML to set Variables in Apache Airflow (Composer) to reduce manual effort to 0. This activity has reduced resource focusing on Manual Tasks by 99%.
1Talend-to-DBT-DuckDB-TempralIO-Agent. The Talend-to-dbt Migration Agent is not just a code translator; it is a logic refactoring engine. It parses the deep semantic structure of Talend jobs to ensure 1:1 behavioral parity while modernizing the codebase.
1Recon-GCP-BigQuery-vs-DataModelling. Creating automated Reconcilliation script to check Integrity of the GCP BigQuery DWH with Data Modelling sheet created by client Data Modelling team.
1talend-agentic-ai-linter. Talend, LLM, OpenRouter, automation, AI-linter, GPT, code-quality, agentic, YAML, data-engineering
1Talend-naukri-scrapper-report-generator. Creating reports using MS Power BI and to perform ETL using Talend tool. Generating Heat Map to find out trending Skills to optimize Naukri/Any other profile
1Talend-AWS-DataLake-Formation. The aim of generating data lake is to allow you to import any amount of data that can come in real-time. Data is collected from multiple sources, and moved into the data lake in its original format.
1