Matthew Powers

chispa. PySpark test helper methods with beautiful error messages

mack. Delta Lake helper methods in PySpark

code_quizzer. Programming practice questions with Ruby, JavaScript, Rails, and Bash.

frontend-generators. Rake tasks to add Bootstrap, Font Awesome, and Start Bootstrap Landing Pages to a Rails app

spark-sbt.g8. A giter8 template for Spark SBT projects

spark-stringmetric. Spark functions to run popular phonetic and string matching algorithms

bebe. Filling in the Spark function gaps across APIs

farsante. Fake Pandas / PySpark DataFrame creator

ceja. PySpark phonetic and string matching algorithms

beavis. Pandas helper functions

tic_tac_toe. Ruby tic tac toe game

spark-test-example. Spark DataFrame transformation and UDF test examples

spark-spec. Test suite to document the behavior of Spark

gill. An example PySpark project with pytest

python-parquet-examples. Using the Parquet file format with Python

spark-slack. Speak Slack notifications and process Slack slash commands

directed_graph. Modeling directed acyclic graphs (DAG) for topological sorting, shortest path, longest path, etc.

querybench. Benchmarks for DataFusion, Daft, DuckDB, Polars, and pandas

pysparktestingexample. PySpark testing example project

unicron. DAGs on DAGs! Smart PySpark custom transformation runner

scalatest-example. Testing Scala code with scalatest

awesome-spark. A curated list of awesome Apache Spark packages and resources.

eren. PySpark Hive helper methods

JavaSpark. Example Spark project with Java API

spark-pika. Demo how to set up Spark with SBT

mill_spark_example. Apache Spark project with the Mill build tool

slack_trello. Helping Slack and Trello play together nicely

spark-etl. Lightweight Spark ETL framework

appa. Data lake metadata / transaction log store

deltadask. Delta Lake powered by Dask

pydata-style-guide. Style for the PyData stack

mesita. Print colorful tables with nice diffs in the Terminal

datafusion-book. DataFusion book

great-spark. Curated collection of Spark libraries and example applications

roman_monkey. Adds to_roman to Integer class and to_arabic_number to String class for fun

ml-book. Introduction to Machine Learning with Python Book

pydata-examples. Examples of various PyData technologies like pandas, DataFusion, DuckDB, and Polars

spark-examples. A Spark playground to help me write blog posts

redshift_extractor. Using the Redshift UNLOAD/COPY commands to move data from one Redshift cluster/database to another

hll-example. Implementing HyperLogLog functions in Spark

blake. Great Pandas and Jupyter workflow with Poetry

data-scrapbook. A collection of images and captions to explain core data concepts