Sem

flake8-pyspark-with-column. A flake8 plugin that detects of usage withColumn in a loop or inside reduce

graphframes-rs. GraphFrames but in DataFusion

ibisgraph. An implementation of Pregel framework and graph algorithms on top of it with Ibis project DataFrames.

pyspark-mcp-server. MPC Server for PySpark inpired by the LakeSail

spark-connect-example. An example of SparkConnect extension.

feature-generation-benchmark. A database-like benchmark of feature generation from time-series data

PennylaneQuantumFeatureMaps. Jupyter Notebook

safetensors-spark. Apache Spark Native DataSource for Safetensors

Binning. Monotonic binning (WOE) in Python

tsumugi-spark. SparkConnect Server plugin and protobuf messages for the Amazon Deequ Data Quality Engine.

python-deequ. Python API for Deequ

RandomGraphModels. Python

chispa. PySpark test helper methods with beautiful error messages

.emacs.d. my vibe-coded .emacs.d