pmem-shuffle. Spark* Shuffle plugin for support shuffling through remote persistent memory over fabrics, which leverages the RDMA network and remote persistent memory (for read) to provide extremely high performance and low latency shuffle solutions for Spark*.

github.com/Eugene-Mark/pmem-shuffle

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.