Rare find

flux-fp8-api. Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

github.com/aredden/flux-fp8-api

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.