ort-batcher. Small crate to batch inferences of ONNX models using ort.

github.com/mlomb/ort-batcher

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.