@Inferact | @vllm-project | M.S. @ Sun Yat-Sen University
pillow-jpegxl-plugin. Pillow plugin for JPEG-XL, using Rust for bindings.
61SakuraLLM-Notebooks. Notebooks to run SakuraLLM on colab
54xformers-prebuild-wheels. xformers prebuild wheels for T4 and P100 GPU, suitable for kaggle notebook environment.
10Acolite-GEE-Colab. Jupyter Notebook
6vllm. A high-throughput and memory-efficient inference and serving engine for LLMs
5nozomipy-async. Python Async API for nozomi.la
2ggml-libtorch. Cuda
1