noonghunna

buun-llama-cpp. LLAMA Turboquant implementation with CUDA support

vllm-ampere-optimized. Optimized VLLM for Ampere

ODS. Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

T3MP3ST. autonomous red teaming platform; multi-agent offensive-security meta-harness

Agent-Reach. Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

shard. Pipeline-parallel LLM inference across GPUs on separate machines.

VibeThinker. Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B

ik_llama.cpp. llama.cpp fork with additional SOTA quants and improved performance

skills. Skills for Real Engineers. Straight from my .agents directory.

deep-swe. Measuring frontier coding agents on original, long-horizon engineering tasks

llama-cpp-turboquant. LLM inference in C/C++

Llama-Optimizer. Automatically find the fastest possible settings for running large language models on your machine. Supports llamma.cpp and ik_llama.cpp

beellama.cpp. KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM

train-llm-from-scratch. A straightforward method for training your LLM, from downloading data to generating text.

pi. AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

whichllm. Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

marin. Open-source framework for the research and development of foundation models.

longctx. Open long-context inference stack: retrieval + open weights, no closed parts. pip install longctx.

turboquant_plus. Python

MLS-Bench. Python

club-3090-server. Single-file installer for a club-3090 webserver providing an admin control panel, a reverse proxy that automatically routes requests to the correct containers via a single endpoint with configurable vLLM setting presets, live log management, GPU power and fan speed controls, multi-instance GPU orchestration and API access control for multiple users

benchlocal-cli. CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.

club-3090. Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1× and 2× cards.

dflash. DFlash: Block Diffusion for Flash Speculative Decoding

sndr_core_engine. SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI.

BenchLocal. Test LLMs on real tasks. Compare models side-by-side.

ai-legal-claude. AI Legal Assistant skill for Claude Code. Contract review, risk analysis, NDA generation, compliance auditing, negotiation strategy, and PDF reports — 14 skills, 5 parallel agents. If you want to learn how to sell this to real businesses, check out the Skool community

ToolCall-15. TypeScript

whatmodels. Figure out what models you can run locally

picoclaw. Tiny, Fast, and Deployable anywhere — automate the mundane, unleash your creativity

openclaw. Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

CodexBar. Show usage stats for OpenAI Codex and Claude Code, without having to login.

mcp_agent_mail. Asynchronous coordination layer for AI coding agents: identities, inboxes, searchable threads, and advisory file leases over FastMCP + Git + SQLite

vscode-antigravity-cockpit. VS Code extension for monitoring Google Antigravity AI quotas. Features Webview dashboard, QuickPick mode, and quota grouping.

proxypal. A desktop app that lets you use your AI subscriptions (Claude, ChatGPT, Gemini, GitHub Copilot) with any coding tool. Wraps CLIProxyAPI with a clean UI for managing connections and tracking usage.

ccs. Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.

claude-code-proxy. Run Claude Code on OpenAI models

dyad. Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

claude-code-switch. One-command model switcher for Claude Code (Only for Anthropic API).

MiniMax-M2. MiniMax-M2, a model built for Max coding & agentic workflows.

vibeproxy. Native macOS menu bar app to use your Claude Code & ChatGPT subscriptions with AI coding tools - no API keys needed

CLIProxyAPI. Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini 3.1 Pro, GPT 5.5, Grok 4.3, Claude model through API

CL4R1T4S. LEAKED SYSTEM PROMPTS FOR CHATGPT, CLAUDE, GEMINI, GROK, PERPLEXITY, CURSOR, LOVABLE, REPLIT, AND MORE! - AI SYSTEMS TRANSPARENCY FOR ALL! 👐

K2-Vendor-Verifier. Verify Precision of all Kimi K2 API Vendor

LongCat-Flash-Thinking.

Ai-speedometer. Benchmark AI model speeds with TTFT, tokens/sec, and performance metrics .

qwen-code. An open-source AI coding agent that lives in your terminal.

UI-TARS-desktop. The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

BMAD-METHOD. Breakthrough Method for Agile Ai Driven Development

camoufox. 🦊 Anti-detect browser

Turnstile-Solver. Python-based turnstile solver using the patchright library, featuring multi-threaded execution, API integration, and support for different browsers.

security-guide-for-developers. Security Guide for Developers