This is your work, valued

Novara, Italy

Fabio Matricardi

Expert
@fabiomatricardi

thepoorgpuguy. Medium writer on Artificial Intelligence

GPT4All_Medium. Repo of the code from the Medium article

84

cdQnA. repository for documents and studies about closed domain question and answering with LLM

46

Deepseek-R1-qwen1.5B. how to run DeepSeek-R1-Distill-Qwen-1.5B GGUF locally on your PC

29

LaMiniPower. The power of a small LLM for your domain knowledge QnA

24

How-I-Built-a-Chatbot-that-Crushed-ChatGPT. Repo of the code from the Medium article

21

ModernFastAPI. Repo of the code from the Medium article - Build a powerful LLM API right on your computer

19

ChatBOTMastery. Your Chatbot Mastery: build a super small custom AI assistant with Gradio_client Python and Streamlit - Chapter 1

17

TiniLlamaGradioChat. Repo for a ChatBot, with Gradio, Streaming TinyLlama1.1BOpenOrca.gguf on CPU only

11

AI-ExtractData-NuExtract-tiny. NuExtract-tiny GGUF for data extraction in json format

11

My-2B-Reflection-LLM. How to build your own Reflection LLM with only 2B parameters model

10

YouAreTheBenchmark. Personal Catalog of prompt templates for NLP tasks

9

whisperCPP-streamlit. Repo of the code from the Medium article

9

LaminiChat. Repo of the code from the Medium article Say Goodbye to OpenAI part2

9

HFChatbot. Repo of the code from the Medium article: Say Goodbye to OpenAI

9

YourFastAPI. Repo of the code from the Medium article A FastAPI for your Local LLM

7

openvino-api-server. my personal attempt to openai API compatible openvino server

7

Gemma2B-ChatAssistant. Maybe Gemma-2B-IT is the smallest and best chat friend you can have

6

NanollavaCPP. nanollava with virtualenv python3.11 llamacpp-python and streamlit

6

danube3-0.5b-chat. stramlit AI assistant with llamacpp and H2O danube3

6

RuleThemAll. Repo of the code from the Medium article

6

Gemma2-2b-it-chatbot. Repo of the code from the Medium article about running Gemma2 2b locally

5

LlamaFile-4-ALL. A quantized LLM and API webserver in one single executable file

5

135M-you-cannot-go-Smaller. Repo of the code from the Medium article 135M: you cannot go Smaller

5

Mistral-DesktopApp. Streamlit Chat-bot with Mistral.ai free API into a standalone Windows Desktop App

5

GradioLangchainCustomLLM. How to build a Custom LLM wrapping a Gradio API call into Langchain

5

llmwareSLIMS. Repo of the code from the Medium article

5

17megabyteCHATBOT. Repo of the code from the Medium article

4

Gemma2-9b-GradioClient. Run with API call to Hugging Face Spaces Gemma2-9B model

4

KingOfTheTiny. Repo of the code from the Medium article about TinyVicuna1B GGUF

4

NuExtract-1.5-openvino. Extract data with LLM and openvino

4

YourAIPhotoStory. Repo of the code from the Medium article Create your own AI powered Photo story

4

llamaCPPServerVisual. llama.cpp server running InternVL-2.5-1b locally

4

twitterStoryCreator. Repository for the Article on Medium about Serverless GPU

3

llamacppChatDocs. Chat with your documents using only LlamaCPP and Langchain

3

Qwen3-4bChatDocs. Textual interface to chat with your documents using llama-cpp server and Qwen3-4b.gguf

3

NuEtract1.5-streamlit. simple use of LLM extracting structured data from plain text

3

Playgrounds. Repo of the code from the Medium article

3

llamaCPP_Agents. Run AI agents with llama-cpp-agents locally

3

OpenVINO-Gemma2B-streamlit. Using OpenVINO with Gemma2-2B INT4 and streamlit CHAT APP

2

MetadataIsAllYouNeed. Repo of the code from the Medium article Metadata Metamorphosis: from plain Data to Enhanced insights with Retrieval Augmented Generation

2

ZephyrGPT4ALL. Test of Chat with documents and RAG reranking multi-language with Zephyr7b GPTQ

2

AI-RewriteText. Medium article repo to use LaMini AI to rewrite text

2

phi-3-miniTEST. Repo of the code from the Medium article

2

StableDiffusionCPP-usage. Create images with dreamshaper_8 on your CPU

2

OpenELM270M-test. Repo of the code from the Medium article

2

ImageUpscaler. Streamlit App to Upscale images and compared visualization - Repo of the code from the Medium article

2

thePromptBattle. Repo of the code and results from the Medium article Battle of the Prompts: Unveiling the True Capabilities of Open Source Language Models

2

Gemini2FlashInChina. Open Router ai Gradio client for Gemini2 flash working also in China

2

Mistral-LeChat. all you need to start with Le Chat Mistral API

2

Qwen3-0.6bReason. llamacpp server and qwen3 textual chat interface with reasoning options

1

llamacpp-speculative. llama-cpp-python server with speculative decoding

1

LFM2-localAI. Quick chat interface with LFM2-700M and llama.cpp server

1

OPENVINO-betterStreamer. Textual Interface for Gemma2-2B Openvino with streaming effect

1

qwen2.5-1.5b-testbench. run GGUF qwen2.5-1.5b with llamaCPP-python

1

nanoLlava-cpp. How to run nanollava with llama-cpp-python

1

HowSmalltoChatYouCanGo. Repo of the code from the Medium article

1

Qwen2.5ChatDocs. A gradio Chatbot with llamaCPP server and Qwen2.5 3B for your documents

1

BattleOfTheTiny-part1. Repo of the code from the Medium article

1

smolLM2-GradioChatbot. a Gradio Chatbot with llama-server backhand

1

OLMOE_llamaCPP. Streamlit chatbot with llama.cpp and OLMoE from AllenAI AI2

1