Andrei Lopatenko

yourbench. 🤗 Benchmark Large Language Models Reliably On Your Data

LLMSearchRecommender. This compendium reviews significant published research contributions and industrial engineering practices in leveraging Generative AI and LLMs for developing search, recommender, personalization, and question-answering systems. It aims to cover the entire spectrum of research and practices

LLMEvaluation. A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.

Vane. Vane is an AI-powered answering engine.

llama2.c. Inference Llama 2 in one file of pure C

Jlama. Jlama is a modern LLM inference engine for Java

FlashRank. Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

RAGatouille. Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

BioWiC. A Dataset for Evaluating Contextualized Representation of Biomedical Concepts in Language Models

finetune-embedding. Fine-Tuning Embedding for RAG with Synthetic Data

Awesome-MLLM-Hallucination. 📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

llamaduo. [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs

UltraWiki. Python

nanoGPT. The simplest, fastest repository for training/finetuning medium-sized GPTs.

cal.diy. Scheduling infrastructure for absolutely everyone.