Víctor Gallego

stable-diffusion-aesthetic-gradients. Personalization for Stable Diffusion via Aesthetic Gradients 🎨

gpt-j-api. API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

zero-shot-reward-models. ZYN: Zero-Shot Reward Models with Yes-No Questions

configurable-safety-tuning. Data and models for the paper "Configurable Safety Tuning of Language Models with Synthetic Preference Data"

refined-dpo. Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs

awesome-rlaif. A curated and updated list of relevant articles and repositories on Reinforcement Learning from AI Feedback (RLAIF)

distilled-self-critique. distilled Self-Critique refines the outputs of a LLM with only synthetic data

sgmcmc-force. Samplers from the paper "Stochastic Gradient MCMC with Repulsive Forces"

samsi-deep-learning. Practical materials for the Deep Learning course at SAMSI/Duke Uni

ai-ml-course. Materials for the course: AI ML & Analytics

machine-learning. Projects for the Computational Geometry and Machine Learning course developed in Python

specification-self-correction. Code for the paper "Specification Self-Correction: Mitigating In-Context Reward Hacking Through Test-Time Refinement"

autocrit-likert-gpt. Automatic and zero-shot critique of outputs using the OpenAI API with json outputs

zero-shot-api. Python

random-thoughts. A personal blog and wiki about language models, reinforcement learning and what not.

art-explorer. Semantic search over paintings databases using deep learning

data-sharing. Jupyter Notebook

curso-ml-avanzado-21. Jupyter Notebook

personalCRMbot. A telegram bot for personal CRM relationships

ARAMARL. Experiments for the paper RL under Threats

meta-self-critique. MetaSC: Test-Time Safety Specification Optimization for Language Models

neural-classifier. Neural text classifier using pytorch for legal sentences

fom-tutorial. A gentle practical intro to adversarial ML using pytorch and cleverhans

vis. Jupyter Notebook

text-decrypter. A tool for decrypting text using Haskell

configurable-preference-tuning. Python

vicgalle.

nn-review. Code for the paper "Current advances in neural networks"

kaggle-bimbo. Group Bimbo Inventory Demand

train-text2text. Python

causal-covid-pollution. Estimating the (causal) impact of the covid-19 measures in pollution generated by urban traffic

wiki-example.

ARA-for-AT. Adversarial Risk Analysis for Improving Adversarial Training

merging-self-critique-jailbreaks. "Merging Improves Self-Critique Against Jailbreak Attacks", code and models

comp-algebra. Fundamental Computer Algebra algorithms implemented in Maple

C-like-compiler. A C-like language compiler written in Java that generates assembly code for the p-machine

phd-thesis. TeX

function-graphing-FPGA. Team project developed on FPGA using VHDL: Function graphing.

numerical-analysis-ode. A set of algorithms for the numerical integration of ordinary differential equations

AI. Several projects for the Artificial Intelligence course, with topics such as Recommender and Rule-based Systems, Ontologies and Natural Language Processing.

vicgalle.github.io. My personal webpage

os-utils. Some utils for UNIX systems administration. Developed during a university course (Advanced topics in operating systems and networks, fall 2015).

optimal-reward-design. Jupyter Notebook

cusp-dnn. Cumulative Shrinkage Priors for DNNs