ML researcher who likes to build software. PhD student in Cambridge.
icai. Inverse Constitutional AI [ICLR 2025]: compressing pairwise preference data into a short constitution of principles.
42beobench. A toolkit providing easy and unified access to building control environments for reinforcement learning (RL) [No longer actively maintained]
42feedback-forensics. Feedback Forensics: An open-source toolkit to measure AI personality
26rl-building-control. A curated list of awesome projects applying reinforcement learning (RL) to building control.
18autoplotlib. Quickly generate plots in Python by simply describing them through text - e.g. use "create a scatter plot with name labels" instead of endlessly searching stackoverflow.
8solar-agent. This project provides Gym environments to train RL agents to operate batteries in solar-plus-battery installations.
5bauwerk. Meta reinforcement learning benchmark with building control environments. An attempt to help scale greener building controllers to more buildings.
4website.
1ml-agent-evaluator. [Maintained Fork] Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge?
1energym. Energym is an open source building simulation library designed to test climate control and energy management strategies on buildings in a systematic and reproducible way.
1gym. A toolkit for developing and comparing reinforcement learning algorithms.
1ai4er-cookiecutter. A quick way to instantiate projects for AI4ER
1