Rare find

Self-Rewarding LM. Train AI models that grade and improve their own answers.

github.com/lucidrains/self-rewarding-lm-pytorch

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

April 2024

Release —0.2.12 Apr 11
0.2.12 Apr 11
Merge pull request #29 from Control-derek/derek Apr 11
Fixed label mask error Apr 7
Fixed deep copy, shallow copy problem Apr 7

March 2024

Release —0.2.11 Mar 29
0.2.11 Mar 29
Merge pull request #28 from Control-derek/derek Mar 29
config. Mar 29
Release —0.2.10 Mar 29
0.2.10 Mar 29
Merge pull request #27 from Control-derek/derek Mar 29
step->self.steps Mar 29
Release —0.2.9 Mar 27
patch Mar 27
Merge pull request #26 from Control-derek/derek Mar 27
add self. Mar 26

February 2024

Release —0.2.8 Feb 19
fix type error Feb 19
Merge pull request #19 from ViswanathaReddyGajjala/patch-1 Feb 19
Fix TypeError for is_valid_reward in SelfRewardDPOConfig Feb 19
Release —0.2.7 Feb 9
patch Feb 9
Merge pull request #17 from unaidedelf8777/patch-1 Feb 9
Update self_rewarding_lm_pytorch.py Feb 9
allow for an external LLM to play as reward model, as in OAIF Feb 8
Release —0.2.6 Feb 8
Release —0.2.5 Feb 3
Release —0.2.4 Feb 1
Release —0.2.3 Feb 1