Rare find

Lion. A faster way to train AI models that Google's research team discovered works better than the standard method.

github.com/lucidrains/lion-pytorch

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2026

accommodate complex tensors https://github.com/lucidrains/lion-pytorc… Jul 9

March 2026

add cautious weight decay for cautious lion from Chen et al. Mar 4

November 2024

Release —0.2.3 Nov 27
add lion with cautious update, from Liang et al. Nov 27
Merge pull request #38 from sarthakpati/added_conda_installation Nov 22
Update README.md Nov 22
Update README.md Nov 22

June 2024

cleanup Jun 15
Release —0.2.2 Jun 15
oops Jun 15
Release —0.2.1 Jun 15
add option for decoupled weight decay Jun 15
Release —0.2.0 Jun 15
add a foreach version of lion Jun 15

March 2024

Release —0.1.4 Mar 30
update triton warning message Mar 30
Merge pull request #36 from yousufmo/patch-1 Mar 30
Fix in-place modification when autotuning triton Lion update Mar 19

May 2023

Release —0.1.2 May 10
Merge pull request #26 from lucidrains/pre-hook-autotuner May 10
attempt to fix autotune + inplace update issue May 10
Revert "address an issue with triton auto-tuner and in-place calls. m… May 10
Revert "actually, just follow @ipoletaev advice and remove autotuner … May 10
Release —0.1.0 May 9
actually, just follow @ipoletaev advice and remove autotuner for now May 9
Release —0.0.8 May 9
address an issue with triton auto-tuner and in-place calls. make the … May 9

March 2023

necessary caution Mar 13
Merge pull request #19 from xiangning-chen/main Mar 10
Clarify the instructions for using Lion. Summarize the updates. Mar 10