Rare find

PaLM. A simplified version of Google's advanced language model you can run yourself.

github.com/lucidrains/PaLM-pytorch

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2022

Release —0.2.2 Jul 29
0.2.2 Jul 29
Merge pull request #11 from conceptofmind/main Jul 29
Fix to is_eos_token variable Jul 29

June 2022

Release —v0.2.1 Jun 20
fix alibi in palm lite Jun 20
Release —v0.2.0a Jun 18
release palm lite version, thanks to @conceptofmind Jun 18
Release —v0.2.0 Jun 18
Merge pull request #10 from conceptofmind/main Jun 18
Add files via upload Jun 18

May 2022

native pytorch softmax is already numerically stable, thanks to @hypn… May 31

April 2022

small fix Apr 24
better comments Apr 22
Release —0.1.0 Apr 22
fuse the attention and feedforward projections, thanks to @feifeibear… Apr 22
link to yannic Apr 17
link Apr 12
move enwik8 to deepspeed examples folder Apr 12
Merge pull request #5 from conceptofmind/main Apr 12
Added DeepSpeed Implementation Apr 11
link to jax version Apr 8
fix citation, given paper is out on arxiv Apr 6
Release —0.0.12 Apr 5
fix rotary embedding caching Apr 5
start chipping away at Triton version of PaLM, use causal numerically… Apr 5
Release —0.0.11 Apr 5
Release —0.0.10 Apr 5
Release —0.0.9 Apr 4
Release —0.0.8 Apr 4