Rare find

MetNet3. An AI weather forecasting model based on Google Deepmind's design.

github.com/lucidrains/metnet3-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

November 2023
  • Release —0.0.12
  • start using a specific linear attention for channel modulation, which…
  • redo the hrrr norm strategy to be completely flexible
  • Release —0.0.11
  • Release —0.0.10
  • Release —0.0.9
  • first pass at inputs, redo hrrr
  • todo
  • make sure targets and losses are to spec
  • Release —0.0.8
  • Release —0.0.7
  • offer another way to normalize hrrr targets and predictions
  • Release —0.0.6
  • running mean and variance should only be updated during training
  • Release —0.0.5
  • normalization of hrrr pred and targets should use same statistics
  • Release —0.0.4
  • Release —0.0.3
  • use a sync batchnorm as way of normalizing all channels of the HRRR, …
  • handle both the cross entropy loss as well as the mse loss
  • project management
  • credit assignment
  • first pass at entire unet + maxvit architecture
  • add film like conditioning before attention as stated in the paper
  • prepare sync batchnorm automatically for maxvit distributed training
  • need center padding operation
  • ready lead time embeddings, prepare down and upsamples as well as cen…
  • diagram
  • safe division
  • add loss scaler