small-malaysian-lm-B200. We want to compare how good Qwen3-1.7B-Base using B200 to continue pretraining on Malaysian multi-lingual corpus on different mixed precision training with proper truncated multi-packing.

github.com/Scicom-AI-Enterprise-Organization/small-malaysian-lm-B200

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.