为整个马林团队感到高兴。他们已经为此默默努力了很长时间。我很高兴能够在该模型的培训后与社区合作！
为整个马林团队感到高兴。他们已经为此默默努力了很长时间。我很高兴能够在该模型的培训后与社区合作！
查看英文原文
So happy for the whole Marin team. They've been quietly working up to this for a long time. I'm excited to get to work with the community post-training this model!
So happy for the whole Marin team. They've been quietly working up to this for a long time. I'm excited to get to work with the community post-training this model!
So happy for the whole Marin team. They've been quietly working up to this for a long time. I'm excited to get to work with the community post-training this model!
🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung scaling ladder from 1.6B-A61M (48B tokens) to 27.7B-A1.2B (926B tokens) to debug issues, and to make a forecast of our hero run. This is by far our biggest run, so definitely expecting the unexpected.
- 来源
- X @natolambert · x-natolambert
- 证据角色
- x_open_model_network
- 时间状态
- known
- 用户判决
- 未判