ByteDance
We present the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of more than 10,000 GPUs.
Visit official pageModality
Text
License
Proprietary
Released
2024-02
AIDB Score
84
MegaScale (Production) is built by ByteDance and indexed in AIDB, the searchable database of every major AI model. Compare it against alternatives, find similar models, or browse other AI tools used in General.