G
ModelSpace/GemmaX2-28-9B-Pretrain
Translation·ModelSpace· 341· 3
Model Description GemmaX2-28-9B-Pretrain is a language model developed through continual pretraining of Gemma2-9B using a mix of 56 billion tokens from both monolingual and parallel data across 28 different languages. Please find more details in our paper: Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study.
# pull & run locally
pip install mlforge-sdk && mlforge pull ModelSpace/GemmaX2-28-9B-Pretrain
pip install mlforge-sdk && mlforge pull ModelSpace/GemmaX2-28-9B-Pretrain
Model details
Task
Translation
Provider
ModelSpace
Framework
transformers
Parameters
10.2B
Size
19 GB
License
gemma
Downloads
341
Likes
3
Paper
arXiv:2502.02481
Updated
2025-03-21
About ModelSpace/GemmaX2-28-9B-Pretrain
Model Description GemmaX2-28-9B-Pretrain is a language model developed through continual pretraining of Gemma2-9B using a mix of 56 billion tokens from both monolingual and parallel data across 28 different languages. Please find more details in our paper: Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study.