stabilityai/stablelm-3b-4e1t

Text Generation·stabilityai· 92.5K· 314

transformers cc-by-sa-4.0 Text Generation 2.8B params dataset:tiiuae/falcon-refinedwebdataset:togethercomputer/RedPajama-Data-1Tdataset:CarperAI/pilev2-devdataset:bigcode/starcoderdatadataset:allenai/peS2o

StableLM-3B-4E1T is a 3 billion parameter decoder-only language model pre-trained on 1 trillion tokens of diverse English and code datasets for 4 epochs.

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull stabilityai/stablelm-3b-4e1t

Model details

Task

Text Generation

Provider

stabilityai

Framework

transformers

Parameters

2.8B

Size

5.2 GB

License

cc-by-sa-4.0

Downloads

92.5K

Likes

314

Paper

arXiv:2307.09288

Updated

2024-03-07

About stabilityai/stablelm-3b-4e1t

StableLM-3B-4E1T is a 3 billion parameter decoder-only language model pre-trained on 1 trillion tokens of diverse English and code datasets for 4 epochs.

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF Q Qwen/Qwen2.5-1.5B-Instruct Text Generation ·1.5B params 11.3M 748 🤗 HF

Browse all Text Generation models →