TinyLlama/TinyLlama-1.1B-Chat-v1.0

Text Generation·TinyLlama· 2.2M· 1.6K

transformers apache-2.0 1.1B params dataset:cerebras/SlimPajama-627Bdataset:bigcode/starcoderdatadataset:HuggingFaceH4/ultrachat_200kdataset:HuggingFaceH4/ultrafeedback_binarizedlicense:apache-2.0

text generation · transformers model

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull TinyLlama/TinyLlama-1.1B-Chat-v1.0

Model details

Task

Text Generation

Provider

TinyLlama

Framework

transformers

Parameters

1.1B

License

apache-2.0

Downloads

2.2M

Likes

1.6K

Updated

2024-03-17

About TinyLlama/TinyLlama-1.1B-Chat-v1.0

The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.

Related Text Generation

Q Qwen/Qwen3-0.6B Text Generation ·751.6M params 27.8M 1.4K 🤗 HF Q Qwen/Qwen3-4B Text Generation ·4.0B params 16.4M 641 🤗 HF G openai-community/gpt2 Text Generation ·137.0M params 13.3M 3.3K 🤗 HF Q Qwen/Qwen3-8B Text Generation ·8.2B params 13.0M 1.2K 🤗 HF Q Qwen/Qwen2.5-7B-Instruct Text Generation ·7.6B params 12.8M 1.4K 🤗 HF O facebook/opt-125m Text Generation 12.3M 267 🤗 HF