Task
Text Generation
Q
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation·RedHatAI· 1.0M· 4
apache-2.0
1.8B params
base_model:Qwen/Qwen2.5-1.5Bbase_model:quantized:Qwen/Qwen2.5-1.5Blicense:apache-2.0
Model Overview - Model Architecture: Qwen2 - Input: Text - Output: Text - Model Optimizations: - Activation quantization: INT8 - Weight quantization: INT8 - Intended Use Cases: Intended for commercial and research use multiple languages. Similarly to Qwen2.5-1.5B, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates applicable laws or regulations
# pull & run locally
pip install mlforge-sdk && mlforge pull RedHatAI/Qwen2.5-1.5B-quantized.w8a8
pip install mlforge-sdk && mlforge pull RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Model details
Provider
RedHatAI
Parameters
1.8B
Size
2.1 GB
License
apache-2.0
Downloads
1.0M
Likes
4
Updated
2024-12-03
About RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Model Overview - Model Architecture: Qwen2 - Input: Text - Output: Text - Model Optimizations: - Activation quantization: INT8 - Weight quantization: INT8 - Intended Use Cases: Intended for commercial and research use multiple languages. Similarly to Qwen2.5-1.5B, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates applicable laws or regulations (including trade compliance laws). - Release Date: 10/09/2024 - Version: 1.0 - License(s): apache-2.0 - Model Developers: Neural Magic