RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Model Overview - Model Architecture: DeepSeek-Coder-V2-Lite-Instruct - Input: Text - Output: Text - Model Optimizations: - Weight quantization: FP8 - Activation quantization: FP8 - Intended Use Cases: Intended for commercial and research use in English. Similarly to Meta-Llama-3-7B-Instruct, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates ap
pip install mlforge-sdk && mlforge pull RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Model details
About RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Model Overview - Model Architecture: DeepSeek-Coder-V2-Lite-Instruct - Input: Text - Output: Text - Model Optimizations: - Weight quantization: FP8 - Activation quantization: FP8 - Intended Use Cases: Intended for commercial and research use in English. Similarly to Meta-Llama-3-7B-Instruct, this models is intended for assistant-like chat. - Out-of-scope: Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - Release Date: 7/18/2024 - Version: 1.0 - License(s): deepseek-license - Model Developers: Neural Magic