ggml-org/embeddinggemma-300m-qat-q8_0-GGUF

Feature Extraction·ggml-org· 65.2K· 18

sentence-transformers gemma Feature Extraction base_model:google/embeddinggemma-300m-qat-q8_0-unquantizedbase_model:quantized:google/embeddinggemma-300m-qat-q8_0-unquantizedlicense:gemmaregion:us

sh llama-server -hf ggml-org/embeddinggemma-300m-qat-q80-GGUF --embeddings

Open in MLForge Sign up free Desktop app Source ↗

# pull & run locally
pip install mlforge-sdk && mlforge pull ggml-org/embeddinggemma-300m-qat-q8_0-GGUF

Model details

Task

Feature Extraction

Provider

ggml-org

Framework

sentence-transformers

Size

313 MB

License

gemma

Downloads

65.2K

Likes

Updated

2025-09-15

About ggml-org/embeddinggemma-300m-qat-q8_0-GGUF

Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl:

Related Feature Extraction

B BAAI/bge-small-en-v1.5 Feature Extraction ·33.4M params 61.8M 497 🤗 HF B BAAI/bge-large-en-v1.5 Feature Extraction ·335.1M params 14.9M 688 🤗 HF Q Qwen/Qwen3-Embedding-0.6B Feature Extraction ·595.8M params 10.5M 1.1K 🤗 HF B BAAI/bge-base-en-v1.5 Feature Extraction ·109.5M params 8.6M 441 🤗 HF M intfloat/multilingual-e5-large Feature Extraction ·559.9M params 8.1M 1.2K 🤗 HF M mixedbread-ai/mxbai-embed-large-v1 Feature Extraction ·335.1M params 6.0M 810 🤗 HF

Browse all Feature Extraction models →