Task
Zero Shot Image Classification
N
visheratin/nllb-clip-base-oc
Zero Shot Image Classification·visheratin· 11.0K· 2
open_clip
cc-by-nc-4.0
Zero Shot Image Classification
dataset:visheratin/laion-coco-nllbarxiv:2309.01859license:cc-by-nc-4.0region:us
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the standard CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets state-of-the-art on the Crossmodal-3600 dataset by performing very well on low-resource languages. You can find more details about the model in the paper.
# pull & run locally
pip install mlforge-sdk && mlforge pull visheratin/nllb-clip-base-oc
pip install mlforge-sdk && mlforge pull visheratin/nllb-clip-base-oc
Model details
Provider
visheratin
Framework
open_clip
Size
1.9 GB
License
cc-by-nc-4.0
Downloads
11.0K
Likes
2
Paper
arXiv:2309.01859
Updated
2023-10-24
About visheratin/nllb-clip-base-oc
NLLB-CLIP is a model that combines a text encoder from the NLLB model and an image encoder from the standard CLIP. This allows us to extend the model capabilities to 201 languages of the Flores-200. NLLB-CLIP sets state-of-the-art on the Crossmodal-3600 dataset by performing very well on low-resource languages. You can find more details about the model in the paper.