Task
Image To Text
O
OpenGVLab/OmniCorpus-CC
Image To Text · OpenGVLab· 16.7K
cc-by-4.0
466 GB
🐳 OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text ⭐️ NOTE: Several parquet files were marked unsafe (viruses) by official scaning of hf, while they are reported safe by ClamAV and Virustotal. We found many false positive cases of the hf automatic scanning in hf discussions and raise one discussion to ask for a re-scanning. This is the repository of OmniCorpus-CC, which contains 988 million image-text interleaved documents collected from Common… See the full description on the dataset page: https://huggingface.co/datasets/OpenGVLab/OmniCorpus-CC.
# download instantly
mlforge datasets pull OpenGVLab/OmniCorpus-CC
mlforge datasets pull OpenGVLab/OmniCorpus-CC
Dataset details
Language
en
License
cc-by-4.0
Size
466 GB
Creator
OpenGVLab
Downloads
16.7K
Source
huggingface_datasets
Updated
2025-03-20
About OpenGVLab/OmniCorpus-CC
--- language: - en license: cc-by-4.0 sizecategories: - 100M<n<1B taskcategories: - image-to-text - visual-question-answering datasetinfo: - configname: CC-MAIN-2013-20 features: - name: generalmetadata struct: - name: domain sequence: string - name: fluencyprob dtype: float64 - name: id dtype: string - name: nonadvertisementprob dtype: float64 - name: politicsprob dtype: float64 - name: pornprob dtype: float64 - name: toxicprob dtype: float64 - name: url dtype: string - name: images sequence: string - name: texts sequence: string - name: metadata list: - name: aestheticprob dtype: float64 - name: bytes dtype: int64 - name: dhash dtype: string - name: dhashdupcount dtype: int64 - name: height dtype: int64 - name: imgurlsha dtype: string - name: phash dtype: string - name: phashdupcount dtype: int64 - name: unsafeprob dtype: float64 - name: width dtype: int64 splits: - name: train numbytes: 19908676196 numexamples: 3878063 downloadsize: 9303464923 datasetsize: 19908676196 - configname: CC-MAIN-2013-48 features: - name: generalmetadata struct: - name: domain sequence: string - name: fluencyprob dtype: float64 - name: id dtype: string - name: nonadvertisementprob dtype: float64 - name: politicsprob dtype: float64 - name: pornprob dtype: float64 - name: toxicprob dtype: float64 -