HomeDatasetsacul3/KoPI-CC
K

acul3/KoPI-CC

Text Generation · acul3· 2.7K
cc 216 GB

KoPI-CC (Korpus Perayapan Indonesia)-CC is Indonesian only extract from Common Crawl snapshots using ungoliant, each snapshot also filtered using some some deduplicate technique such as exact hash(md5) dedup technique and minhash LSH neardup

Open in MLForge Sign up free Desktop app
# download instantly
mlforge datasets pull acul3/KoPI-CC

Dataset details

Task
Text Generation
Language
id
License
cc
Size
216 GB
Creator
acul3
Downloads
2.7K
Source
huggingface_datasets
Updated
2023-03-03

About acul3/KoPI-CC

KoPI-CC (Korpus Perayapan Indonesia)-CC is Indonesian only extract from Common Crawl snapshots using ungoliant, each snapshot also filtered using some some deduplicate technique such as exact hash(md5) dedup technique and minhash LSH neardup