Task
Text Generation
W
wikimedia/wikipedia
Text Generation · wikimedia· 240.8K
["cc-by-sa-3.0","gfdl"]
488 KB
Dataset Card for Wikimedia Wikipedia Dataset Summary Wikipedia dataset containing cleaned articles of all languages. The dataset is built from the Wikipedia dumps (https://dumps.wikimedia.org/) with one subset per language, each containing a single train split. Each example contains the content of one full Wikipedia article with cleaning to strip markdown and unwanted sections (references, etc.). All language subsets have already been processed for recent dump… See the full description on the dataset page: https://huggingface.co/datasets/wikimedia/wikipedia.
# download instantly
mlforge datasets pull wikimedia/wikipedia
mlforge datasets pull wikimedia/wikipedia
Dataset details
Language
ab
License
["cc-by-sa-3.0","gfdl"]
Size
488 KB
Creator
wikimedia
Downloads
240.8K
Source
huggingface_datasets
Updated
2024-01-09
About wikimedia/wikipedia
--- language: - ab - ace - ady - af - alt - am - ami - an - ang - anp - ar - arc - ary - arz - as - ast - atj - av - avk - awa - ay - az - azb - ba - ban - bar - bbc - bcl - be - bg - bh - bi - bjn - blk - bm - bn - bo - bpy - br - bs - bug - bxr - ca - cbk - cdo - ce - ceb - ch - chr - chy - ckb - co - cr - crh - cs - csb - cu - cv - cy - da - dag - de - dga - din - diq - dsb - dty - dv - dz - ee - el - eml - en - eo - es - et - eu - ext - fa - fat - ff - fi - fj - fo - fon - fr - frp - frr - fur - fy - ga - gag - gan - gcr - gd - gl - glk - gn - gom - gor - got - gpe - gsw - gu - guc - gur - guw - gv - ha - hak - haw - hbs - he - hi - hif - hr - hsb - ht - hu - hy - hyw - ia - id - ie - ig - ik - ilo - inh - io - is - it - iu - ja - jam - jbo - jv - ka - kaa - kab - kbd - kbp - kcg - kg - ki - kk - kl - km - kn - ko - koi - krc - ks - ksh - ku - kv - kw - ky - la - lad - lb - lbe - lez - lfn - lg - li - lij - lld - lmo - ln - lo - lt - ltg - lv - lzh - mad - mai - map - mdf - mg - mhr - mi - min - mk - ml - mn - mni - mnw - mr - mrj - ms - mt - mwl - my - myv - mzn - nah - nan - nap - nds - ne - new - nia - nl - nn - 'no' - nov - nqo - nrf - nso - nv - ny - oc - olo - om - or - os - pa - pag - pam - pap - pcd - pcm - pdc - pfl - pi - pih - pl - pms - pnb - pnt - ps - pt - pwn - qu - rm - rmy - rn - ro - ru - rue - rup - rw - sa - sah - sat - sc - scn - sco - sd - se - sg - sgs - shi - shn - si - sk - skr - sl - sm - smn - sn - so - sq - sr - srn - ss - st - stq - su - sv - sw - szl - szy - ta - tay - tcy - te - tet - tg - th - ti - tk - tl - tly - tn - to - tpi - tr - trv