Spaces:

HuggingFaceFW
/

README

Running

App Files Files Community

README / README.md

guipenedo HF Staff

Update README.md

de63a1d verified about 1 month ago

preview code

raw

history blame contribute delete

1.48 kB

metadata

title: README
emoji: 👀
colorFrom: purple
colorTo: pink
sdk: static
pinned: false

🍷 FineData

This is the home of the 🍷 FineData team, a branch of the 🤗 Hugging Face Science Team releasing large scale pre-training datasets to accelerate open LLM development.

🍷 FineWeb: A 15T tokens English dataset for LLM pre-training. See the blogpost and paper.
📚 FineWeb-Edu: a filtered subset of the most educational content from FineWeb.
🥂 FineWeb2: an extension of FineWeb to over 1000 languages. See the paper.
📄 FinePDFs: 3T tokens of text data extracted from PDFs sourced from the Web.
🌐 FineWiki: an updated, better extracted version of Wikipedia in 300+ languages.
📄 FinePDFs-Edu: 350B+ highly educational tokens filtered from 📄 FinePDFs