datablations

https://github.com/huggingface/datablations

Activity Feed Request to join this org

AI & ML interests

Scaling Data-Constrained Language Models

Recent Activity

thomwolf authored a paper about 2 months ago

Robot Learning: A Tutorial

thomwolf authored a paper 6 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

craffel authored a paper 6 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

View all activity

datablations 's datasets 13

datablations/scripts

Viewer • Updated Jun 15, 2023 • 3.48M • 2.46k

datablations/oscar-subsets

Viewer • Updated Jun 14, 2023 • 365k • 831

datablations/c4-subsets

Viewer • Updated Jun 14, 2023 • 729k • 1.22k • 5

datablations/c4-filter-megatron

Updated May 28, 2023 • 477

datablations/oscar-filter-megatron

Updated May 27, 2023 • 226

datablations/python-megatron

Updated May 22, 2023 • 1.81k • 1

datablations/subsets

Viewer • Updated May 10, 2023 • 365k • 54

datablations/oscar-filter

Viewer • Updated May 10, 2023 • 432M • 5.15k

datablations/oscar-dedup-expanded

Viewer • Updated May 10, 2023 • 432M • 4.28k

datablations/mup

Updated Apr 24, 2023 • 1.01k

datablations/c4-filter

Viewer • Updated Feb 1, 2023 • 365M • 4.8k

datablations/c4-filter-small

Viewer • Updated Jan 17, 2023 • 100k • 162

datablations/oscar-filter-small

Viewer • Updated Nov 24, 2022 • 100k • 19