Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
Ploba logo
DiscoverHackathonsPeopleLearnAI Digest
Sign inGet started
HomeTop ChartsExploreCategories
TypesWeb apps1,894Agents585Plugins416APIs376Mobile apps152Datasets85
AdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise hereAdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise here
  1. Explore
  2. /
  3. AI
  4. /
  5. FineWeb
AI
FineWeb icon

FineWeb

by Hugging Face

FineWeb is Hugging Face's dataset of more than 18.5T tokens of cleaned and deduplicated English web text from Common Crawl. It is meant for pre-training language models.

Dataset·Free

View on Hugging Face(opens in a new tab)

About FineWeb

Key features of FineWeb

  • More than 18.5T tokens of English web text
  • Cleaned and deduplicated Common Crawl data
  • Dumps from 2013 onward, loadable one at a time
  • Sample configs of about 10B, 100B and 350B tokens
  • Processing code and ablation models published
  • Versioned releases with a public changelog

Who FineWeb is for

  • Teams pre-training language models
  • Researchers studying web data curation
  • Developers who need a smaller sample for experiments

How to use FineWeb

  1. 1

    Step 1: Choose the full dataset, a single dump or a sample config such as the 10B-token sample.

  2. 2

    Step 2: Load it with the datasets library, optionally in streaming mode.

  3. 3

    Step 3: Or fetch specific files with huggingface_hub's snapshot_download and an allow pattern.

  4. 4

    Step 4: Or read and filter documents with datatrove's ParquetReader.

  5. 5

    Step 5: Use the table of dumps on the card to plan disk space.

FineWeb FAQ

How big is FineWeb?

The card says more than 18.5T tokens, up from the 15T tokens of the first release.

What license is FineWeb under?

ODC-By 1.0.

Can I use a smaller piece of FineWeb?

Yes. There are configs for each Common Crawl dump and random samples of about 10B, 100B and 350B tokens.

Which language does FineWeb cover?

English web data.

Details

Pricing
FreeReleased under the ODC-By 1.0 license.
Type
Dataset
Categories
AIDataResearch
Added
Sep 17, 2026
Hugging Face iconPublisherHugging Face

Built from public sources

We put this page together from FineWeb’s own website and docs so you can compare it with other tools. Ploba isn’t affiliated with FineWeb.

Work at FineWeb? Claim the listing to manage it yourself.

Something wrong here?

More from Hugging Face

View publisher
FineWeb-Edu iconFineWeb-EduHugging Face · FreeFineWeb-Edu is a 1.3 trillion token dataset of educational web pages filtered from Hugging Face's FineWeb using an educational-quality classifier. It is for teams pretraining or researching large language models.AI · FreeHugging Face Datasets iconHugging Face DatasetsHugging Face · FreeHugging Face Datasets is the Hub's browsable index of machine-learning datasets, with full-text search and filters. It is for practitioners looking for datasets by task, modality, format or license.Developer Tools · FreeHugging Face iconHugging FaceHugging Face · FreemiumHugging Face is a platform for hosting and sharing machine learning models, datasets and demo apps. It also offers inference services and open-source libraries.Developer Tools · Freemium

Related tools

See more
UPUltraX PreviewOpenBMB · FreeUltraX Preview is a collection of five English pre-training corpora refined by UltraX, a framework that edits web text with structured function calls. Each corpus has about 20B tokens.AI · FreeMONET iconMONETJasper · FreeMONET is a dataset of 103.8 million English image-text pairs for training text-to-image models. It was distilled from 2.9 billion raw pairs through safety, domain and duplicate filtering.AI · FreeHLHumanity's Last ExamCAIS · FreeHumanity's Last Exam (HLE) is a benchmark of 2,500 expert-written questions across dozens of subjects, built to test AI models at the frontier of human knowledge. It is for researchers and model builders evaluating frontier AI.AI · Free