Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
Ploba logo
DiscoverHackathonsPeopleLearnAI Digest
Sign inGet started
HomeTop ChartsExploreCategories
TypesWeb apps1,894Agents585Plugins416APIs376Mobile apps152Datasets85
AdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise hereAdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise here
  1. Explore
  2. /
  3. AI
  4. /
  5. GAIA
AI
GA

GAIA

by GAIA Benchmark

GAIA is a benchmark of more than 450 questions with unambiguous answers for evaluating LLMs that use tools, search and prompting. It is for teams measuring how well AI assistants handle multi-step tasks.

Dataset·Free

View on Hugging Face(opens in a new tab)

About GAIA

Key features of GAIA

  • More than 450 questions with unambiguous answers
  • Three difficulty levels
  • Public dev set and test set with private answers
  • Some questions include attached files such as PDFs and media
  • Parquet-backed splits compatible with current datasets releases
  • Public leaderboard hosted on Hugging Face
  • Described in the paper GAIA: a benchmark for General AI Assistants

Who GAIA is for

  • Researchers evaluating tool-using LLMs
  • Teams building AI assistants and agents
  • Developers comparing systems on a public leaderboard

How to use GAIA

  1. 1

    Step 1: Sign in to Hugging Face and accept the access conditions on the GAIA page.

  2. 2

    Step 2: Download the repository with snapshot_download from huggingface_hub.

  3. 3

    Step 3: Load a config such as 2023_level1 with load_dataset from the downloaded directory.

  4. 4

    Step 4: Read each Question and open any attachment using its file_path.

  5. 5

    Step 5: Compare your system's answers with the Final answer column on the dev set, and check the leaderboard for results.

GAIA FAQ

How many questions does GAIA have?

More than 450 questions, divided into 3 levels of difficulty.

Can I reshare the dataset?

No, not in a crawlable form. To avoid contamination you agree not to reshare it outside a gated or private repository on the Hugging Face Hub.

Are the test answers public?

No. Each level has a public dev set, while the test set keeps its answers and metadata private.

What format are the splits in?

Parquet files that mirror the former JSONL structure, with columns such as task_id, Question, Level, Final answer, file_name and file_path.

Details

Pricing
FreeGated on Hugging Face: you must accept the access conditions, which ask you not to reshare the dataset outside a gated or private repository.
Type
Dataset
Categories
AIDataResearch
Added
Sep 17, 2026
GBPublisherGAIA Benchmark

Built from public sources

We put this page together from GAIA’s own website and docs so you can compare it with other tools. Ploba isn’t affiliated with GAIA.

Work at GAIA? Claim the listing to manage it yourself.

Something wrong here?

Related tools

See more
HH-RLHF iconHH-RLHFAnthropic · FreeHH-RLHF is Anthropic's dataset of human preference comparisons on helpfulness and harmlessness, plus red teaming transcripts. It is meant for research on making models less harmful.AI · FreeWearableQA iconWearableQAMeta · FreeWearableQA is Meta's benchmark of 4,084 ten-option multiple-choice questions about health reasoning over real wearable data. It is meant for researchers testing how well language models reason over sensor time series, blood biomarkers and demographics.AI · FreeX1Xperience 10MRopedia AI · FreeXperience-10M is Ropedia AI's egocentric multimodal dataset of 10 million experiences and 10,000 hours of first-person recordings. It is for work on embodied AI, robotics and world models.AI · Free