by InclusionAI
FinFIRST is an open benchmark of 123 financial research tasks that tests whether search agents give answers backed by authoritative, timely and verifiable evidence. It was developed by Ant Group with support from CICC's investment banking team.
DatasetFree
Step 1: Open the dataset page on Hugging Face and read the card.
Step 2: Download the dataset and read the query, answer and rubric fields for each task.
Step 3: Run your agent on each query with tools such as web search, page visits and Python.
Step 4: Grade the output against the atomic rubric criteria using a judge model or human reviewers.
Step 5: Report atomic, loose pass, strict pass and unsupported-correct rates.
FinFIRST V1 has 123 tasks, of which 74 are in Chinese and 49 in English.
The card states the Apache License 2.0.
It scores the whole research process with atomic rubrics, including source verification, instead of only matching the final answer.
It was developed by Ant Group with professional support from the investment banking team at China International Capital Corporation Limited.
Arkham IntelArkham Intel is a blockchain intelligence platform that maps crypto activity to the entities behind it, such as exchanges, trading firms and individuals. It offers entity pages, a network visualizer, alerts and an API.
FlipsideAIAI-powered blockchain intelligence with guided analysis workflows.
Nansen AINansen AI is a conversational agent for onchain research and trading, built on Nansen's database of labeled wallet addresses. You can ask about tokens and wallets, then trade from the same place.