by Axiomic Labs
SFTset SLM is Axiomic Labs' supervised fine-tuning dataset of about 3.09 million English conversations, built for small language models.
DatasetFree
Step 1: Open the dataset page on Hugging Face and read the source breakdown.
Step 2: Load it with the Hugging Face datasets library.
Step 3: Use the source field to keep or drop particular origins.
Step 4: Pick the chatml or messages field to match your trainer.
Step 5: Use token_count to budget sequence length and training size.
Apache 2.0, as stated on the dataset card.
3,091,614 conversations and about 1.67 billion tokens across 13 sources.
A chatml string, a messages list of role and content pairs, a token_count and a source name.
Axiomic Labs, an independent Australian AI research lab focused on small models.
HH-RLHFHH-RLHF is Anthropic's dataset of human preference comparisons on helpfulness and harmlessness, plus red teaming transcripts. It is meant for research on making models less harmful.AnswerCarefullyAnswerCarefully is LLM-jp's Japanese instruction dataset for the safety and appropriateness of LLM output. It pairs hand-written questions with reference safe answers.