
by OpenAI
GSM8K is OpenAI's dataset of about 8.5K grade-school math word problems with step-by-step natural-language solutions. It is for researchers testing and training language models on multi-step arithmetic reasoning.
DatasetFree
Step 1: Install the Hugging Face datasets library with pip install datasets.
Step 2: Load the data with load_dataset("openai/gsm8k", "main"), or "socratic" for the sub-question version.
Step 3: Use the train split for fine-tuning or few-shot examples and the test split for evaluation.
Step 4: Extract the final answer after #### in each solution and compare it with your model's answer.
About 8.5K: 7,473 in the training split and 1,319 in the test split.
The GSM8K dataset is licensed under the MIT License.
Both have the same problems and splits. The socratic configuration adds a guiding sub-question before each reasoning step in the answer.
English.
OpenAI DotsDots are always-on agents in ChatGPT that take on ongoing responsibilities and keep making progress between conversations. You choose which apps they use and when they need your approval.
ChatGPT WorkChatGPT Work is an agent in ChatGPT that takes action across your apps and files and turns a goal into finished work such as sheets, slides, docs and web apps. It can stay with a project for hours.
ChatGPT SpaceChatGPT Space is a shared place in ChatGPT for pages, files, spreadsheets and slides that you build with ChatGPT and your teammates. It replaces Library and is available on Pro, Business and Enterprise plans.