Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
AI glossary
Machine Learning

Batch Size

The number of training examples the model processes before updating its internal parameters.

What is Batch Size?

Batch size is a hyperparameter that dictates the number of individual training examples a machine learning model processes in one chunk before pausing to update its internal mathematical weights.

How does it work?

Instead of looking at the entire dataset at once (which requires too much memory) or updating after every single example (which is chaotic), data is broken into batches. If a dataset has 1,000 images and the batch size is 100, the model processes 100 images, calculates its average error, updates its parameters, and then moves to the next batch of 100.

What are the trade-offs?

Engineers must balance several factors when choosing a batch size:

  • Memory use: Larger batches require significantly more GPU memory.
  • Training speed: Larger batches process faster because they take advantage of parallel computing.
  • Update stability: Larger batches provide a smoother, more accurate estimate of the error direction.
  • Generalization: Surprisingly, smaller batches introduce a bit of helpful "noise" that can prevent the model from getting stuck and actually improve its ability to generalize to new data.

Why does it matter?

Batch size directly impacts both the hardware cost of training and the ultimate quality of the resulting AI model. Getting it right ensures efficient use of expensive GPUs.

Category
Machine Learning
Last reviewed
Sep 24, 2026

Sources

  • Google Machine Learning: Batch Size

Related terms

  • Machine LearningEpochOne complete pass through the entire available training dataset by the machine learning algorithm.
  • Machine LearningHyperparameterA configuration setting chosen by the developer to govern the training process of a machine learning model.
  • Machine LearningLearning RateA hyperparameter that determines the size of the mathematical adjustments a model makes during training.