Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
AI glossary
Machine Learning

Gradient Descent

An optimization algorithm used to iteratively adjust model parameters to minimize the error of its predictions.

What is Gradient Descent?

Gradient descent is a mathematical optimization method used during training that repeatedly adjusts a machine learning model's parameters in a specific direction intended to reduce the model's overall error (or "loss").

How does it work?

A helpful analogy is a person blindfolded near the top of a hilly landscape, trying to find the lowest valley. The person feels the slope of the ground under their feet (the gradient) and takes a step downward in the steepest direction. By repeating this process, step by step, they eventually reach the bottom.

What is a common misconception?

Do not suggest that all AI training uses exactly the same basic gradient descent algorithm. Modern training utilizes advanced variations, such as Adam or Stochastic Gradient Descent (SGD), which introduce momentum and adaptability to prevent the model from getting stuck in a shallow dip that isn't the true bottom of the valley.

Why does it matter?

Gradient descent is the fundamental engine of machine learning. Without an optimization algorithm to systematically reduce errors, a neural network would just be a random collection of numbers completely incapable of learning from data.

Category
Machine Learning
Last reviewed
Sep 24, 2026

Sources

  • IBM: Gradient Descent

Related terms

  • Machine LearningBackpropagationThe mathematical algorithm used to calculate how much each individual parameter contributed to an error.
  • Machine LearningLearning RateA hyperparameter that determines the size of the mathematical adjustments a model makes during training.
  • Machine LearningModel TrainingThe computationally intensive phase where a machine learning algorithm processes data to learn patterns and adjust its parameters.