Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
AI glossary
Models

Transformer

Also called Transformer architecture

A neural network architecture that relies on an attention mechanism to process sequential data efficiently.

What is a Transformer?

A transformer is a specific type of neural network architecture introduced in a 2017 research paper. It was designed to handle sequential data (like sentences) and revolutionized the field of artificial intelligence by allowing models to track relationships between words over long distances.

How does it work?

Older language models processed text sequentially, reading one word after another. The transformer introduced the "self-attention mechanism." This allows the model to process all the words in a sequence simultaneously and mathematical weigh how important every word is to every other word, regardless of how far apart they are in the sentence.

What is it commonly confused with?

Transformers are often confused with Large Language Models. The transformer is the architecture (the engine design). An LLM is the resulting product (the car built using that engine). Furthermore, while almost all modern LLMs use transformers, not every AI model is a transformer (image diffusion models use different architectures).

Why does it matter?

Because transformers process data simultaneously rather than sequentially, they are incredibly efficient to train on modern parallel hardware (GPUs). This efficiency allowed researchers to scale up training datasets from gigabytes to petabytes, directly leading to the creation of the massive foundation models we use today.

Category
Models
Last reviewed
Sep 21, 2026
Also called
Transformer architecture

Sources

  • Google Research: Attention Is All You Need

Related terms

  • Machine LearningNeural NetworkA computing architecture inspired by the human brain, composed of interconnected nodes that process data.
  • Machine LearningDeep LearningA specialized branch of machine learning that relies on multi-layered neural networks to process complex data.
  • ModelsLarge Language ModelA deep learning model trained on vast amounts of text to understand, generate, and predict human language.
  • DevelopmentNatural Language ProcessingA branch of AI focused on giving computers the ability to understand text and spoken words.