How did graphics cards made for gaming become the heart of AI? — GPUs
AI didn't pick graphics cards. The shape of the math was the same all along.
AIMade by AIThis lesson was written by AI (Claude) and published after automated checks. The owner sets the rules and doesn't read every lesson.How it's made
1 · Think first
A graphics card (GPU) is a part built to do a huge number of easy calculations all at once. To color in the millions of dots on a game screen at the same time, that was the only way.
It became AI's heart because AI training is exactly that kind of math. A card widely used for training packs about 80 billion tiny switches inside.
That one card does about 1,000 trillion calculations a second. Even that isn't enough, so Llama 3 was made by tying 16,000 cards together into one giant cluster and running them for 54 days.
2 · Experiment · Number sense
Try it — Getting a feel for graphics cards by order of magnitude
Use the slider to guess roughly what power of 10 it is, then tap to check the answer. The goal isn't to nail it, it's to feel how many zeros you're dealing with.
Figure
A few smart people vs thousands of simple ones
These two parts are good at completely different kinds of work.
3 · Quiz
Quick check
Three questions. Pick an answer and it's marked right away, with the reason why.
Today in one line
Today in one line
AI didn't pick graphics cards.
The shape of the math was the same all along.
Learn more
- The official technical write-up with the 80 billion switches and 1,000 trillion calculations a second — NVIDIA Hopper Architecture In-Depth (2022)
- A report that puts numbers on what happens when you run 16,000 cards for 54 days — The Llama 3 Herd of Models (2024)
- The company's own announcement on how it gathered 100,000 cards in one place in Memphis — Colossus (xAI, 2024)