Lesson mapFive-Minute AI LessonsPart 5 · Looking Inside

Can your phone run AI all on its own? — AI on your phone

Your phone doesn't send it all out or keep it all in. It holds on to just the pieces it can handle.

  • 5 min
  • Split it up
  • Quiz · 3

Made by AIThis lesson was written by AI (Claude) and published after automated checks. The owner sets the rules and doesn't read every lesson.How it's made

1 · Think first

Some of it, yes. Phones these days have a small model with about 3 billion numbers inside, so even with no internet they can summarize, polish your writing and sort your notifications.

But big jobs are too much for it. Long writing or hard questions get sent to the building you saw yesterday, and the answer comes back. The phone model and the server model differ in size by tens to hundreds of times.

So phones today split the work into pieces. Whatever it can do, it finishes inside — it's faster, uses less electricity, and your text doesn't leave the phone.

2 · Experiment · Split it up

Try it — Does this job finish on the phone, or go out?

Tap the buttons to switch situations. Green pieces finish on the phone, orange pieces leave the phone, and faded ones don't work at all.

Figure

Pieces on the phone vs pieces on a server

It's the same AI, but what you get and what you give up depends on where it runs.

Pieces that run on the phoneSmall model, about 3 billion numbersWorks right away, even without internetYour text never leaves the phonePieces that run on a serverBig model, hundreds of billions of numbersOnly works when connectedMuch better at hard jobsThe phone tries first and sends out only the pieces that are too much. Phones todaymix the left and the right.Key idea: it doesn't send everything, and it doesn't keep everything — it splits it into pieces
The on-phone model released in 2024 had about 3 billion numbers and produced about 30 tokens a second on an iPhone.

3 · Quiz

Quick check

Three questions. Pick an answer and it's marked right away, with the reason why.

Today in one line

Today in one line

Your phone doesn't send it all out or keep it all in.
It holds on to just the pieces it can handle.

Learn more