Run AI on your phone with no internet
You can run an AI model on a smartphone. The model file is in the storage of the phone, and the phone does the work. The model can answer in airplane mode, because it does not need a server.
What does your phone need?
Your phone needs enough free memory for the model and a recent processor. A phone with more memory can run a bigger model. Long work can make the phone warm, and the phone can then slow down to protect itself.
What works well on a phone?
- Short questions and answers.
- Rewriting and editing text.
- Summaries of a document.
- Sorting notes and messages.
Long tasks with many steps are harder. The benchmarks guide shows where big cloud models lead.
Can AI run on iPhone and Android?
Yes. PocketPal runs small open models on iPhone and Android today. Apps of this type run models that other people made. You choose a model, download it one time, and then use it with no internet.
How can you check that an app is really local?
- Turn on airplane mode and send a request. A local model still answers.
- Read the privacy section of the app store listing.
- Check if the app needs an account. A local model needs no provider account.
The guide to private AI gives more checks.
When can you use our models on your phone?
Our early models come to macOS computers. Then they come to computers with Windows or Linux, smartphones with iOS or Android, and tablets with iPadOS or Android.
We will tell you when our models are ready.