I just found GitHub - a-ghorbani/pocketpal-ai: An app that brings language models directly to your phone. It is available on Android and iOS and allows you to run small LLMs from Meta, Google, Alibaba, etc. On my Pixel 9, it worked really well. I am looking to see how it runs on other devices !

I just tried it. An awesome app.

I am more interested in the specs like RAM and processor

I tried running it on both the Pixel 8 Pro and the iPhone 16 Pro. Although the iPhone has 8GB of memory, the largest model I was able to load was around 4.5GB. All models larger than that would not load at all. In contrast, the Pixel has more memory than my iPhone, which allowed me to run larger mo…

İPhone 15 a16. The biggest Qwen model (Qwen2.5 3B(Quantisation5)) is sometimes a bit slower to load. But apart from that the app is working fine.

[image] Add AI Chat tools I tried running it on both the Pixel 8 Pro and the iPhone 16 Pro. Although the iPhone has 8GB of memory, the largest model I was able to load was around 4.5GB. All models larger than that would not load at all. Interesting. How was the speed with 3B models? [image…

Yes. It approximately takes 10 seconds to load and generation speed is 8-10 tokens per second.

I am really enjoying it thank you ! Though it’s still up to see if I have a real use case for it. [image] anon80779245: I am looking to see how it runs on other devices ! I am using a Pixel 7 (8GB RAM) and it’s usable.

Privacy Guides Community

PocketPal (Mobile App that Runs AI Locally)

Site Development Tool Suggestions

Clar December 7, 2024, 3:55pm 8

I prefer to use the Duck chat now, but the app still seems very cool.

Perhaps when mobile hardware improves or larger models become more efficient, this will become a thing.

Topic		Replies	Views
Update on AI chat tools Site Development invalid	4	998	September 7, 2025
Local LLM on Android? Questions	6	1055	February 27, 2026
Help : local AI Questions software	10	823	August 2, 2024
Thoughts on fullmoon Questions software	3	370	February 13, 2025
I want to build an AI/LLM app that preserves privacy. Please roast my idea :) General	25	1195	April 14, 2026

Privacy Guides

Massive organizations are monitoring your online activities. Privacy Guides is your central privacy and security resource to protect yourself online.

Privacy Guides is a non-profit, socially motivated website that provides information for protecting your data security and privacy.

We do not make money from recommending certain products, and we do not use affiliate links.

Knowledge Base

Private Web Browsers

Top VPN Providers

Privacy-Respecting Services

Software Recommendations

More Resources

PocketPal (Mobile App that Runs AI Locally)

Related topics