Pocketpal is an mobile app to run LLMs locally!

Privacy
1

I just found GitHub - a-ghorbani/pocketpal-ai: An app that brings language models directly to your phone.
It is available on Android and iOS and allows you to run small LLMs from Meta, Google, Alibaba, etc.

On my Pixel 9, it worked really well. I am looking to see how it runs on other devices !

2 Likes
2

I am really enjoying it thank you !
Though it’s still up to see if I have a real use case for it.

I am using a Pixel 7 (8GB RAM) and it’s usable.

1 Like
3

its pretty handy or just fun to pass time when paired with eg. gemma3 1b or 4b if you have 8GB+ RAM