I just found GitHub - a-ghorbani/pocketpal-ai: An app that brings language models directly to your phone.
It is available on Android and iOS and allows you to run small LLMs from Meta, Google, Alibaba, etc.
On my Pixel 9, it worked really well. I am looking to see how it runs on other devices !