Some relevant (and positive) news today from Mozilla. PG Forum Post | Nightly Blog
Nightly can be configured by advanced testers to use custom prompts and any compatible chatbot, such as llamafile, which runs on-device open models, including open-source ones. We are excited for the community to share interesting prompts, chatbots, and models as we make this a better user experience. We are also looking at how we can provide an easy-to-set-up option for a private, fully local chatbot as an alternative to using third-party providers.
I’ve currently got Firefox Nightly setup to use Open-webui+Ollama behind the scenes, its really easy to setup.
Apart from opting-in to the experiment, and using Firefox Nightly, there are few about:config settings that need to be changed:
Note: the last one is particular to my setup depending on your setup you might use a different port or something other than localhost.