What does “end to end encryption” mean to you in the context of a large language model?
I’m not sure it is a concept that makes a lot of sense in the context of an LLM or search engine (with currently available tech).
which currently only supports [list of providers]
Local models are supported as well.
- Can Ollama or Llamafile be integrated into Firefox Chat AI somehow?
Yes, if you already have a local LLM setup, its quite straightforward, Firefox built in the ability to use local models from the start. But you need to flip a few preferences in about:config
Change:
browser.ml.chat.hideLocalhost to false
browser.ml.chat.provider to whichever address and port number your local LLM listens on (e.g. localhost:8080)
I like ollama personally but llamafile is really easy in terms of getting started (its essentially 1-click/zero config)
Other Qs and As
- Which offers the best performance for local AI inference?
Should be fairly similar regardless of the software you use. Hardware (specifically memory bandwidth and capacity) is by far the most important factor.
- Are there any secure and private alternatives that work within Firefox Chat AI?
Every locally hosted LLM should be secure and private assuming you trust the software running it (e.g. ollama).
How much control does Firefox Chat AI actually give users over their data?
Assuming you self-host the LLM, you should have total control. If you don’t, you trust whoever operates the model. If you don’t self-host it is essentially the same amount of trust that you put in your search engine, just like your search provider can (and must) process all of your search queries, an LLM also must process all of your queries.
- Are there any secure and private alternatives that work within Firefox Chat AI?
You can point Firefox’s AI sidebar at essentially anything (local or remote), using the second about:config preference I mentioned above. But some things will work better than others. I use Duck.AI in the sidebar, but its important to note that neither Firefox nor Duckduckgo intends this, so some things work better than others.