It was discussed several times on the forum, but I want to write more privacy friendly alternatives in one post. Keep in mind that chatgpt mostly requires a phone number, especially when you register with vpn.
GPT4ALL : This app helps you run AI models locally even without an internet connection.
Freechat: This is an macOS only and simplistic alternative app to Gpt4All.
LM Studio: This is a very user friendly app with a better UI than others above, but not open source. Still models are open source and run locally.
Perplexity.ai and perplexity labs: Perplexity lets you use their platform even WITHOUT an account. (Still can collect data) It also generates answers including citations to the original source.
I don’t know if you tried or not, but GPT4All, Freechat and LM Studio are exactly doing what you expect. The thing is if you have enough CPU, or GPU or not. You can discover many open source models.
Edit: Free version of Brave AI is using Llama2 13b, and I can run it in my macbook locally. For llama 70b, you can use perplexity labs or hugging chat or locally if you have the hardware. You can use ChatGPT with API Key on GPT4All, but that does not make much difference with the website. Leo (Brave AI) also offers paid option with Claude Instant, but it is already free if you use Poe.
If it’s local, and doesn’t collect nor share any data, why the warning? I mean, it’s obviously good advice anyway, and if Brave were really going after our data there’d be little reason to “scare” people away. But it seems out of place, almost feels like a license agreement rather than a “use responsibly” notice.
It also stops working when I disconnect from the network…
It cannot run locally in a browser, because running a model locally requires you to have appropriate hardware. I tried that model in a laptop with 8 gb, and it was too slow. Sometimes it even was frozen when ram usage is high, unlike using it on brave.
I did sound too good to be true, not sure why I was so fixated in believing that it would run 100% offline in my machine… I would love for PG to write some recommendations or articles on how to achieve that though.
Massive organizations are monitoring your online activities. Privacy Guides is your central privacy and security resource to protect yourself online.