On MacOS should I be installing applications into the user directory?

I noticed homebrew installed applications generally are placed into the System application folder. Are there a security benefits to limiting applications to the user application directory if manually downloaded? For example, my browsers are all in the System app directory, but would there be a potential benefit in moving them to the user?

AFAIK the only difference is that the user directory limits the use of the app to the current user, if you have other accounts on the machine they won’t see/can’t use it.

Any way to download apps into the user dir by default?