I think that’s entirely reasonable, but I don’t think you’d try to solve that by wearing nondescript clothing. You’d appeal to society/the law to take action against that person following you around. Wearing nondescript clothing might make their job harder, but you’d have no way of knowing the extent to which you stopped them, and you wouldn’t stop the practice in general.
The same broadly applies here. Acting otherwise leads to chasing design patterns that lack a mechanism to falsify their effectiveness on the “output side” (i.e. whether or not they really prevent a profile from being built), and then pushing these patterns via individual behavior changes. Public policy change is a precondition to making these measures falsifiable, by at a minimum giving us visibility into what’s happening on the “output side”.
That is to say that the solution lies in public policy and building a coalition for collective change. The answer is to have the person who’s “following you around town” arrested, and if that’s not politically possible then at least requiring them to disclose information they have about you so you can determine whether or not “changing your clothes” is effective. One legislative starting point that would be highly useful would be requiring any company that profiles users to make user profiles available to the user upon request. This would at least allow us to have a concrete mechanism by which to falsify anti-fingerprinting claims and test them against each other concretely.
As far as I’m aware (but please correct me if I’m wrong on this), this is already required by California CCPA, so that could be an area where a long-term study could be designed for users in that jurisdiction, with some kind of instrumented accounts where the study author controls both the fingerprint surface and the identity.
One could of course argue that these anti-fingerprinting measures are worth doing even if their effectiveness on the “output” side isn’t falsifiable. This is all well and good if nothing is being sacrificed in the process, but too often it involves sacrificing security improvements (which are directly measurable and concretely falsifiable) for fingerprinting improvements that are abstract in their current unfalsifiability on the “output” side.