I agree with recommending using NTS but I don’t think we can offer much value in terms of offering a specific configuration. I use and recommend the GrapheneOS chrony.conf
The main issue seems to be certificates errors. Attacker can make victim start to ignore warnings if it will happen all the time. Plus this can DOS some security systems that use TLS.