TLDR: Apple starts to train AI on user data. You should disable device analytics in your devices.
Thats a bit misleading.
The contents of the sampled emails never leave the device and are never shared with Apple. A participating device will send only a signal indicating which of the variants is closest to the sampled data on the device, and Apple learns which selected synthetic emails are most often selected across all devices, not which embedding was selected by any individual device.
So your actual data is never sent to Apple. On top of that they’re using differential privacy, which is essentially injecting random noise into the dataset with the ultimate result that you mathematically can’t tie data back to any individual user.