Sorry, forgot to mention that. Yes, the devices are in Device Owner mode and running Android 12 with the latest patches.
In the past, going the UI route to factory reset would have prevented the user from doing so, but it doesn't seem to prevent that now.