Alerts will inform when a DHCP server is enabled at any stage but also if you have one that isn't used often and has been sitting idle for some time I have found that when it does provide a lease the Meraki dashboard will send an alert.
I've never seen the behaviour you are seeing just by rebooting a switch.
If you found this post helpful, please give it Kudos. If my answer solves your problem, please click Accept as Solution so others can benefit from it.