Alerts will inform when a DHCP server is enabled at any stage but also if you have one that isn't used often and has been sitting idle for some time I have found that when it does provide a lease the Meraki dashboard will send an alert. 
 
I've never seen the behaviour you are seeing just by rebooting a switch. 
					
				
			
			
				
	If you found this post helpful, please give it Kudos. If my answer solves your problem, please click Accept as Solution so others can benefit from it.