There is no specific way to do this. You would have to "untick" the alerts during the timeframe (which is pretty easy).
You could also consider using an email distirbution group for the alerts and have the Meraki dashoard send emails to that. Then just remove everyone from the distribution group during the maintenance.