Is the ISP modem connected directly to the MX? Is your IP dedicated?
Otherwise open a support case.
I am not a Cisco Meraki employee. My suggestions are based on documentation of Meraki best practices and day-to-day experience.
Please, if this post was useful, leave your kudos and mark it as solved.