Meraki recommends using the hostname precisely for the reason you mentioned. In the event of a WAN failover, the hostname should update to the new WAN IP.
In regards to getting it working, using a hostname vs an IP address shouldn't make a difference as long as the hostname resolves correctly.
Are you using the Meraki dynamic hostname or do you have another hostname defined?
Does the hostname resolve to the correct IP on the client PC?