Sorry to bring this topic back up but... Yesterday I did a demonstration for a group of customers about SD-WAN. I had a setup with a hub and spoke WAN between 4 sites using a mixture of MX'es (250, 84, 68, 67C) All of them had a primary WAN going into a cisco router of mine each with their own little subnet (simulating an MPLS with a single breakout IP) and a second connection going to a switch going to another ISP. Before the demonstration I did some testing using iperf server on a laptop in the HQ site and another laptop in one of the sites I could send continuous heavier traffic to test policies out and found the following: Even if the HQ site had WAN2 defined as primary. When the traffic in the branch site was being routed over WAN1, it also arrived at WAN1 on the HQ site. I tested this with captures at first but then I could just look at the uplink stats page of HQ and see the color if the traffic downstream. We tested the other way around but the results were consistent. So I can only conclude the MX chooses to send from WAN1 to WAN1 or WAN2 to WAN2 based on the public IP or performance metrics instead of uplink preference on the other side. The next test I did was running the test longer and then disconnecting a local uplink. The traffic was switched to the other WAN immediately because of the layer 1 down status of the WAN link. Final test was disconnecting the receiving WAN link on HQ and there we had two results. Using UDP: the traffic stopped being received for between 20 to 25 seconds and resumed on the cross VPN link after that. Using TCP: the connection failed after the link was switched to the cross link (reset by peer), this however could be due to the behavior of iperf. So long story short: If you have an MPLS where you overlay Meraki SD-WAN having a single breakout IP don't worry. Traffic leaving one MX onto the MPLS will be routed to the other site on that same MPLS and not crossed over to the internet unless the MPLS link on the other site is down.
... View more