Meraki

bholmes12 · ‎Feb 22 2018

@Mr_IT_Guy- Upgraded my MS350 stacks to 10.14 a few weeks back and so far they have been solid. The original issue was nmap scan's would cause some switches in a MS350 stack to become unreachable, they would also no longer forward traffic. The only way to bring the switch back online was to reboot it. Here is the reported fix from the Meraki engineering team. "The fix was to implement a rate-limiter in hardware to avoid the CPU from being hampered by the scans."

bholmes12 · ‎Sep 27 2017

Unfortunately 9.27 has not resolved the stacking issue I am having. OSPF goes up then down and switches in the stack without their own uplink can fall out of stack. I have a maintenance window scheduled for this weekend and will engage support so hopefully they can see this issue happen in real time.

bholmes12 · ‎Sep 15 2017

What version of firmware are you on? I'm taking my entire environment to 9.27 this weekend.

bholmes12 · ‎Sep 6 2017

I have been on 9.26 for a few weeks now, I have had one issue. The building had a power outage taking my 3 MS350 stacks down. 2 of the stacks came up without issue, 1 of the stacks had 2 switches that didn't join the stack. That stack had to be rebooted manually and then all switches came up in the stack. I will be upgrading to 9.27 in the near future.

bholmes12 · ‎Aug 17 2017

Upgrade is completed, ended up going to beta 9.26 instead of candidate release 9.19. The tech I talked to tonight said that if you are below 9.2 and going to 9.19 then have had stacked switches hang, but that issue was fixed in 9.25, 9.26 has since been released to he advised to go to that to avoid any of the issues of the switches locking up. When I started the upgrade all switches started flashing white on the front while they were downloading the image. After about 35 minutes of that they rebooted, the reboot was quick I would say the stacks were back up and passing traffic in about 3 minutes. I hadn't seen this before, but I was able to watch the upgrade process until reboot on the http status page. I got a little nervous when for about 20-25 minutes all of the switches were hung at 66%. But eventually they jumped to 100% and rebooted. I guess the real test will be over the next few days.

bholmes12 · ‎Aug 17 2017

I believe it's all switches on 8.10. But it sounded like it only effects switches in the stack that don't have there own uplink. So in my case, I have 3 stacks of 6 switches, each stack has 2 switches with uplinks. The other 4 switches in the stacks don't have there own uplink, it only seems to affect the switches without uplinks. They also mentioned that in general there are a lot of stacking bugs on 8.10. One of the bugs is actually upgrading the switches! So instead of just scheduling the upgrade they have a very specific process they want me to follow for this upgrade. 1. Power down all but the primary uplink switch 2. Run the upgrade on the one powered on switch 3. boot up the remaining switches, I'm not sure if they meant all at once or one at a time. But they mentioned they have had lots of issues when upgrading off 8.10 with stacked switches.

bholmes12 · ‎Aug 17 2017

@Dave@NFL0NR @BHC_RESORTS Ok so today again I had the some of the switches fall out of the stacks, but I think we have been able to track down the issue. Our security team was running ping sweeps across our network. When the sweep got to the MS stack closets for some reason it took down the OSPF neighbor relationship from the MS 350's to the 9k's. When the OSPF neighbors went down and then came up the MS switches hit a bug. Based on what Meraki support is saying there is a bug when the uplink goes down other switches in the stack fall over the stack. Tonight I am upgrading to 9.19 and Meraki support believes the stacking bugs are fixed in this release.

bholmes12 · ‎Aug 16 2017

@BHC_RESORTSYeah talking about physical stacking. Nothing in the logs, just all of a sudden certain switches were no longer seen as in the stacks. We probably have 30+ stacks hanging off the 9k's the MS350's were the only ones that had any issues. It did get me wondering if Meraki pushes out patches to switches outside of just standard firmware upgrades??????

bholmes12 · ‎Aug 16 2017

I have 3 MS350 stacks, 6 switches in each stack, running on 8.10 software. All stacks have been up and running without issue for the past month or so. No changes have been made on the Meraki switches or the Cisco Nexus 9k's that are upstream. This morning within an hour all 3 stacks had switches that removed themselves from the stack and stopped forwarding traffic. Stack 1 - 1 switch disappeared from the stack and stopped forwarding traffic - Did not come online until after a reboot. Uplink port was not on this switch. Stack 2 - 1 switch disappeared from the stack and stopped forwarding traffic - Did not come online until after a reboot. Uplink port was not on this switch. Stack 3 - 5 of the switches disappeared from the stack - 1 of the uplinks was on one of the switches that disappeared from the stack. After rebooting the switch with the uplink the 5 switches rejoined the stack. 1 switch in this stack stayed online, that switch has an uplink to the core. It seems really strange that 3 stacks had the same issue within an hour, Meraki support suggested we hit a bug (8.10) and have requested I upgrade to 9.19. Has anyone else been having stacking issues? I typically put in Cisco 4500's or 3850's and these are my first 3 MS350 stack closets. This obviously isn't giving me a very warm and fuzzy feeling to have a failure like this after a month or so. Curious what other users experiences have been when using MS350 stacks ???

Meraki

Community

About bholmes12

bholmes12

Community Record

Badges

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues

Re: MS350 Stacking Issues