Just as follow up to anyone checking in the future: I made a separate Meraki administrator account I called "MerakiExpired" and set that as the org/network administrator for clients that we no longer manage and removed my MSP Administrator account from their orgs/networks so they're not in my active list. Not ideal, but better.