You have to delete them manually under the port config or perhaps with an API endpoint https://developer.cisco.com/meraki/api-latest/#!update-device-switch-port
Ryan / Meraki SE
If you found this post helpful, please give it Kudos. If my answer solved your problem click Accept as Solution so others can benefit from it.