It would be nice if it would actually power off, however I do not think that is something that is possible.
Closest I know to getting to actually 'OFF' is to either set the radio to OFF under the power settings manually (or doing it through the RF Profile method which always seems difficult for some reason), and then contacting Meraki support to have them give you the toggle option under General settings, to disable MESHING.
You shouldn't 'see' any wireless frames then going across the air, however I believe you'll still see the AutoRF changing channels. You can ignore the TX power setting the 2.4GHz radio 'grabs' because its never the same for me. One AP might show 29dBm, another might show 6dBm, both set to OFF. I just ignore it and move on.