@timeshimanshu
Tried that, plus I also have Deny all local lan set. I can still reach the 10.128.128.128 (since its the gateway).
I do have a password set so nobody can really do anything, I just prefer that on a specific SSID (like a guest one), that they can't have access to this at all. Gives them information I would prefer they don't have access to, like AP name etc.
At this point I think the only solution is to turn the feature off, and only on if I ever need to access. Oh well >.<