I had the same issue and the following worked for me.  In the app listing, I clicked on "Revoke unknown device licenses" and "Refresh details" and then I refreshed the page and my license count went down and removed the devices that I had deleted.  I'm not sure which one of those actually did the trick, but it worked! ... View more