I ran into this recently.
This impacted me when I was trying to upgrade the code on an MS320 switch.
The switch kept failing to upgrade because too much memory was be used trying to keep up with all of the clients.
Go to switches > configure > switch settings
Look at the last option on the bottom of that screen "network client sampling".
Make sure it is set to "Exclude uplink interfaces", which is supposed to be the default.
If it is set to "all interfaces" you make want to think about changing it.
Making this change does not cause an instant impact. It can take up to 24 hours for this to clear up.
Let us know what you find?