Note that QoS settings do nothing unless there is congestion. Once congestion has occurred and there is a queue of packets then QoS can re-order those packets. If there is no queue of packets waiting to be sent there is nothing to act on.
Is your Internet circuit being maxed out at any point in time?