I’m experiencing slow upload speeds on my VLAN ID with Annex M enabled.

This can be caused by the modem itself. If the modem has multiple VPI/VCI circuits enabled, you will need to disable all and leave the active circuit. If the port is configured for 2Mb up but have 5 VPI/VCI’s enabled, it will divide the max upstream rate by 5.