What type of connection does the branch office have and what sort of router? Are transfer speeds between devices at the branch office fast?
I would start troubleshooting by testing the wifi / LAN speeds then moving onto the router/WAN speeds before looking at the VPN connection.
If you found this post helpful, please give it Kudos. If my answer solves your problem, please click Accept as Solution so others can benefit from it.