Yes, you don't need the VAs any more. The connector can replace them.
Personally, I still keep the VAs on all branches that still have VMware servers. The VAs don't need a lot of resources and "just work". This is something I only offload to my firewall if there is no different way to do it.
If you found this post helpful, please give it Kudos. If my answer solves your problem, please click Accept as Solution so others can benefit from it.