Following up here. I was never able to speed up Manager in Arch, I have the same problem with a few other applications (Spotify is one), and I am not able to troubleshoot effectively.
However, I have been using an Ubuntu virtual machine and it is working fine at the moment.