My users have the same problem that only happens with XenForo (1.0.4) while on other websites is functioning properly at the same time.
When clicked, the vote is briefly displayed and then the button turns red.
Surprisingly the button works fine in XenForo.com.
Sometimes it works, which suggests problems with Google's servers.