What game are you planning on running? I don't really know many VPS hosts (especially not Windows) that allow you to run gameservers. You might be better off getting a small, cheap dedicated server. Of course that's going to raise your budget, but that might be your only option.
The original idea was to purchase a windows VPS to install and run games as well as a forum but I scrapped that idea as it's much cheaper to just go for a linux based VPS and a separate game server, thanks for the help though dudes
1) Linode- Great unmanaged hosting that has a very good track record, daily backups http://www.linode.com
2) Digital Ocean - Another great solution, cheap too http://www.digitalocean.com
3) Vultr- Another good service but use your own backups http://www.vultr.com
Not sure how vultr is expensive, unless you expect to pay a dime for premium service.