I would normally look for in below order:
Support (Technical support is very important), Value for Price (you will get what you pay for), Uptime, Reliability!
Can also draw your attention to affordable greenwebpage.com
SSD VPS hosting solutions. Fantastic technical support, questions usually answered within 5 minutes of posting.