I strongly recommend against looking for the very cheapest, bottom-dollar hosting because the quality of your hosting is so dependent on what you pay for it.
Very often, the money you put in directly affects the product at the other end. This is why ratings are so low for even the biggest-name corporations that offer products for pennies, like Bluehost, HostGator, and GoDaddy.
Their servers are over-stuffed with cheaply hosted sites and customer support is going to be a pain to get through to. The massive size of such companies leads to the tendency to deal with customer issues on the long finger.
Instead, I would recommend finding the most cost-effective hosting service. Look for hosting companies that do not ask you to pay extra for necessary services like security, or migration. Hosts that offer free bonuses, like SSL Certificates or email, will save you more in the long run than buying cheap hosting and paying for every single extra thing you will need.
I would also suggest choosing independently-owned hosting companies. These companies will be able to respond and serve you better and more considerately than the mega-corporations. They cannot afford the damaged reputation like bigger companies can and so you can expect more dedicated service and support.