How much does a shared PHP host cost? Is it less than $3.50/mo?

I don't understand why people want to use these instead of a cheap VPS that can execute any code instead, but I'm glad this option exists anyway.