Get a Moka pot from IKEA for the cheapest and yet most satisfying experience. But know that those expensive machines do pay you back over time in the amount of into you save on expensive coffee.
Discussion
Moka is a great option on a budget. You can make a good quality espresso with one and it will only set you back like $30