This is exactly the point I was trying to make, although I said "entire investment" when I should have said "down payment amount" because it's only the cash you had to put up that you need to worry about getting back, not the amount printed by the bank when you took out the mortgage.
Thanks for clarifying.