The question is then, why shouldn't we only buy products and services from NGOs or the government? Seems like a sweet deal!

Because their products and services will tend to be worse, and decline over time, as they are not motivated by profits.