Pierre Rochard argues that we only need one miner for the bitcoin protocol to work.
Decentralization is only important if this one miner begins to censor transactions. If he or she does, another miner is required for censorship resistance.
He told me this at the pacific bitcoin conference, but I think he also told it to #[2] in this podcast.