The question is how can you move fiat to xmr?
Since you propose that xmr remain niche, that implies that most transactions will be with fiat. Once in a while people will move fiat to xmr and use it (for example, for political donations). In order for that to be possible the movement from fiat -> xmr -> fiat must be as smooth as possible.
And it's not.