The downside is if the block is orphaned, no other miner will include your TX. You have to trust the specific miner you paid.