physical danger can be mitigated. have a gun, smaller amounts, public places or even hire a bodyguard if you have to.
bigger problem is that you never know who the buyer is. it may be a cop, you are probably taped (surveillance is omnipresent) and you can't spend big amount of cash anyways.
black markets (and maybe proxy merchants) is the only way we win this war.