Its depends on the circumstances, if I left them outside here over winter they wouldn't die from the cold but rather from being waterlogged from the wet winter we typically have here.... even in a sandy well drained soil.

The only time I see cacti outside in the U.K is when someone has them in a rain shadow under roof eaves,thatch or greenhouse .