I took it off the network and booted it back up, opened settings, and I was this time able to turn off the switch, except it gave me a confirm popup, and the confirm was all in big red scary letters. I pressed on the big red scary letters and now...

.. well maybe it is off. Maybe it is pretending.