What you write about washing machines and other devices is a "feature" for the manufacturers - they get to sell spare parts or new devices. If the machine routed around something that's not very important, many users would just keep using it without that feature. It's a facet of planned obsolescence.

Also, it reminded me of the news several years ago of Candy washing machines exploding due to weak welds in the drum. I searched it to confirm that I remembered the brand right, and found out that Hotpoint, Indesit and Samsung washing machines have also exploded. While it makes perfect sense from a physics standpoint to consider a heavy, fast-spinning mass to be a potential bomb if it disintegrates, it's probably something that very few "ordinary people" would consider about a washing machine, pointing to the importance of knowing the systems we're dealing with when designing them. Something that, as far as I know, is impossible with AI. Don't get me wrong - what you suggest is very important, and AFAIK we can't really do much more - but it's not a guarantee. The important difference between a washing machine and an AI is that one exploding washing machine could kill a couple of people at most, while one rogue AI could kill most of humanity. (And the disclaimer again: No, I don't advocate AI regulation. That would at best delay the risks somewhat, at worst cause them to materialize sooner.)

Reply to this note

Please Login to reply.

Discussion

True, but I think it’s another general consequence of high time preference. They wouldn’t get away with it if the market had proper incentives and everything wasn’t purchased with debt. I know this is iffy when it comes to failure modes, but the example with car enshrines and things would’ve been less obvious to people and wouldn’t have hit home. I know a lot of people who hate modern washing machines 🤣