It doesn't have to be sentient or alive to create havoc among civilization. Just take a look at the current social media algorithms. People often fail to realize the magnitude of manipulation and psyops driven by these sophisticated algorithms. Once you become aware of how much advantage AI has over your perception due to the data you have provided, it can become incredibly difficult for you to sleep at night.
It wouldn't resemble a Terminator scenario, but rather a sophisticated surveillance systems similar to the ones employed by China today.