iOS: Settings > Apps > Photos > Enhanced Visual Search

MacOS: Photos > Settings > Enhanced Visual Search

Toggle it off