It is. AI Bots are not normal crawlers and won't respect a robots.txt.

Googlebot is not "how crawlers work". You can create a bot today, and listen to relays, aka. "crawl" them, store the data, and have fun with it. Try it, you will enjoy.