We need an evolved robots.txt and regulations to enforce it https://www.andreagrandi.it/posts/we-need-evolved-robotstxt-and-regulations/

#AI #robotstxt #crawler #bots #Perplexity #EU #regulation #opinion