Honeypots, tarpits and the like can slow down your target but it’s an arms race for them to build better tools. This new product from Cloudflare will cost them a lot to maintain.
If you really want to let the public use your service or crawl your site let them pay with sats and be excited when they scrape your content.