Avatar
Kieran 5mo ago

Is facebook scraping nostr? I just posted a link in a note and instantly got HTTP requests from "facebookexternalhit" and "WhatsApp/2"

https://admin-demo.lnvps.net/testing-bots

Reply to this note

Please Login to reply.

Discussion

Avatar
Derek Ross 5mo ago

Perhaps someone immediately copied and shared it on WhatsApp?

Avatar
Kieran 5mo ago

Within 1s? I posted another link and its the same thing, within a second there is multiple requests from all kinds of bots, idk if its really facebook or just other bots using the facebook user agent

Avatar
Luxas 5mo ago

You check the IPs ASN? Should be owned by Meta if it is truly legit UA.

Avatar
Laeserin 5mo ago

I don't know, but there are websites that are getting indexed by search machines. That's why typing in "laeserin" on google.com returns me.

Avatar
inpc 5mo ago

They scrape everything, nosey bastards. They’ve been riffling through the bins of the Fediverse for sometime now…

Avatar
Vitor Pamplona 5mo ago

Yes

Avatar
TKay 5mo ago

Test again and see.