this post was submitted on 21 Jul 2026
23 points (100.0% liked)
Fuck AI
7560 readers
1428 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Trying to prevent bits from being copied is always going to be futile.
In the long-ago times, websites that didn't want crawlers to scrape them had a /robots.txt file that described what was and wasn't allowed to be scraped.
But, the AI companies completely ignore that file. In fact, if anything, they may use it to find the "juicier" stuff to scrape. I know plenty of people who have decades of experience in running web servers who are going to extreme lengths (like banning entire countries, or huge IP ranges) to prevent what amounts to a DDOS on their servers from AI-company scrapers, because anything less extreme than that doesn't work. For some of these people, more than 90% of the traffic they get is from AI scrapers. In fact, it seems like if you try to do something to discourage scrapers from AI companies, they think there's something even juicier there and work even harder to get at it.
If they can find it, they'll ingest it. And, these companies have spent literal billions on working around any attempt to prevent them from ingesting things, because they believe that whichever company manages to ingest the most content will come up with the best model.
If you have some kind of moral exception to your work ever ending up in an LLM, then you're really out of luck. You better take up oil painting and never allow pictures of your art to be taken. The slop machines are hungry, and anything that becomes bits and ends up online will eventually be scraped.
As for making money as an artist, that's another matter. It has always been hard, now it's even harder. I don't think you'll make it easier for yourself by trying to prevent your stuff from being scraped. That just adds extra headaches you don't need.
glue traps are a good solution to badly-behaved scrapers. just list a path in your robots.txt that slowly produces random text and links, all of which go to the same sort of page. if they respect robots.txt, they're fine. if they don't, they get stuck ingesting nonsense.
not a catch-all solution but a good tool.