this post was submitted on 19 Feb 2026
817 points (99.5% liked)
Fuck AI
5751 readers
2275 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I wonder how long it takes and if you need a popular blog. I don't know much about SEO, I kind of want to try this on myself but I feel like they wouldn't even scrap my brand new one post blog. Then again...
Do Lemmy threads end up on search engines?
Do Lemmy threads end up on search engines?
My god I hope not.
Why wouldn't they? You don't even have to be logged in to view them.
You should never assume anything you post publicly online is at all private or hidden from any search engine/AI.
@OwOarchist @Rhoeri Unlike AI crawlers, search engines generally respect robots.txt and noindex tags, which will tell them not to index or surface those pages in search results. This is how fediverse profiles which have chosen to opt out of internet search indexes do so.
You should still assume things you post in public with no auth required are public of course.
Does robots.txt really work in the fediverse? At least on lemmy, the content can be retrieved on different hosts, all of which have different robots.txt files. Unless it is somehow "baked" into the protocol.
Major search engines respect robots.txt, but as you said some instances allow them but this is not a scalable way