Not wrong, but I feel like you're preaching to the Choir here.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
it helps to clarify one's mind from time to time :)
I just post my unhinged performance art
People on lemmy don't seem to enjoy it for some reason
Uhh...ಠ_ಠ
Apparently not everyone wants to see a man nail his dick to a piece of wood, or shoot fireballs from it
I'm going to need to see this for research purposes.
I've posted some shit here
That links to my redgifs, where it's all available
Every time I visit someone's house or coffee shop or whatever, I create a new reddit account and see how long it takes to get banned from as many subs as possible
That's genius. Guess I just found my new mid-tier hobby. Thanks.
You can download archives of Reddit comment and submissions from Academic Torrents.
I'm not aware of any similar public archives of Fediverse content.
Interesting, if I'm not misreading that index you have 2007 to 2015, then jan 2024 onwards monthly (at 30-50gb a file) but not the 9 years in the middle
hmm i'm not entirely sure either but it seems like fediverse content should be easily archivable.
probably this is another engineering challenge to think about once that i have checks notes a few months of free time ...
"your valuable data."
Hilarious.
Unfortunately most of the internet is login-gated at this point. And honestly a lot of it is justifiable, lest you let the bots run wild scraping your site until it goes down completely.
a lot of lemmy servers use anubis to hinder bots. it's quite effective actually. makes the bots do some hard cryptographic riddles before accessing data. insignificant for human users who only read 100 posts but significant for bots who want to read millions of posts.
What.
All you have to do is host your own lemmy instance and federation will give you all the data. Free of charge
yes i know. sadly a lot of big scrappers don't do that, instead they scrap the web interface. which is significantly inefficient so it slows down the service for everyone else.
Yeah, I'm sure this post won't ever get scanned.
?
Off topic, but that blue/black graphic looks recessed about 1/4" into my phone screen.
Way cool!
Way ahead of you, brother.
I'm not contributing anywhere and that includes open source projects


