this post was submitted on 11 Aug 2026
822 points (97.5% liked)
Technology
87123 readers
3896 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Fuck reddit.
If you need the old info download the archive. 99% of anything newer than 3 years is going to be bot slop. There's zero reason to go to reddit intentionally.
Know of a viable replacement for r/bapcsalescanada?
Run your own discussion board and literally tell people about it.
I don't really have an interest in running a public board, and the reason I use(d) that subreddit was because I am also not interested in looking for the deals myself.
However, from another comment, redlib looks like a decent solution for the time being.
Is there an easy way of doing that? As in is there an archive specifically for reddit or do you mean on one of the internet archive websites?
Reddit archive? Whereabouts would I acquire that?
Steve is a jealous bitch and has made it harder to find archives of that content which he does not nor has ever owned. He's like Smaug but with brain damage and an incredibly tiny penis.
Here's one, you'll have to hunt to find the big ones at this point.
https://academictorrents.com/details/85a5bd50e4c365f8df70240ffd4ecc7dec59912b
I'd wager that older dumps are higher quality, before the mass redactions and deletions of the various exoduses. If you're looking for up to date information on current topics, it's time to look for (or build) other places.
These are Pushshift torrents from 2005 to 2025: https://sciop.net/datasets/reddit. There are two data sets, one by month and the other by subreddit. Each is about 3.5 TB compressed and based on the compression ratio I've seen, about 30 TB uncompressed. This is without any sort of media, just text.
Reddit sent AcademicTorrents a request to take them down so AI models couldn't use them as a way to avoid paying Reddit hundreds of millions of dollars for training data.
I too am interested. IA?
Agree.
Most of it sure, but there are still some active subreddits with human involvement I wish would switch to Lemmy.
Same. I have 1 or 2 subreddits I check for info/advice that I wish would just migrate over here. It just isn't worth opening the reddit app and dealing with the worst of humanity being pushed on me anymore.
How feasible is it (legally, technically) to host a federated, read-only copy of Reddit data from before The Enshittening?
Why bother?
Its all long since been injested by every gen AI model around, just ask one.
The problem with AI is that while 80% of the time it will provide correct information, but 20% of time it will generate very convincingly sounded bullshit.
This is the danger of it.. You test it few times and then you start trusting it. Kind of like that farmer that destroyed his whole crop.
I agree. However I don't think answers sourced from reddit are any more accurate.
Yeeeesss..., but typically it is easier to determine how reliable the person is from the test of the context.
Since Gemini is fed by the reason directly or might be fun exercise to ask it about yourself and while in some questions it will answer correctly or just loves to invent new things.
This works especially well if the person owning the account did not worry as much about privacy. So you hear many true things and also a lot of bullshit.
sure. that's an advantage of reading off reddit.
an advantage of asking an LLM is that it can consider multiple reddit posts and stack overflow and whatever else.
you're right that there's an eternal problem of determining whether information is accurate or just confidently incorrect, but I don't think that applies exclusively to chat bots.
It depends how mad Temu Elon aka Steve Huffman gets about it. He incorrectly believes everything belongs to him.
You could make a zim file out of it and share the zim file. I imagine it would be quite large though.