this post was submitted on 12 Jul 2026
487 points (99.6% liked)
Fuck AI
7560 readers
1342 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
A quantized 30b model will run on a 3080. I know because I’ve done it. But yeah, it needs to be quantized really small.
Edit: wait, no, you’re right, I’m thinking of a 3090. I’ve done it on a 3090, not a 3080. Quantized to 4 bits. And yes, it’s very slow. That’s enough to replace a human, right?