this post was submitted on 02 Nov 2026
716 points (99.3% liked)
Technology
89443 readers
4335 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
No, they just enabled Chinese LLMs to be the forefront of reverse engineering. Because people will do what they want to do.
Their goal is simple... everything they are doing right now is striving to make the US ban individual hardware.
Chinese models are open, anyone can get them... stopping the flow of data on private computers is impossible. Hardware however is getting more expensive, hardware manufacturers are already deciding to move out of the consumer market on their own. The US government is already establishing laws to prevent shipping foreign hardware into the country.
Altman's giving the game away when he does this "it's so sad that all this ram is sitting around in people's home computers unappreciated when it could do so much more in a data center".
The idea is to sell the message "AI is out of the bag, and it's world ending technology. Basically they are going to imply that the guardrails in their data centers are the only thing that's preventing all AIs from destroying the software industry, and teaching teenagers to build bombs and hacking the CIA, and the only possible response would be to stop all direct to consumer hardware sales with anything more than the bare minimum needed to stream a PC out of a data center.
This is all pretty obvious and I agree. They can no longer protect their imaginary property if they allow it to be ran in your computer's memory or stored on your computers hard drive.
The cat is definitely out of the bag, as in their own AI models are making them obselete. The race to make money before the end is what motivates them. They will ride the roller coaster to our societal demise because they only care about money. These people shouldn't be in charge of a small fast food restaurant let alone multi-billion dollar companies.
If private hardware becoming scare would send America back to the stone age, completely choke technological progress.
probably, but don't you know, everything in the cloud is the FuTuRe!! owning things yourself is the way of the past, it's like physical disks you can resell or something.
Sad thing with the exception of price, it's probably not that far off that most average people's usages will be similar. but yeah the idea of paying by the hour or cpu grade etc... for a computer is going to suck... and be far more expensive for gamers, hobbyists etc...
Read that as "democratic and free word ending", and it's on purpose as they saw cyberpunk and wanted to become a mega-corporation that rules the world too.
mostly quoting their own people who are going out on the news and saying "yeah we really believe that there's maybe a 10% chance we destroy the world with this".
Just ran into Qwen's version of guardrails myself, and am quite annoyed. Guess I'm gonna have to look into abliterated models next.
Oh, abliterated models are awesome! Just be aware that they’re a little too agentic at times. Once they start ignoring guardrails, they happily keep ignoring them!
My concern at the moment is I've heard some of them have performance issues due to the abliteration process. What's your experience with that?
Like, TTFT? Or speed of tokens? Or something else? BTW what was the gate you initially hit with Qwen?
Some abliterated models had lower reliability and quality, I heard. Is that still an issue, or has the dev community figured out how to avoid those pitfalls?
Was spitballing about various ideas, and occasionally Qwen would go all Chinese-ethical on me, no using open systems outside of stated design, no avoiding govt blocklists, etc etc.
depends on what their base model is. Most abliterated models start off with an already quantized model, so depending on the type and level of quantization, you've already lost some capability. Plus, I think there are two types of abliteration, so ymmv.
My current go tos, in order are -
I've tried and hated - hf.co/DavidAU/L3.1-Dark-Reasoning-Dark-Planet-Hermes-R1-Uncensored-Horror-Imatrix-MAX-8B-GGUF:latest
If you're set on trying out Qwen, I highlugh recomment orcarouter's models. Very well done and they start off with a good base model - well, actually now that I think about it, Qwen3.8 basically has one base model - the 27b one, right? So that's that.
I like the Gemma-4-E4B for speed for response, and HauhauCS has done a good job of abliterating the model appropriately. However, it's nothing compared to the A4B models, so if your hardware can take it, go for A4B over E4B always.