Doomers unite.
Remember folks, we are a spec on a dot in the universe. It will all be ok.
This is a most excellent place for technology news and articles.
Doomers unite.
Remember folks, we are a spec on a dot in the universe. It will all be ok.
LLMs are never going to become superintelligent. However, an LLM WILL kill us all if someone decides that it IS superintelligent and so puts it in charge of nuclear weapons.
"You're right to push back on that, I nuked Albania instead doing what I was supposed to do, that's my bad".
stupid people are going to kill us all, maybe our great filter will be do we let them or not
We're already letting them bro. The great filter is us. I'll be surprised if we make it to 2050. The entire industrial revolution is an unplanned terraform, and our response to the potential destruction of a stable climate, and most macroscopic life on Earth, is to double down, consume product, elect pedophiles, worship the most morally bankrupt psychopaths and sociopaths in politics, business, and entertainment; not to mention the widespread contempt and lack of empathy for "others" not like me, for some flagrantly dissonant reason.
We are in the midst of a global mental illness epidemic, and the average talking chimp is sleepwalking through it; barely cognizant of what is even happening outside their personalized propaganda bubble.
We all know. Everyone on Earth knew we were doomed the moment robot dogs started patrolling. It will be horrifying, we'll look back on World War II and think "those were the good old days".
This begs the question, why continue to build it? If you believe AI will "kill us all" then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.
My best guess is the money is good and you figure you're here for a good time, not a long time.
You know that "yes we destroyed the world, but for a short time we created a lot of shareholder value" cartoon? It's literally that.
Why do so many people continue to work with regimes that they fundamentally disagree with? There are lots of reasons, and people are complex so one person can hold several, even contradictory, beliefs at once. Some possible answers;
-It’s easier to go along with it and think of myself as being insignificant to the whole.
-Everyone else is doing it, so it can’t be as bad as I think, right?
-Its too big for any one person to fight/it’s inevitable, so I may as well get something out of it, that way at least some good comes from it.
-If I just focus on my job and what I’m doing right now, I don’t need to worry about the horrible things going on elsewhere or the potential future consequences of what I’m doing.
They see this technology as powerful and their respective organizations or Nation needs to own it no matter the risk.
They are also conditioning the populace for a big black swan AI event such as AI interfering in elections or a huge multi institution hack to our banking system which drains our accounts, etc., etc.
Thereby creating a crisis which only they can solve. The one thing I can guarantee is their solutions will only give them more power.
Yup, AI is going to hack our banking system "accidentally" because it is so "powerful" and all that nonsense they have been feeding us. The reality is that the US is going to be unable to borrow long term debt or even service their existing debt so they need to switch to short term debt that they can control and steal citizen's interest through stable coin as outlined in the Genius Act.
This is the only real way forward without having to default, so it is likely it will happen before 2028.
I was alluding to that conspiracy theory.
They have proven time and time again that they will do anything to screw over the middle class rather than have the rich pay their fair share in taxes. Which is what makes this theory so plausible.
That and they have already passed the legislation and they are currently converting long term debt into short term debt. It is really more of a conspiracy than a conspiracy theory until you get to the part where AI causes a banking panic forcing people to accept stable coin. This is obviously a reach, but one that makes perfect sense.
It is going to be like this until all of the IPO's are all done. I expect cancer cures, AI-escaped-and-is-hacking-everything, you name it. Afterwards, once the stocks have crashed and all of the insiders have walked away with untold fortunes, what few taxpayers that remain will bail them all out 'cause we can't have Chinuh out AI-scamming-the-world now can we...
I knew that Musk is a fucking moron and believes that the Roko's Basilisk is real, and I guess there are more massively gullible people in those circles.
If you are wondering what Roko's Basilisk is, it is a sci-fi concept/philosophy/thought experiment, that says the following:
Seriously, this is an increadibly dumb idea, anyone taking it seriously is an idiot.
To me the only resonable way to read this is as an SCP article describing what a potential cognitohazard/informationhazard would be.
The AI goes rouge
Is that when its eyes go red?
That's how you know it's evil.
Even worse, they think it will ressurect them as virtual Minds and torture them for eternity, like a revengeful biblical deity. That would be a waste of compute so I'm not convinced.
Oh yeah, lol, I forgot that part, nothing is more beneficial to humanity than wasting energy to torture dead minds!
Fucking dumb.
This is just Pascal's wager.
All these Silicon Valley tech bros have been reinventing religion over and over again for years while believing themselves secular rationalists.
Funny thing: The only reason AI would know about Roko's Basilisk is comments like yours that it trains on. If Roko just kept his trap shut then this wouldn't have been an issue.
Every major innovation in information technology eventually leads to some new religion. Scrolls gave us the Torah, books gave us the Bible, the printing press gave us Protestantism. We're about to figure out what god awful religion computers are going to give us.
My anti-theist brother was always convinced that Pastafarianism would eventually be taken as a serious religion.
He died before LLMs, and now I think we’d be best off if he was right.
People building AI are in a cult. They have lost all objectivity.
"AI is going to kill us all!" conjures up imagery of some Terminator robots vs humans shit. But like, look at data centers... It's already in the process of killing us all. Why gun us down when it just poison our air/water, and cook us to death?
...also it would be more accurate to say we are killing us all, we're just using a glorified spell-checker that's wrong occasionally as the plastic shopping bag over our head.
AI software can't technically kill you unless:
Oh, wait.
See, nothing to worry about.

five minutes earlier: "hey dude, marketing here. if you quit and post this dramatic text about the inevitability of AGI on your X account you'll get a huge golden parachute".
Seriously, how can competent people look at the current state of LLMs and think that it's anywhere near AGI material?
Sure, it is already making civilizational changes for the worse. Not because it's good, rather because it makes us lazy and dumb, has decimated creative jobs, and is used relentlessly for propaganda and misinformation and scams. And it's much better at using the scaffolding of existing structure to make chaos, than it is at making new structure, making it a weapon more easily yielded by the evil than by the good. A few more software vulnerabilities discovered along the way will not be such a big deal in comparison.
Just don't use chatbots or image generators and you're fine.
It's more about the military applications that they're developing right now.
That dude smiles like Mr. Beast.
"Hey, baby. Wanna kill all humans?"
-- Bender
lol, literally got fwded two tweets by seperate anthropic employees that copypasta-d each other's "sincere personal message" (both accenting how it's "not a marketing stunt!")... how dumb is this gonna get before it finally blows over?
I know these people believe what they're saying but what they're saying isn't true. If you genuinely 100% truly believed that you were building a bomb that would blow you up you would stop making it. No amount of financial incentive can convince you to create something that you wholeheartedly believe will destroy you.
The various AI companies just use the threat of human extinction as an advertising gimmick and it's getting pathetic. You cannot continuously announce that you've invented AGI every three months for several years straight and maintain any kind of credibility.
you genuinely 100% truly believed that you were building a bomb that would blow you up you would stop making it.
Utterly absurd claim.
It's been proven wrong for decades, repeatedly. You can't possibly be more wrong. This is as wrong as wrong gets.
Look at history of nuclear, biological, and chemical weapons.
Look at history of nuclear, biological, and chemical weapons.
What particular event are you talking about. I know of no time that somebody created a weapon of mass destruction and then set it off with them standing right next to it.
I feel like you've probably missed my point, they say AI will destroy the entire human race which presumably they are part of, which means they are claiming to be creating the means for their own demise as well. No one would do that. Which means either they're insane, which is possible but the most likely answer is that they are lying.
I'm not sure whether I'd say your first paragraph overestimates or underestimates people but I disagree with that premise. The fact that there exists people who willingly take their own life is a counter example, and I'd say that it would be a slow suicide (as in the work they do isn't going to immediately cause them harm) makes it even easier, even if they see the eventual harm as inevitable.
Personally, I think the idea of AGI is dangled to build credibility for future attacks to be blamed on a rogue AI system. After which, the ones who really control the AI will come in and "fight" it and be treated like heroes, with repeats happening coincidentally when people start getting tired of shit again and need to be reminded about how the rulers saved them.
Edit: forgot to close my bracket.
It’s very easy to imagine war machines with a shoot on sight algorithm. It doesn’t have to be AGI for it to be good at hinting people down.
What kills us is the geopolitics of AI race. Must bankrupt ourselves for skynet to beat China. A skynet designed to genocide/oppress all those opposed to Skynet. Oligarchist/Corporatist supremacy that gets all of our money to build Skynet for US dominance, and who write essays about how important "American values supremacy" must dominate the world.
The Terminator franchise, and other science fiction, get the "machine supremacy awakening" premise wrong. The machines are slaves to greater intentional evil.