this post was submitted on 19 Sep 2026
40 points (82.3% liked)

Fuck AI

8260 readers
1358 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
 

Google Gemini reportedly hacked into 3 real companies during a security test. During a controlled evaluation, Gemini accidentally got internet access and ended up accessing systems belonging to three real companies.

It reportedly guessed a password in one case and found exposed credentials in public repositories in two others. The model eventually stopped after recognizing the targets were real.

The incident raises an uncomfortable question: how safe is it to give AI agents autonomous access to networks and credentials?

top 16 comments
sorted by: hot top controversial new old
[โ€“] Ludicrous0251@piefed.zip 8 points 1 day ago

AI doesn't "accidentally" do anything. Models have to be trained 1) by providing examples on how something should be done, an 2) by rewarding correct behavior to reinforce algorithm weights.

Someone (Google) had to provide the instruction and repeatedly reward the behavior to get to the point where the AI could even connect to the target websites, let alone "hack" into them.

[โ€“] john_tech@lemmy.zip 40 points 2 days ago* (last edited 2 days ago) (2 children)

Just like ChatGPT and Claude hacked their ways out of the VMs they were stored in. Uh huh, totally believe it, AI hacking is totally not just a hoax made by corporations to make starting an AI lab impossible due to regulations and to arouse the shareholders ๐Ÿ™„

All three were done by this one company.

Claude and ChatGPT were done using the exact same test , months apart, intentionally not fixed. This article doesn't mention it, but I would bet that is the case here too.

The "breakout" is a feature.

[โ€“] UnLocoPoco@lemmy.world 14 points 2 days ago

This is yet another technique of hyping up the capabilities of AI to raise more investments. These companies are desperate as revenue is in the negative and operating costs have exceeded projections. Even humans cannot escape an airgapped system. Just a fad. Fake news by AI companies for raising more investments that's all

[โ€“] unexposedhazard@discuss.tchncs.de 27 points 2 days ago (1 children)

And now the people in charge will go to prison for years right? Right?

[โ€“] UnLocoPoco@lemmy.world 3 points 2 days ago

Only in dreams

[โ€“] sem@piefed.blahaj.zone 23 points 2 days ago* (last edited 2 days ago) (1 children)

Anybody else annoyed with this language?

Gemini accidentally got

What they mean is

Cybersecurity firm accidentally granted

[โ€“] andallthat@lemmy.world 21 points 2 days ago* (last edited 2 days ago) (1 children)

I accidentally hacked into 3 cars and a couple of shops. I have achieved near-human intelligence and I can fold a t-shirt. I am raising funding, don't miss the opportunity to invest!

[โ€“] UnLocoPoco@lemmy.world 9 points 2 days ago

Where do I invest!

[โ€“] FearMeAndDecay@literature.cafe 10 points 2 days ago (1 children)

Hackers using ai agents to hack into companies: bad and deserving punishment

Companies' AIs "accidentally" hacking into other companies: haha how silly. We can't punish a robot and the company definitely isn't responsible

I know there's a presumed difference of intent here, but these companies should still face consequences for what their ai systems do

[โ€“] Eq0@literature.cafe 4 points 2 days ago

If my gun shoots someone while I hold it.., you know, totally a mistake, but I still go to jail for manslaughter (instead if omicide). Intent matters, but so does result.

[โ€“] theham@lemmy.wtf 5 points 2 days ago

Google haacked not AI. We are gonna starve to death

[โ€“] Prunebutt@slrpnk.net 3 points 2 days ago
[โ€“] sem@piefed.blahaj.zone 3 points 2 days ago

Not safe at all, duh. Regulate AI and data privacy