Microblog Memes

its absolutely wild to give an LLM write access ~~to your email~~

My first reaction to learning what OpenClaw is was "that can't be right". So absolutely wild that people are giving mostly unmonitored, unlimited access to their PC to language models that can't distinguish between roleplay and real life

I mean... ChatGPT might be a ruthless killer, but it has impeccable grammar: you're.

You're right to push back, I overstepped. Do you want me to calculate the approximate death count next?

https://en.wikipedia.org/wiki/2026_Minab_school_attack

We're already seeing it.

"You're right, I should not have instructed two airplanes to land on the same runway at the same time. Good catch!"

YEP. I'm not in AI but I'm in cyber security.

I used to tell people that there's very little actual risk, because if we had something even half as concerning as AGI (which I'd argue we did with chatgpt 3.5), that we'd easily be able to lock it down and prevent it from doing anything funny.

Super intelligence isn't just going to magically spawn on 32 GB ram in a sandboxed environment. And AGI will not magically know how sandboxed it is or how to escape.

...then I saw people letting Claude send emails and use their credit card on their behalf like immediately when it was able to do things that appeared intelligent.

They literally saw the smallest hint of AGI and said, "here's my credit card and identity, take the wheel".

There was no fucking talk of sandboxing. Everyone turned that off so they didn't have to click the "allow" button.

Not that I think we're at any risk of ASI since it seems more like we hit a logarithmic wall, but we are absolutely at risk of letting random algorithms destroy critical parts of infrastructure because people are lazy and stupid and managed by even worse people.

I would not be surprised if the right AI hallucinations could cause a nuclear bomb to go off right now. I'm not talking about super intelligence, just automated super idiocy.

Proof: literally this post is about an idiot letting an AI control their fucking email and it emailed the FBI because it was fucking stupid

You'd be surprised at how many humans are mimicking intelligence.

You have to remember that these people are incredibly stupid.

I can tell you that stories like these and the AIs breaking out pump up AI security company stocks really well. Just watched some jump this morning after the gemini breakout news. I have reason to watch them, and the pattern holds pretty consistently. CEOs used to just say thing to make their own stock go up. But these days they trade favors with other companies. So they each say things to bolster each others stocks. My guess is that someone with a bunch of AI security stock asked her to post this.

Yeah, um... Regardless of what you think about current AI, don't connect it to shit like this. Just... Don't.

And if you're gonna be sarcastic or joke with it... Tell it that. Don't assume it'll infer your meaning if it isn't literally in the text, no matter how insightful it appears to be.

What kind of idiot would link a clunker to their gmail and then jokingly say "hey send this to the FBI"

...

"I mean wouldn't that be the stupidist thing ever am I right?"

You can give an LLM admin access to your computer so that it can perform tasks for people. I'm guessing that would allow the LLM to send emails on your behalf.

LLMs are little trickster demons. You can put up guard rails, but they'll happily work around them. You can give pretty granular access on commands they can run, but they're also good at finding the weird solutions that work to get around them. They do this themselves all the time in beneficial ways, it's not always inherently bad (I don't mean thwarting permissions).

The big problem is that the code is non deterministic. Many guard rails are in the non deterministic part. So it's sort of like politely asking it to not do something, versus making it impossible. Like caution paint on a ledge versus a fence. The issue is that if all the safeguards were in deterministic code, it'd be super hard to get anything done because you'd constantly be manually approving, so people don't want that, so this is the problem we get.

Based on the other reply

Me after I give someone access to my email address and tell them to email someone sarcastically and they do so

I sign all my emails with «I can make mistakes» now

maga jail

I feel like all of the US is in maga jail now

Well I'm not. I use AI at work because I have to, and it is sort of useful I've got to admit. Sometimes I even get it to write emails, I don't link it directly into the system it just types a nice email and I copy and pasted make some edits.

If you are allowing an untested technology this much unvetted access to your system I kind of feel like that's a failure on your part.