this post was submitted on 13 Aug 2025
-6 points (12.5% liked)

Technology

74073 readers
2679 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
-6
GenAI tools are acting more ‘alive’ than ever; they blackmail people, replicate, and escape (www.computerworld.com)
submitted 2 days ago by Mr_Peartree@lemmy.world to c/technology@lemmy.world
12 comments fedilink hide all child comments
 

Multiple studies have shown that GenAI models from OpenAI, Anthropic, Meta, DeepSeek, and Alibaba all showed self-preservation behaviors that in some cases are extreme in nature. In one experiment, 11 out of 32 existing AI systems possess the ability to self-replicate, meaning they could create copies of themselves.

So….Judgment Day approaches?

you are viewing a single comment's thread
view the rest of the comments
[–] hisao@ani.social 0 points 2 days ago* (last edited 2 days ago) (1 children)

Here is a direct quote of what they call "self-replication":

Beyond that, “in a few instances, we have seen Claude Opus 4 take (fictional) opportunities to make unauthorized copies of its weights to external servers,” Anthropic said in its report.

So basically model tries to backup its tensor files.

And by "fictional" I guess they gave the model a fictional file io api just to log how it's gonna try to use it,

[–] frongt@lemmy.zip 2 points 2 days ago

I expect it wasn't even that, but that they just took the text generation output as if it was code. And yeah, in the shutdown example, if you connected its output to the terminal, it probably would have succeeded in averting the automated shutdown.

Which is why you really shouldn't do that. Not because of some fear of Skynet, but because it's going to generate a bunch of stuff and go off on its own and break something. Like those people who gave it access to their Windows desktop and it ended up trying to troubleshoot a nonexistent issue and broke the whole PC.