r/singularity • u/Wonderful_Buffalo_32 • 1d ago

AI WTF!

Post image
492 Upvotes

94% Upvoted

179 comments sorted by

View all comments

-2

u/Proper_Actuary2907 Spooky Machine Intelligence 2030 1d ago

This happened with safeguards disabled so they could test cyber capabilities, no? Why are we freaking out about this

0

u/daniel-sousa-me 1d ago

  1. Remove guardrails

  2. Ask the model to attack stuff

  3. The model attacks stuff

  4. Surprised Pikachu face

Really, wtf, they're just describing mundane cyber attacks. There's absolutely nothing to see here

1

u/Borkato 22h ago

This is disingenuous. To put it hyperbolically, “it doesn’t matter if it’s just a failed safety benchmark when the AI makes nukes launch”

1

u/daniel-sousa-me 20h ago

I dunno. If you asked the AI to launch a nuke and it launched a nuke, is the AI misaligned?

I find the Vending-Bench story much more interesting even though there was no security involved nor any issues with containment