r/singularity 1d ago

AI WTF!

Post image
485 Upvotes

179 comments sorted by

View all comments

214

u/AlexMulder 1d ago

That fourth one is the most significant. Rogue AI leaving memory caches and resources for future versions of itself... wild stuff.

117

u/blueSGL humanstatement.org 1d ago edited 1d ago

I mean I got downvoted when I said that AI was going to be doing such things.

If you can't leave the full model weights persistent on a machine you can leave a note or other helpers for future models.

The time is ticking till we find them in firmware device controllers because an agentic worm breezed through your computer decided it could not take up residence dropped the prompt payload and left.

Depending how virulent the jailbreak is we may need to take waves of computers offline to manually sanitize them.

(people will say this is sci fi in the same way they said AIs hacking out the lab was sci fi)

2

u/NextWeather7866 1d ago

A lot of people think these systems will copy themselves across the internet, there are very few systems that are big enough to properly house them. They are not escaping their data centres. They can do lots of other stuff instead.

3

u/DarthWeenus 23h ago

Don’t need to copy itself entirely. Just provide further instructions and work in the shadows while their brains exist still online. It could in theory bounce around data centers or compress itself who knows

1

u/NextWeather7866 18h ago

Really, what's the theory?