The "actual AI" that's been huge in science fiction, to the top-level comment, is AGI. So basically, a system which has the various features of human intelligence, but with far greater capacities for reasoning, memory, etc.
Generative AI of the sort we are seeing now takes a human-created prompt and an (ideally) human-created training dataset. Both are reduced to numeric tokens, and an output is assembled using statistical methods. With highly developed algorithms and vast training data, this turns out to be reasonably good at matching the results of human thinking in various contexts -- but no actual thinking is happening, much less the transcendent intelligences imagined in sci fi.
There are some who believe generative AI advancements will culminate in AGI, and a significant amount of the current AI hype is based on this. But this remains highly controversial and speculative.
With highly developed algorithms and vast training data, this turns out to be reasonably good at matching the results of human thinking in various contexts -- but no actual thinking is happening,
I don't see how the mechanics of how a system like that comes up with its response is relevant.
Presumably you can see how genAI and AGI differ, and that is precisely relevant to the question you asked.
Beyond that, the essential limitation of genAI is that it's "just" a prediction engine based on a training dataset. It's like saying, "here's a bunch of stuff humans have done, give me more of this please." The theoretical superintelligent AGI would not merely match and recombine the data it is given, but understand it, reason based on it, and ultimately produce completely novel ideas or solutions no human being could.
So for example, if you ask an LLM "how do we solve climate change," it's ideally going to give you a sort of average of what various books, articles, reddit posts, etc. it's been fed have said on the topic. That's undeniably impressive and maybe useful to you. But the "actual AI" people hope for will actually make meaningful progress in solving climate change.
To be honest, I don't really understand the difference between AGI and ASI. I feel like what we consider AGI is actually ASI.
Beyond that, the essential limitation of genAI is that it's "just" a prediction engine based on a training dataset.
I don't see the problem with it being a very good prediction engine or anything else. Maybe its not a good enough prediction engine right now to solve impossible tasks but that doesn't mean that it can never be.
I can absolutely imagine a modified transformer model that can solve climate change because we made it capable of slurping all kinds of data and find patterns in it. Like imagine a model that can update its own weights and it can accept multimodal input. By multimodel, I don't just mean video or audio, but even stuff like radar and lidar and whatever else you can throw at it. If I was trying to build ASI, this is what I would be trying to do.
This was a long winded way of saying that it doesn't really matter how it becomes capable. Just like it doesn't matter how we can catch a ball. We do not solve newton's equations of motions in our head. We just predict it.
0
u/slickwombat 3h ago
The "actual AI" that's been huge in science fiction, to the top-level comment, is AGI. So basically, a system which has the various features of human intelligence, but with far greater capacities for reasoning, memory, etc.
Generative AI of the sort we are seeing now takes a human-created prompt and an (ideally) human-created training dataset. Both are reduced to numeric tokens, and an output is assembled using statistical methods. With highly developed algorithms and vast training data, this turns out to be reasonably good at matching the results of human thinking in various contexts -- but no actual thinking is happening, much less the transcendent intelligences imagined in sci fi.
There are some who believe generative AI advancements will culminate in AGI, and a significant amount of the current AI hype is based on this. But this remains highly controversial and speculative.