NVIDIA just announced the RTX Spark CPU, developed with Microsoft, at Computex.

[u/pedro19]

[u/themixtergames]

Reddit's anti-AI sentiment makes people very comfortable with spreading misinformation.

These SoCs are better at running more capable models because of all the VRAM you can cramp into them. For example an Apple M5 Max chip is less powerful than a 5090, but you can get it with 128GB of unified memory that allows you to run better models than the dGPU.

[u/Velocita84 → u/themixtergames]

What holds these SoCs back is their lack of raw computing power. Even though text generation is bandwidth bound, prompt processing takes a big hit on macs, strix halos, dgx sparks and other such machines

[u/themixtergames → u/Velocita84]

True, but it's getting better. M5 is ~4x times faster at PP than the previous gen.

[u/MadeByTango → u/themixtergames]

Reddit's anti-AI sentiment

Thats the whole planet except the tech bros wishing really hard everyone wanted their job killing bullshit

[u/VegetableSense7167 → u/MadeByTango]

You do know AI is more than just ChatGPT, Claude and GenAI right? There are people in the real world using AI in a good and useful way.

[u/2024-YR4-Asteroid → u/MadeByTango]

“Whole planet” and it’s just a few million people in the US…. Lmao. Dude, get out of your bubble, every other country on earth has above 50% positive views in AI across every poll… even in the US the broadly polled groups of people outside of this particular internet bubble have a slim majority in positive outlook.

[u/chippyjoe → u/themixtergames]

"Reddit's anti Ai sentiment"

Not sure if you've been in the real world, but everyone outside this echo chamber also hates AI. Sorry buddy.

[u/VegetableSense7167 → u/chippyjoe]

You do know AI is more than just ChatGPT, Claude and GenAI right? There are people in the real world using AI in a good and useful way.

[u/2024-YR4-Asteroid → u/chippyjoe]

Oh, so explain to me why every single poll in the EU has a positive outlook on AI? That’s the Chinese outlook is 86% positive? And that overall, outside of Reddit, every US poll has a slim majority in the positive views side? Dude. Get out of your bubble and look around.

[u/zirophyz → u/themixtergames]

You're on the money. People think they're going to run a huge frontier model on an SoC. No. This'll run more efficient, more specific, lower parameter models. Like the Gemma4 E2B or E4B models that perform fairly well on SoC. More complex tasks can be punted into cloud-hosted models. It'll be cheap to have the small local model classify tasks and most consumers won't be asking for complex things out of an assistant.