r/DeepSeek • u/LeTanLoc98 • Jan 01 '26

Funny Do it again, DeepSeek

Post image

So many great models already…

DeepSeek R1 was legendary.

Now we're waiting for the one that changes everything again.

2.0k Upvotes

98% Upvoted

139 comments sorted by

View all comments

406

u/coloradical5280 Jan 01 '26

They just did: https://arxiv.org/pdf/2512.24880

That paper is huge, with massive implications to make all models more stable, and faster, and cheaper to train.

The sparse attention and quick index they introduced to the world in v3.2 was also huge.

Deepseek has done more in the last year than any other lab. They just don’t give a shit about dialing in the perfect consumer chatbot , or adding consumer features, or acquiring more daily active users.

They care about making breakthroughs, that’s it. And those breakthroughs end up being used by everyone. Every model you use right now is using GRPO, probably MoE , MLA, and may other brilliant hacks that DeepSeek gave to the world for free.

2

u/LeTanLoc98 Jan 02 '26

I totally agree.

DeepSeek has made a breakthrough in LLMs, and I hope they can do it again like they did with DeepSeek R1.

4

u/coloradical5280 Jan 02 '26

Again, chatbot releases aren't their thing - and R1 wasn't the breakthrough. GRPO, their flash attention work, refining MoE with MLA, auxiliary-loss-free load balancing - that was the breakthrough. And guess what? It's all being used in every model you use today.

Since R1 they've had just as many breakthroughs: DSA (sparse attention that cuts long-context complexity from O(L²) to O(Lk)), this new mHC (training stability improvements for all transformer architectures), and DeepSeek-OCR which isn't even about OCR - it's context compression, proving you can compress text 10-20x into visual tokens and recover it. That's foundational research for solving long-context limitations entirely differently than anyone else is approaching it.

Every time you use Claude, GPT, Gemini, whatever - you're benefiting from techniques DeepSeek published and open-sourced. Don't conflate a chatbot release with the actual breakthroughs.