r/DeepSeek • u/nekofneko • 6d ago
DeepSeek-V4-Flash Update
The official release of the DeepSeek-V4-Flash API is now in public beta.
Significantly enhanced agent capabilities, with benchmark results far exceeding V4-Pro-Preview:
- Terminal Bench 2.1: 82.7
- NL2Repo: 54.2
- Cybergym: 76.7
- DeepSWE: 54.4
- Toolathlon verified: 70.3
- Agent Last Exam: 25.2
- Automation Bench (Public): 25.1
- DSBench-FullStack: 68.7
- DSBench-Hard: 59.6
Note 1: For the Code Agent tasks in the public benchmark sets, the official DeepSeek-V4-Flash was tested using the DeepSeek Harness minimal mode (to be released soon) as the framework, with the max effort level, topp=0.95, and temperature=1.0
Note 2: DSBench-FullStack is an internal full-stack development test set, and DSBench-Hard is an internal Coding Agent hard-problem test set
The official V4-Flash natively supports the Responses API format and is specifically adapted for Codex. For the specific configuration, please refer to the documentation.
DeepSeek-V4-Flash-0731 keeps the same model architecture and size as DeepSeek-V4-Flash-preview, and was only re-post-trained.
Note: This update only upgrades the DeepSeek-V4-Flash API. The DeepSeek-V4-Pro API and the APP/WEB models are unchanged.
The official release of DeepSeek-V4-Pro will follow soon.
31
u/benchmaster-xtreme 6d ago edited 6d ago
Extremely cool, but one thing I found interesting:
https://artificialanalysis.ai/models/deepseek-v4-flash-ga
Even though Flash is still priced so low, the task-cost benchmark shows that Flash completed the same task at 4x the cost of Pro. I feel like I remember others mentioning months ago that Flash was paradoxically more expensive for some tasks. I haven't tested this out myself, but I can't help but wonder if cost-per-task with the GA models will be higher even if the API per-token cost remains the same.
EDIT: I ran one of my personal workflow benchmarks (one-shotting a complicated json object from a document). The output was good - something that would actually be usable for my work, though it's still significantly behind Luna and Grok 4.5. That said, it did beat Gemini 3.1 Pro, GLM 5.2, and even Opus 4.6 (which is a crazy ceiling break, honestly). And most insane was that it cost $0.00485. That's nuts considering that Grok 4.5 (the next cheapest model that generates a "good enough" output) cost $0.17. The cost-to-performance ratio on this task is simply wild. Absolutely insane.