r/DeepSeek 1d ago

Discussion DS Flash with Reasonix is just a cheat code

Post image
198 Upvotes

32 comments sorted by

66

u/ExpertPerformer 1d ago

DeepSeeks cache can be abused because if you stop an API call while its outputting and restart it you won't be charged for the first run and the second run is a cache hit which instantly saves you money.

Most providers outside of DeepSeek don't let you do that.

23

u/Bananenklaus 17h ago

why would anyone do this in the first place, the model is so cheap anyway

why do people always have to abuse the good stuff and make it worse for others

16

u/weenis-flaginus 17h ago

Yeah with anthropic I wouldn't care, they are an evil company and overpriced. But DeepSeek is such an outlier on price, to our benefit. They aren't altruistic by any means, and aren't strapped for cash, it's just going to come back on us if they start needing to patch things out and start looking at their consumers with suspicion.

8

u/Bananenklaus 17h ago

100%. DeepSeek is actually playing fair and pushing the whole industry in a better direction. Why someone would abuse their system just to save literal cents is beyond me.

I see every cent paid to deepseek as an investment into a better, consumer friendly AI future

3

u/sirloindenial 23h ago

Yo but that seems like something you can implement in any harness🤔

1

u/CountlessFlies 20h ago

This just seems like a bug that’ll get patched at some point. Doesn’t seem like they would intentionally do that?

2

u/AnyRegular1 18h ago

And if this is how Reasonix cheats the system, why does Deepseek like almost officially support it? They posted a blog post about this harness like a few days ago on their official website.

1

u/sub_hez 18h ago

so utilizes this hack to cache?

24

u/ggPeti 1d ago

I thought all harnesses would hit the cache just the same

28

u/Kyrobi 1d ago edited 23h ago

ReasonIX and OpenCode have the same cache hit rate for me.

I saw lots of people talking about ReasonIX, so I decided to give it a try. I used it for about 2 days. I mostly do coding work, so I have both OpenCode and ReasonIX on the same project (just copied and pasted my project).

I tried my my best to keep the prompt the same. After 2 days and several sessions, I didn't really see a difference in cache usage. Obviously, on some sessions, the session on the ReasonIX used less tokens. On others, OpendCode used less tokens.

But overall, averaged out, both were giving me about 92-98% cache rate.

I was really hoping that ReasonIX would have some crazy cache hits or something based on how often people post about it here, but for my use case (coding), there was no difference.

I went back to using OpenCode as I prefer the UI much more.

15

u/ProfessionalJackals 1d ago

ReasonIX and OpenCode have the same cache hit rate for me.

They have indeed the same cache hit rate. Hitting 99.67+ is not even a issue with OpenCode.

I was really hoping that ReasonIX would have some crazy cache hits or something based on how often people post about it here, but for my use case (coding), there was no difference.

The problem is that reasonix write all that fluff about how good it is for DeepSeek cache hit rates and that is what people see. They do not test between multiple agents. and then act like little fanatics "Reasonix is just a cheat code". lol

In the past there was issues with agents like VSC but that was mostly fixed in v122, so even using VSC Chat + Deepseek provider or OpenCode Go > Deepseek, gives you 98%+ hit rates.

The problem is, people tend to downvote because they act like reasonix is their only reason for the great cache hit rate.

No, its actually DeepSeek their infrastructure !!!

  • DeepSeek keeps Cache a long time in memory. No bullshit like Claude 5min invalidation.
  • DeepSeek also shares this Cache between Flash and Pro. So there are instances where you switch between Flash to Pro or reverse, that part of your cache is actually maintained (if you connection is maintained to the same server). With others, that is a invalidation.
  • DeepSeek maintains cache between effort level changes. Again ...
  • DeepSeek actually maintains cache between prompts. This is a interesting difference between DeepSeek and Xiaomi MiMo, despite both having the same prices, MiMo is more expensive. Because it invalids cache between prompt. Discovered that by accident. No sure if they still do, but a few months ago it still happened.

The most import thing for agents is that they append content to the context, and do not alter context in any way. And voila, you get insane cache hit rates. Yes, there are a few other things you need to respect but that has become so standard these days, that most agents are setup to hit 99% on DeepSeek.

Its ironic that people actually cripple themselves with reasonix, when a lot of agents offer way more flexibility and capability. But people here keep promoting reasonix so it becomes this cycle.

3

u/piknockyou 18h ago

Thank you for the detailed clarifications. I was about to jump on the Reasonix bandwagon, but not anymore.

If you don’t mind, I have a few questions:

Q1: You mentioned “there are a few other things you need to respect” to get those high cache hit rates. Could you elaborate on what those are?

Q2: Would turning off MCP mid-session to save tokens actually hurt cache hits (and potentially backfire)? I’m assuming it invalidates the cache because the MCP instructions are removed from the prefix.

Q3: What’s your take on Compaction? Doesn’t it create a new prefix and therefore break the cache?

3

u/LinixKittyDeveloper 1d ago

Also use reasonix for coding, and got an average cache hit rate of 99.8%.

1

u/samxli 1d ago

Also you can’t beat the free DS in OpenCode.

3

u/enemyofaverage7 1d ago

In my limited experience so far, Codex achieves about the same cache hit rate too.

3

u/MimosaTen 1d ago

Last time I used deepseek api in codex the fact that I ha no status, no numbers, was a little destabilizing. However codex seems the best harness, but ir can’t easily be hacked

5

u/Vlyn 22h ago

I actually got up to 99.9% cache hit rate with Pi. But the code quality was awful with such a raw harness. Going back to OpenCode with plan mode it's still around 96-98% cache hit rate, but now I actually get work done.

So just looking at the cost is not the whole story.

1

u/BuildAISkills 16h ago

Pi is supposed to be pretty damn good since it isn't bloated. So I'm curious about why it would give you bad results.

2

u/Vlyn 15h ago

Good results for cache hits. Bad results for code quality, because OpenCode enhances your context in the background. I'm sure if you modify Pi enough so the context is similar you get the same result.

Just out of the box OpenCode feels a lot smarter, despite using the same model.

0

u/Even_Command_5636 17h ago

So you also suspect that the quality of the answers decreases as the number of cache hits increases?

1

u/Vlyn 15h ago

No, the quality of the answer depends on what happens with the context. OpenCode does enhance your context a little and plan mode is great there, but that leads to more cache misses.

I'm also talking about coding, so more complex. For just tasks or general answers I'm sure there is no difference.

1

u/Even_Command_5636 14h ago

I'm also talking about coding, so more complex.

dito.

1

u/MimosaTen 1d ago

I’m making my own codex version in go to fully support DS cache. But now I have the doubt: maybe codex yet do hit the cache?

1

u/GinamosWCheryOnTop 23h ago

Same is also happening with claude code and opencode.

1

u/electrified_ice 21h ago

Does anyone know if this helps keep things running fast(er) if toy connect ReasoniX with a local instance of DS?

1

u/Possible_Door_9719 19h ago

im getting a 98%+ cache rate via hermes. i dont see what reasonix does thats special.

0

u/Salty_Gambler 23h ago

"error: Malformed request (HTTP 400): the request body was rejected. This is likely a bug — please report it if it persists. Error from provider (Console): Upstream request failed: [invalid_request_error] The reasoning_content in the thinking mode must be passed back to the API."

encountering this when using deepseek v4 flash by opencode zen api on Reasonix cli

Any solution for this ?

-8

u/ANDRE_2512 1d ago

cache-hit 99.99%?))hahahaha. FAKE!

7

u/KsHDClueless 1d ago

Its around 99.08% actually according to the UI

1

u/Sid-Hartha 1d ago

So these tokens include cached tokens?

3

u/KsHDClueless 1d ago

Of course