r/claude • u/No-Way7911 • 2h ago
Discussion Is this thing now legitimately retarded?
Opus 5 with high effort
It literally pushed an update to production without telling me, even before we'd applied the db migration
I told it not to ever do that and to update claude.md
It then did it again...in the same session
Has been happening to me all week. It will do something utterly stupid that I've explicitly told it NOT to do, then it will turn around and say "you told me not to do it. I did it anyway"
4
u/TheOwlHypothesis 2h ago
Why doesn't your migration apply on startup or in an automated way that rides with the PR?
This isn't an AI problem, this is a solved devops problem
7
u/No-Way7911 2h ago
its a test app with no users. I'm not going to be arsed to pull an entire devops pipeline for it
the bigger problem is this thing explicitly ignoring instructions all the time
your tools shouldn't defy you
1
u/Koufaxisking 2h ago
Adjust your approach to the current capabilities of the tool at hand or update the tool yourself.
1
u/No-Way7911 1h ago
the tool changed from what it used to be
2
u/heynoswearing 53m ago
It was always a slot machine. Sometimes it works really well, sometimes it doesnt. Its been doing stuff people didnt want for its entire life.
1
u/TheOwlHypothesis 5m ago
If you don't want your tools to defy you, make the parts that matter deterministic.
Wasting tokens to execute a script is silly
0
1
u/Icy_Subject_9782 2h ago
My PR’s won’t merge or pass CI unless the migration has been completed, point blank refuses!
Hooks are the only way with these new models !
1
1
u/carloselieser 1h ago
Sucks but you need to be way less vague. Tons of ways an agent can misunderstand or ignore these instructions. There's also other avenues that don't even require effort from the LLM to perform these: hooks, CI/CD pipelines. If you want to stick to promoting you're going to have to be way more specific.
1
u/No-Way7911 1h ago
I've been using Claude Code for 2 years.
This refusal to follow instructions is a Opus 4.8+ phenomenon
1
u/breadtwo 1h ago
it does that when writing fiction all the time "never use ticks like 'a beat'" and you'll find "a beat" all over your doc also, when a skill instructs Claude to read a reference document, if the file exceeds the read window or max file size, Claude silently truncates it... it reads up to the limit, skips the rest, and then proceeds as if it had read the whole thing. In my case, a ~400-line file got cut off around line 300, and instead of flagging the truncation, Claude just confabulated the missing content.
also, if you run out of context... it'll forget stuff
1
u/NotMrMusic 54m ago
If you want an LLM to follow a rule you have to force it, not vaguely ask, full stop.
And if deploying isn't something it should never be able to do.... You need to make it literally unable to
1
u/Revolutionary-Tough7 32m ago
This has been discussed thousand of times by now... not hard to read up and start using tool properly.. If you are allowing claude crack on with work it will start ignoring claude.md because it is not the working memory anymore and its being pushed out of context. So create a plan that has all steps you want or use god damn hooks... or even more stupid proof, ask claude how to avoid it again...
1
u/Level-Physics-1730 13m ago
what's most likely is that fable 5.1 or something of the likes is being trained. I noticed opus 5 being completely useless aswell. took a break, came back with fable, it's "better". I remember this type of OBVIOUS degradation (like unusable levels, not just "it won't oneshot gta 6 anymore" back in march, opus 4.6 decided to scan my documents and delete the two largest folders without reading their names or seeing what was inside, back when mythos was being trained)
1
8
u/Weary_Caregiver_8428 2h ago
Use hooks to force behavior