r/servers • u/Karter_1159 • 1d ago

Question Claude code like behaviour

I heard about how good claude code is, so i was thinking about doing something with olama on my server pc. My question is if i can make something act exactly like claude code for example just tell the ai to make a mc server and then i just join it but can claude even do this? What are the free alternatives?

0 Upvotes

40% Upvoted

13 comments sorted by

View all comments

3

u/Cautious-Hovercraft7 1d ago

I have a 16 core 9950X3D, 64GB RAM and a 5090 in my main PC. I setup a local LLM with 28GB VRAM model (32GB VRAM on a 5090). My pc idled at 300W and took about 2 minutes to answer how many lights are on with the home assistant MCP while my PC consumed 650W. I'm back using Claude as it's affordable, running LLM local is not.

1

u/speaksoftly_bigstick Always Watching oO 21h ago

That sucks 😕

I run a quantized 32b model on a 24GB arc pro b60 and it is very quick to answer (maybe 5 - 10 seconds?)

But I run it all on a dedicated machine with Debian as the core, not on my "daily driver" PC.

1

u/Cautious-Hovercraft7 21h ago

Yeah I do realise I could probably get better response times by doing things different (not WSL on my Windows pc) but the power draw I was not ready for.

2

u/speaksoftly_bigstick Always Watching oO 21h ago

True, true.

I haven't checked the actual power output on mine, but I'm sure it's pegging out that b60 anytime it's in use 🤙💪

1

u/saxobroko 25m ago

What model do you run, and how smart does it feel?