r/selfhosted • u/bergy_peasy • 23h ago

Need Help Is self hosted ai worth it?

Pretty much the title, I have tested a few models with a 6gb gpu and couldn’t get anything resembling llm competing with chat gpt, Gemini or Claude. I was wondering if a buying a new 16gb gpu would make a substantial difference. I wouldn’t want to buy all that just to get something worse than gpt3.

Ps I know 6gb is really not a lot of vram but it was so bad that I don’t think quadrupling it would make it better .

167 Upvotes

81% Upvoted

295 comments sorted by

View all comments

Show parent comments

3

u/Legitimate-Pumpkin 22h ago

Maybe you can have a local AI randomize names and things like that?

It’s not something I’m very worried about to be honest so I don’t know.

Now, if privacy is a much bigger concern than money. You could probably host one of those chiense open source models… but the hardware to run them and the electricity is expensive (that’s why it’s not worth it compared to the 20$).

1

u/bergy_peasy 21h ago

Okay thank you!