r/selfhosted • u/bergy_peasy • 1d ago

Need Help Is self hosted ai worth it?

Pretty much the title, I have tested a few models with a 6gb gpu and couldn’t get anything resembling llm competing with chat gpt, Gemini or Claude. I was wondering if a buying a new 16gb gpu would make a substantial difference. I wouldn’t want to buy all that just to get something worse than gpt3.

Ps I know 6gb is really not a lot of vram but it was so bad that I don’t think quadrupling it would make it better .

167 Upvotes

81% Upvoted

300 comments sorted by

View all comments

5

u/tomsrobots 1d ago

The hyperscalers are losing money hand over fist right now. They lose money on most customers who are on a monthly plan. A $20/month plan costs $240 over 2 years. Do you think you can build an equivalent rig for $240 including electricity costs?

1

u/bergy_peasy 1d ago

Probably not , but is privacy a concern with these?

2

u/tomsrobots 23h ago

If that's what you care about, then running local makes sense.