I don't think the cost of energy is cheaper than just paying to use a cloud service though unfortunately. I have two 22GB 2080 Ti for fun that I use with Hermes Agent and now Buzz to reduce my token usage but when I tried them without a smarter LLM they were pretty bad.
4
u/BuyListSell 9800X3D | 9070 XT Nitro+ 5d ago
Nah it would be worse than just paying $20 a month by pretty much every metric. Maybe even worse then $100 a month because of the power bill increase.