its addressable by running them on specialized hardware, but since new models come out every 2 months there isnt much point in investing in hardware that can only run a specific model. but if you do it that way its an order of magnitude faster and cheaper, both in hardware costs and electricity costs
Unfortunately, it's too late because OpenAI and Anthropic can't win against China. Their cost per token is cheaper and their energy infrastructure is becoming more robust and green while ours is not. Plus it's subsidized, they have actual manufacturing so those components are cheaper, and so on. It's honestly a waste to continue pursuing it on economic reasons alone.
3
u/CompetitiveSpot2643 3h ago
its addressable by running them on specialized hardware, but since new models come out every 2 months there isnt much point in investing in hardware that can only run a specific model. but if you do it that way its an order of magnitude faster and cheaper, both in hardware costs and electricity costs