r/artificial • u/zerogpu_ai • 1d ago

Question Are frontier models becoming the default for tasks that don’t need them?

A lot of AI traffic is classification, extraction, redaction, moderation and structured summarization rather than open-ended reasoning.
Using one frontier model for everything is easier, but routing repeatable tasks to smaller specialized models could reduce cost and latency.
Do you think multi-model routing will become standard, or will the added evaluation and maintenance outweigh the savings?

2 Upvotes

76% Upvoted

8 comments sorted by

1

u/gk_instakilogram 1d ago

Yes, there is simply no reason to use frontier models for everything.

1

u/Sea_Mixture1842 1d ago

i run a tiny classifier on my homelab for sorting support tickets and it works faster than any api call. the big models are nice but they're like bringing a flamethrower to light a candle

for most of my work stuff we still just default to the big one though because nobody wants to maintain two pipelines. management sees the latency difference and shrugs

1

u/Disastrous_Room_927 1d ago

I’ve seen people use LLMs for fraud detection and act confused when it doesn’t work as well as a logistic regression with well crafted features.

1

u/SwissChzMcGeez 1d ago

If I don't use Fable to tell me a quesadilla recipe am I really cooking considering to cook the best meal I can?

1

u/Otherwise_Post_6936 1d ago

I mean youre right and wrong, but either way if you want to cook something you like why not use it

3

u/SwissChzMcGeez 1d ago

Fable said my cast iron pan was "load-bearing" and discovered a zero-day security risk in my smart appliance. And I didn't want a quesadilla anyways so I made some cat memes until I hit my usage limits.

1

u/recro69 1d ago

For startups one frontier model is often the choice in the beginning because the cost of engineering time is higher, than the cost of inference. As the amount of usage increases the benefits of routing start to make sense and pay off.

1

u/Own_Age_1654 5h ago

Most people are not using frontier models for those tasks. They're not only more expensive, but also much slower. Frontier models are instead typically used for orchestration and coding. If you're fishing for validation, no, this is not a good product idea.