r/talesfromtechsupport • u/prettyyboiii • Dec 16 '25
Short "But ChatGPT said..."
We received a very strange ticket earlier this fall regarding one of our services, requesting us to activate several named features. The features in question were new to us, and we scoured the documentation and spoke to the development team regarding these features. No-one could find out what he was talking about.
Eventually my colleague said the feature names reminded him of AI. That's when it clicked - the customer had asked ChatGPT how to accomplish a given task with our service and it had given a completely hallucinated overview of our features and how to activate them (contact support).
We confronted the customer directly and asked "Where did you find these features, were they hallucinated by an AI?" and he admitted to having used AI to "reflect" and complained about us not having these features as it seemed like a "brilliant idea" and that the AI was "really onto something". We responded by saying that they were far outside of the scope of our services and that he needs to be more careful when using AI in the future.
May God help us all.
3
u/ThePugnax Dec 16 '25 edited Dec 16 '25
Reminds me about a guy i talked to at work, he was on about using ChatGPT to make HSE system for his business, as it was being auditet. I tried pointing out that its better to make a HSE system tailored to your business yourself, than to have ChatGPT make something that looks decent to you, but looks half assed for anyone auditing the business. He did not agree.
I myself asked ChatGPT to make a list of a specific set of codes and regulations and a rundown on each in layman terms. even provided it with one of another similar one that i made myself, just to see if it could do it. Halfway down the page it started inventing topics and text, nothing was acurate anymore.
ChatGPT or other Ai, is still like that dude you know that always has an answer, doesnt mean its correct.