Handle customer support with an AI agent (partial)
A merchant ran Gorgias AI Agent for months but disabled it after irrelevant answers and promises the store couldn't keep. Task: The Gorgias team configured an AI Agent for merchant Topped Toys over several weeks, implementing logic for order editing and cancellation. The merchant operated the agent for a few months before issues arose. After attempting multiple support channels without resolution, the merchant disabled the agent. Human involvement was limited to initial setup and subsequent troubleshooting attempts.; tools: custom-built or unnamed agent. Human role: Not stated in the source; limitations: Post-launch support was inadequate, with Level 2 response times exceeding 36 hours. The team that built the agent offered no support, and regular chat support advised deleting the code they wrote. Reliability depends heavily on vendor stability and support responsiveness, which proved insufficient for this merchant..
Tools
custom-built or unnamed agent
Published on Agent Work Atlas:
Overview
A merchant ran Gorgias AI Agent for months but disabled it after irrelevant answers and promises the store couldn't keep.
Workflow
The Gorgias team configured an AI Agent for merchant Topped Toys over several weeks, implementing logic for order editing and cancellation. The merchant operated the agent for a few months before issues arose. After attempting multiple support channels without resolution, the merchant disabled the agent. Human involvement was limited to initial setup and subsequent troubleshooting attempts.
Reported result
The agent initially resolved approximately 95% of issues but subsequently failed in 100% of cases. It recommended non-existent products, lost the ability to edit or cancel orders, and made unfulfillable promises to customers. The merchant disabled the tool due to customer frustration and lack of effective vendor support.
Human role
Not stated in the source
Limitations
Post-launch support was inadequate, with Level 2 response times exceeding 36 hours. The team that built the agent offered no support, and regular chat support advised deleting the code they wrote. Reliability depends heavily on vendor stability and support responsiveness, which proved insufficient for this merchant.
Try it
I am a merchant evaluating AI customer support tools. I need to test a Gorgias-like AI agent for low-risk queries only. First, configure the agent to handle only FAQ responses, excluding order edits or cancellations. Second, set up a human-in-the-loop review process where all AI-generated responses are held for manual approval before sending. Third, monitor for hallucinations, such as recommending out-of-stock items. Fourth, track the percentage of irrelevant answers or broken promises over a two-week pilot. If the error rate exceeds 5% or support response times exceed 4 hours, disable the agent immediately. Do not allow the agent to make binding commitments. Confirm with me before deploying to live customers.
Source reports are not independently verified. Publication date is the catalog publication date, not the original article date.