LeeteLeeteAI · IoT
← Back to cases
E-commerce & RetailA home goods e-commerce (20-person team) · Dongguan

Home-goods e-commerce service QA and after-sales: kill bad reviews in the ticket queue

100%
QA coverage
-60%
After-sales time
-35%
Bad-review rate
24h
Auto ticket routing

Client Profile

Industry
E-commerce · home goods
Scale
20-person team · 50k orders/month
Current
Manual sampling + manual after-sales
Goal
Stable service, fast after-sales

Pain Points

1

Uneven script quality

Many new support staff with inconsistent scripts mean uneven service.

2

Slow after-sales

Manual ticket judgment and routing are slow; delays invite bad reviews.

3

Complex returns

Back-and-forth returns raise communication costs and hurt experience.

Live Demo

Live demo · Service QA & after-sales
Ready
Input
A support conversation + an after-sales ticket
Consolelogs · stdout
$ 初始化演示管线…

How We Built It

01

Full-session QA

Every conversation is auto-scored for emotion and risky phrasing.

02

Smart ticket routing

Tickets auto-classify, route to the right handler, and suggest replies.

03

Self-serve returns

Guide customers through returns to reduce manual involvement.

Not betting on one AI — combining the right few

For a real business scenario, we don't lock in a single technical path up front. We evaluate candidate paths on the same benchmark, then design a hybrid so each path does what it's best at.

General LLM API

Public-cloud models such as GPT-4o / Qwen / DeepSeek

  • ✓Out-of-the-box, minimal integration cost, cheap to start
  • ✕Limited generalization to vertical domains, unstable field-level accuracy, separate compliance design
Best for cold start and quick validation

Industry fine-tuned model

Domain fine-tuning of open-source models on industry data

  • ✓Grasps industry semantics, much higher accuracy, private deployment
  • ✕Needs labeled data plus ongoing training and upkeep
Best as the primary path for high-frequency traffic

RAG + rule engine

Retrieval-augmented knowledge plus business rule checks

  • ✓Highly targeted, explainable, best latency and cost
  • ✕Requires continuous data-loop investment
Best for fallback and high-certainty scenarios

Fusion, not selection

What we deliver is not a single model but a fused pipeline of primary path + semantic correction + graceful fallback: routine cases are handled by the industry model in seconds; low-confidence fields are re-understood by an LLM; on service anomalies the system degrades to a general API and flags manual review — achieving accuracy, cost, latency and controllability at once.

An explainable, degradable, evolvable AI pipeline

We treat AI engineering as a pipeline, not a black box: every step has clear responsibilities, inputs/outputs and fallbacks. The five-step pipeline plus four-layer architecture below is the technical skeleton.

L1

Ingestion & access layer

Multi-channel access with unified auth, idempotency and masking

Business APIsMobile / mini-programsFile upload / scanningAPI gateway · masking
L2

AI inference layer

Multi-path inference plus a confidence router switching by features

Industry fine-tuned modelMultimodal LLMRAG retrievalConfidence routing
L3

Business orchestration layer

Connecting results to real business flows with rule checks and closure

Business rule checksEntity / master-data matchingAmount / logic closureManual review tickets
L4

Data loop layer

Every online error flows back; models iterate monthly

Sample warehouseOnline labeling & error recallMonthly incremental fine-tuningDrift monitoring & alerts

Tech Stack

FastAPIvLLMLangChainRAGQwenGPT-4oTritonKubernetesPostgreSQLRedisMilvusDocker

Delivery Process

1

Service standards

Compiled service standards and QA points.

2

QA launch

Deployed conversation QA, then optimized.

3

Ticket system

Integrated auto classification and routing.

4

Self-serve flow

Launched self-serve returns.

5

Closed loop

Continuously improve scripts from bad-review attribution.

Before vs After

MetricBeforeAfter
QA coverage5% sampled100%
Avg. resolution time48 hrs19 hrs
Bad-review rate1.4%0.9%

“We used to react after problems happened. Now the system flags risky tickets in advance, and bad reviews are way down.”

— Ms. Zheng · Support Manager · home-goods e-commerce

Where It Fits

Full QA for e-commerce support
Smart after-sales ticket routing
Self-serve returns

Related Cases