Review moderation that catches health claims before they publish
Every new review is checked against the retailer’s compliance rules before it can appear, and the risky ones go to the right person.
Under 30 min
a week on moderation, down from 2 to 3 hours
2 passes
a pattern check, then a language model
3 levels
of automation, chosen per store
The problem
In this retailer’s market, a single published review that says a product treats, cures or relieves a condition can create legal risk. A review that reports a side effect has to reach the right team quickly.
General review apps publish by star rating or by hand. Reading every submission by hand costs staff time, and the review app the retailer used could not tell which reviews were risky.
What we built
- Checks that flag health and relief claims, profanity, reported side effects, customer service problems (late, broken or wrong orders), negative sentiment and wording that could hurt the brand.
- Three levels of automation, chosen per store. Assist: nothing publishes on its own, and staff see a recommendation. Auto hide: risky reviews are held automatically. Tiered, the default: clean reviews publish on their own when the check is confident enough.
- Reviews that report a side effect email a set list of people. Customer service reviews email the support team.
- Separate queues for side effect reports and customer service reviews, and staff can assign a review to a teammate.
- Each decision records the policy version used, so the team can show later why a review was published or held.
How it works
- Two passes. A fast keyword and pattern check runs first and marks hits. Then a language model reads the review and returns a recommendation, a confidence level, the quoted text behind each flag, and a short reason.
- If the pattern check finds a health claim, the review cannot publish on its own, even when the model says "publish".
- If the model cannot be reached or returns a bad answer, the review goes to a person instead of publishing.
- Reviews are processed in the background, so a burst of submissions does not slow anything down. Older reviews can be checked again when the policy changes.
Results
- Moderation time fell from 2 to 3 hours a week to under 30 minutes a week.
- The launch rule: no review that breaks the policy publishes without passing the check.
- Runs on the retailer’s own review system, which replaced Yotpo Reviews.
Could this work for your store?
The two-pass check, the queues, the alert routing and the automation levels carry over to other stores.
The rule set does not. Which claims are blocked and what counts as a side effect were written for this retailer’s market. Another seller of regulated or claim-sensitive products needs its own rules.
Review wording is one more place a regulated store can get into trouble. If your first worry is where you ship, start with the free checkout check.
See the checkout compliance offerRelated work
An owned loyalty program for BigCommerce
Points, VIP tiers, rewards and referrals in a program the retailer owns, with redemptions that become working BigCommerce coupons.
Read the caseIntercom Fin for BigCommerce: order, stock and points answers
Connectors that let the Intercom Fin chatbot answer "where is my order?" and "how many points do I have?" from live store data.
Read the caseSee where your own checkout stands
The first step is the same for every store: a free check of your shipping policy and checkout, sent back as a short video.
BuildPath is run by Ian Mason, a developer with 20 years in ecommerce and search.
- The check is free
- A short video of what we find
- If we find nothing, we tell you that