Skip to content
BuildPathGet a free checkout check

Work / Loyalty and email

Review moderation that catches health claims before they publish

Every new review is checked against the retailer’s compliance rules before it can appear, and the risky ones go to the right person.

Under 30 min

a week on moderation, down from 2 to 3 hours

2 passes

a pattern check, then a language model

3 levels

of automation, chosen per store

The problem

In this retailer’s market, a single published review that says a product treats, cures or relieves a condition can create legal risk. A review that reports a side effect has to reach the right team quickly.

General review apps publish by star rating or by hand. Reading every submission by hand costs staff time, and the review app the retailer used could not tell which reviews were risky.

What we built

  • Checks that flag health and relief claims, profanity, reported side effects, customer service problems (late, broken or wrong orders), negative sentiment and wording that could hurt the brand.
  • Three levels of automation, chosen per store. Assist: nothing publishes on its own, and staff see a recommendation. Auto hide: risky reviews are held automatically. Tiered, the default: clean reviews publish on their own when the check is confident enough.
  • Reviews that report a side effect email a set list of people. Customer service reviews email the support team.
  • Separate queues for side effect reports and customer service reviews, and staff can assign a review to a teammate.
  • Each decision records the policy version used, so the team can show later why a review was published or held.

How it works

  1. Two passes. A fast keyword and pattern check runs first and marks hits. Then a language model reads the review and returns a recommendation, a confidence level, the quoted text behind each flag, and a short reason.
  2. If the pattern check finds a health claim, the review cannot publish on its own, even when the model says "publish".
  3. If the model cannot be reached or returns a bad answer, the review goes to a person instead of publishing.
  4. Reviews are processed in the background, so a burst of submissions does not slow anything down. Older reviews can be checked again when the policy changes.

Results

  • Moderation time fell from 2 to 3 hours a week to under 30 minutes a week.
  • The launch rule: no review that breaks the policy publishes without passing the check.
  • Runs on the retailer’s own review system, which replaced Yotpo Reviews.

Could this work for your store?

The two-pass check, the queues, the alert routing and the automation levels carry over to other stores.

The rule set does not. Which claims are blocked and what counts as a side effect were written for this retailer’s market. Another seller of regulated or claim-sensitive products needs its own rules.

Review wording is one more place a regulated store can get into trouble. If your first worry is where you ship, start with the free checkout check.

See the checkout compliance offer

See where your own checkout stands

The first step is the same for every store: a free check of your shipping policy and checkout, sent back as a short video.

BuildPath is run by Ian Mason, a developer with 20 years in ecommerce and search.

  • The check is free
  • A short video of what we find
  • If we find nothing, we tell you that
Get a free checkout check