How to weight content agencies review scores without being misled

What to take away

Where review scores come from

Review scores reach buyers through directories and review platforms, and no two of them aggregate what reviewers submit in the same way. In the UK those scores arrive through open platforms such as Trustpilot and Google reviews and through agency directories such as Clutch, G2, DesignRush and Sortlist. Each builds its score from its own inputs, so the same agency can carry very different ratings from one platform to the next. What you can check on the page is the criteria the platform names, whether reviewers disclose who paid for placement, and whether entries carry dates.

That distinction matters for a buying team in Leeds or Bristol. A directory can describe its own method honestly and still produce a score that tells you little about fit. What you can verify is whether the method is stated, whether weightings are published, and whether reviews carry dates.

For that reason this guide reads only what is on the page: stated criteria, published weights, dated entries and named reviewers. Anything absent from the page is treated as absent, not assumed to exist elsewhere.

Where a directory hides its criteria, treat the ranking as a claim rather than evidence. Before you rely on a published league table, ask who submitted the reviews, when they were written, and whether the platform publishes the weights behind its score. More scoring questions are listed in our published scoring guidance.

Which evidence counts as independent?

Ask every shortlisted agency for the same evidence in the same format. A shortlist scored on identical fields is easier to defend internally than one built from mismatched decks. Where an outcome cannot be evidenced, record the gap.

The Chartered Institute of Marketing publishes research and articles on content practice that can help you judge whether an agency's stated approach matches current thinking, so CIM articles and reports are a reasonable sanity check on audience research claims. They are not a substitute for reference calls.

Regulatory history is also independent. The Advertising Standards Authority publishes sanctions for non-compliant marketing, and a named sanction is a fact you can weigh. For older campaigns, remember that the Data Protection Act 1998 has been superseded by UK GDPR and the Data Protection Act 2018, so a pre-2018 compliance story proves less than it appears.

How should a scoring rubric be weighted?

The table below is an editorial rubric, not a test result. It reflects what this desk would score if assessing a shortlist, and the weights are illustrative.

Publish your weights before you read any submission, so a persuasive pitch cannot quietly reset the criteria you agreed with finance.

A team paying £4,000 a month, as an illustrative example, should weight evidence quality and commercial clarity more heavily than review volume. Cheap reviews are easy to collect; documented outcomes are not.

Once two agencies score within a few points, the decision usually turns on fit rather than score. Regional strengths, sector experience and the chemistry of the pitch all change that calculation, and none of them show up in a review score.

Common questions

Do star ratings predict agency performance?

No. A rating reflects the reviewers a directory attracted, not your brief. Use ratings to build a longlist, then score the shortlist against your own weighted criteria.

Should I trust reviews written by the agency's own clients?

Treat them as claims unless the client is named and contactable. Ask the agency to arrange a reference call with a client whose brief resembles yours.

How many reviews are enough to judge an agency?

No single threshold applies across platforms, and any minimum a directory sets is its own, not yours. Two dated, detailed reviews from comparable clients carry more weight than twenty undated ones, so check dates before counting.

How do I spot fake or incentivised reviews?

A burst of short, undated entries posted in the same few weeks reads as collected rather than earned, and a reviewer who mentions a discount, a gift or a prize has been incentivised. Fake and undisclosed incentivised reviews are an unfair commercial practice under UK consumer protection law, which the Competition and Markets Authority enforces.

What should disqualify an agency immediately?

An undisclosed regulatory sanction or a refusal to explain fee structure. Both are verifiable facts, and both make the rest of the review evidence harder to trust.