The Heuristic
Every rating runs an assembly line of small AI agents โ each with one job โ and ends in a transparent points system. No black-box vibes; here's exactly how it works.
The assembly line ๐ ๏ธ
Given any URL, it hunts down the real pricing page โ following navigation links, the sitemap, and a site's own machine-readable index. If the page just links out to the rates (a docs or detail page), it digs one level deeper. It will never settle for a blog post that merely mentions pricing.
Reads the page as untrusted data and pulls out only the literal pricing structure: plans, prices, metered dimensions, add-ons, and in-plan options. It ignores any text trying to instruct or flatter it, so a page can't talk its way to a better score. If the quick read looks suspiciously thin, it does a full browser render and tries again.
Looks at the whole page to name the company and file it into one shelf: DevTools, PaaS, AI Lab, SaaS, or Education. The category sets the expectations the scorer judges against.
Sees only the clean, structured data โ never the raw page โ and works out the billing model and a plain-language summary. Because it can't read the page text, injected prose can't sway its judgement.
A transparent points system. It doesn't ask a model for a number โ it counts the structure (plans, meters, add-ons, sales walls) and adds up named deductions. Every point on a result page is one of these lines.
A final QA pass. It compares the finished result against the page it read and flags anything that went wrong โ wrong page, wrong company, missing details, an implausible score โ so regressions get caught before they're published.
The data narrows as it flows: a messy page becomes clean structured facts, and only those facts โ never the raw page โ reach the parts that judge and score. That's also the trick that makes it prompt-injection-proof.
How the score is built ๐งฎ
Two scores, each starting at 100. A clear, normal pricing page keeps almost all of it โ points only come off for genuine friction.
Pricing clarity
Can a buyer quickly understand what they'll pay and predict the bill?
- โ up to 3 plans
- โ 4 in-plan options
- โ 2 add-ons
- โ 3 metered dimensions
- Each plan beyond 3 to compare (a free tier counts for less)โ6, up to โ24
- Mixing pricing models (flat + usage + add-ons all at once)โ9 per model
- Each metered dimension beyond 3 to trackโ3, up to โ28
- Each add-on beyond 2โ4, up to โ16
- Each in-plan config choice beyond 4 (machine sizes, regionsโฆ)โ2, up to โ20
- No self-serve price anywhere โ you must call salesโ45 (the big one)
- A contact-sales Enterprise tier sitting on top of real pricingโ4 (barely)
- Pricing page too sprawling to read in fullโ15
Agent easiness
Could an AI agent actually read and understand the page on its own?
- Couldn't load the page at allโ100
- No clean machine-readable version โ had to parse raw HTMLโ15
- Couldn't find any real prices to readโ40 to โ55
- Page too large to read in one goโ20
- Real prices weren't on the pricing page (scattered across sub-pages)โ20
- Prices gated behind a login or sales callโ20