19 rules in 5 groups, worth 100 points in all. They were set before any product was scored and apply the same way to all 12.
Version 1, published 9 Oct 2026
In short
Each rule is a yes-or-no fact, a list (such as the systems with an app) or a number with published thresholds, read from the vendor's own pages.
A fact the vendor does not publish earns nothing. A feature in beta or preview does not count.
The list follows the points. A tie goes to the lower price on "cheapest paid plan", then to the name.
Hosted or self-hosted error and crash tracking for small teams. Full observability suites, uptime checks and session-replay-only tools are left out. "On at least one plan" counts any published plan, including quote-priced ones. Price lines describe the hosted service; an entirely free product counts as $0.
SDK coverage 20 points
Rule
What it takes
Points
Web and server SDKs
An SDK for each language is listed in the vendor's docs and is generally available. An SDK the docs name as compatible (for example a Sentry SDK pointed at the server) counts. Each one earns 2 points.
12
Mobile SDKs
An SDK for each mobile platform is listed in the vendor's docs and is generally available. An Apple, Cocoa or Swift SDK counts as iOS; a React Native or Flutter guide counts for that platform. A compatible SDK named in the docs counts. Each one earns 2 points.
8
Debugging 17 points
Rule
What it takes
Points
Source maps
The docs describe uploading JavaScript source maps so minified stack traces show your original code.
6
Mobile symbol files
The docs describe uploading iOS dSYM files or Android ProGuard/R8 mapping files to read crash reports.
4
Release tracking
The docs describe tagging errors with a release or deploy version and showing which release introduced an error.
4
Event trail before the error
The docs describe a trail of events (breadcrumbs, request data or logs) attached to each error to show what happened before it.
3
Alerts and workflow 10 points
Rule
What it takes
Points
Alert channels
A built-in alert integration for each channel, on at least one plan. Each one earns 1 point.
4
Issue tracker integration
Built-in integration that creates or links tickets in Jira, GitHub or GitLab, on at least one plan.
3
Spike and quota controls
The docs describe spike protection, rate limits per project or key, or sampling that limits how many events from an error flood are counted. A monthly quota that only stops accepting events does not count.
3
Hosting and security 25 points
Rule
What it takes
Points
Self-hosting
The vendor documents how to run the error-tracking server on your own machines, with a free or paid licence.
6
Open source
The source code of the server (not only the SDKs) is public under an OSI-approved open-source licence. Source-available licences (such as FSL or BSL) do not count.
5
SOC 2 Type II or ISO 27001
The vendor names a SOC 2 Type II report or an ISO/IEC 27001 certification for this product or the company running it.
6
Single sign-on (SAML or OIDC)
Sign-in through the company's identity provider (SAML 2.0 or OpenID Connect, for example Okta or Entra ID) is documented on at least one plan, including quote-priced plans. Social logins (Google, GitHub) do not count.
5
EU data region
You can choose to store your error events in the European Union, on at least one plan.
3
Price and limits 28 points
Rule
What it takes
Points
Free plan
A free plan (not a trial) that tracks errors from a live app. A product that is entirely free counts.
5
Events on the free plan
Error events or crashes a month on the free plan. No free plan counts as 0. A product with unlimited free events counts as 1,000,000. 100,000 or more earns 5 points, 15,000 or more 4, 5,000 or more 3, 1,000 or more 1.
5
Cheapest paid plan
The cheapest paid plan for one user at its regular price, in US dollars a month. Use the yearly price divided by 12 when the vendor offers yearly billing, otherwise the monthly price. A product that is entirely free counts as $0. $10 or less earns 8 points, $20 or less 6, $30 or less 4, $45 or less 2.
8
Events on the cheapest paid plan
Error events or crashes a month included in the cheapest paid plan (the same plan as the price line). An entirely free product counts its free limit, and unlimited counts as 1,000,000. 100,000 or more earns 5 points, 50,000 or more 4, 25,000 or more 2.
5
Error history on the cheapest paid plan
Days an error stays searchable on the cheapest paid plan (the same plan as the price line); for an entirely free product, on its free plan. The longest period the plan page or docs state counts. 90 or more earns 5 points, 60 or more 4, 30 or more 2, 14 or more 1.