Evidence methodology
How Orkio scores products
Every product on Orkio is scored by the evidence behind it — not the marketing behind it. Here's what "Vetted by Orkio" means, how Confidence Level works, and where brands can and can't step in.
What "Vetted by Orkio" means
Orkio does not just publish product opinions. We structure real creator reviews and trusted product evidence into buyer-friendly verdicts.
The Vetted by Orkio mark is how we label that work for shoppers, creators, and merchants.
Each evidence-backed review can include:
- ▸A clear product verdict — who should buy it and who should skip it
- ▸Top supported pros — the strongest claims backed by creator testing
- ▸Biggest risks and objections — the tradeoffs reviewers agree on
- ▸Source-backed claims — individual claims with confidence levels
- ▸Confidence level — how strong and consistent the overall evidence is
- ▸Comparison notes — where the product wins and loses against alternatives
- 1Gather creator reviews and trusted third-party sources
- 2Extract claims, pros, risks, and comparisons from each source
- 3Score evidence strength and consistency across sources
- 4Publish a buyer-friendly evidence verdict
- 5Refresh evidence as new reviews and sources appear
How Confidence Level works
Orkio Confidence Level (High, Medium, Limited, Insufficient) reflects the depth, consistency, and independence of available product evidence — not product quality or popularity.
High Confidence means the available evidence is thorough, consistent across multiple independent sources, and well-documented. It does not mean the product is perfect.
Limited or Insufficient Evidence means evidence is sparse, inconsistent, or from non-independent sources. It does not mean the product is bad.
| Confidence Level | Score (0–100) | What it means |
|---|---|---|
| High Confidence | 80 – 100 | Multiple independent sources, consistent findings |
| Medium Confidence | 50 – 79 | Some independent sources, mostly consistent |
| Limited Evidence | 20 – 49 | Few sources or significant gaps |
| Insufficient Evidence | 0 – 19 | Speculative or unverified sources only |
How Ask labels a claim
When you paste a recommendation into Ask Orkio, each question gets a label from the hub we already published — not from the model guessing. The named rule is ask-claim-status-v1. Timeouts do not invent a pill.
| Label | Means |
|---|---|
| Supported | This hub claim supports the question, within that claim’s existing scope. |
| Partially supported | Support, plus a limit already written on that hub claim. |
| Conflicted | The assertion and this hub claim disagree. |
| Mixed | Evidence rows on that claim disagree. We only use Mixed when both sides are present. |
| Insufficient evidence | The hub has the claim; the evidence is too thin. |
| Stale | Mapped, but the sources are older than our freshness window. |
| Out of scope | The question is stricter than what that hub claim covers. |
| Not in our record | We have not mapped this question to a hub claim. |
| Check unavailable | The check did not finish. This is not a label on a completed card. |
The model does not choose these labels.
Confidence Level (0–100 / High / Medium / Limited / Insufficient) is the hub score, not the Ask pill.
Brand and affiliate policy
Brands cannot pay to improve Confidence Levels, remove legitimate risks, or change verdicts.
Affiliate links may appear on product and review pages. Affiliate relationships do not affect evidence ratings or verdicts.