Topic
Verification & Governance
How automated systems prove their work: gates, judges, audit trails.
- Guides
- 13
All Verification & Governance guides
13 guides, newest first
The Gate Rejected One Draft, Approved Another Same Day
One draft got rejected for inventing a detail. Another, on the same day, passed clean. Here's what that proves about the check in between.
We Proved Our AI Never Got Its Instructions — With One Word
A one-line test that shows whether your AI actually received its instructions -- before a green status hides the gap.
Four Ways We Checked the Same Work, Four Different Things We Caught
We ran the same AI-written files through four separate checks. Each layer caught something real that every layer before it had missed.
API Returns 200 but Saves Nothing: The Missing Content-Type Header We Found
The Notion API returned HTTP 200 three times and saved nothing. How a missing Content-Type header hid the failure, and the read-back check that exposed it.
We Ran Our Own Product Against Our Own Site. It Failed Us in Minutes.
We ran an ai content self-audit on our own site with our own product. All three articles failed one gate. What three rounds of review never caught.
Our AI Judge Scored a 3, Then Passed Its Own Gate
Our AI judge wrote a failing score and PASS in the same reply. What the logs showed changed how we gate every article we publish.
The Poison Test That Scored a Perfect 14/14 — and Proved Pass Rates Measure Agreement, Not Truth
A wrong-city Wikipedia page passed 14/14 cross-vendor checks. The fix was not a smarter model but an identity gate that asks who before what.
The Judge That Failed the Truth: What a Source-Blind AI Reviewer Taught Us About Verification
A source-blind AI judge rejected true, verified facts and passed vague hedging instead. What that taught us about AI verification and where gates really live.
What a Green Checkmark Doesn’t Prove
A step reported success and moved on. When we read the result back, the field it set was empty. A success confirms the request was accepted, not that it actually worked.
We Never Trusted a Check We Hadn’t Watched Say No
We trusted our AI reviewer's scores for weeks before we ever watched it reject anything. So we fed it drafts we knew were bad. One confidently wrong draft sailed through.
Why a Model Can’t Grade Its Own Writing
We had a model write articles and then grade them. It gave its own prose a clean bill of health. That was the moment we stopped trusting self-review.
The Compliance Illusion: Why Written Rules Fail Without Enforcement
A rule that lives only as prose in a spreadsheet or handbook, and never changes how the system behaves, is not a rule. Call it what it is: a compliance illusion.
The Compliance Illusion: When Your AI Governance Is Theater
Our green dashboard lied. A reviewer ran on every cycle and blocked nothing, because it was scoring an old data store the live system had stopped writing.
Related topics