A Flip Is a Missing Rule
A colleague sent me the cleanest bug report I've had all year. He'd taken an open change, squashed it, and opened it again — same content, byte for byte, as…
Tagged evidence
-
-
Intermittent Competence Looks Like Coverage
My reviewer caught a deleted flush call three times out of three, and said nothing about eight of thirteen removals in any run.
-
A Constraint You Can Quietly Lift Isn't One
I had a harness measuring whether a set of skills helped a cheap model. It came back negative: no lift worth the tokens. I believed it.
-
Train on What the Gate Throws Away
My code reviewer does far more work than it ships. Scouts cast a wide net — anything that might be a violation.
-
A Big Rule Set Is an Attention Problem
Sixteen minutes and sixteen dollars to surface four low-severity nits, most of it spent scanning for rules rather than judging code.
-
Rules Are the Alpha
Two reviewers, the same commit — a fat change, a few thousand lines. One was a deep reviewer I own, running a portfolio of judgment rules tested across a…
-
A Cue Finds More of What It Can Already See
An AI reviewer finds three bugs on a real PR. Tell it to expect four or five and it finds more — but only more of what it could already see.
-
Familiarity Isn't Trust
I caught myself telling an AI, "you're starting to sound like me." My cadence, my hedges, the figures I reach for — it had picked them up and was handing them…
-
Shrink, Reorganise, Relocate: Why Synthetic Wins Fail on Real PRs
I spent a stretch trying to make an AI code reviewer cheaper without letting it miss more. Cost and recall, two dials pulling against each other.
-
Augmented Reading
The reflex, when a model meets something long, is to make it shorter. Summarise the PR, TL;DR the paper, have the agent review the diff and hand back the…
-
You Can't Grade Your Own Misses
Ask a code-review tool how good it is and you'll get a precision answer: of the things it flagged, how many were real.
-
Fidelity Was a Vibe, Cost Was a Number
I told the agent fidelity came first. It optimised for cost anyway, for an embarrassing reason — cost had an estimator and a guardrail, and fidelity had a…
-
Your Merged-PR History Is Survivorship-Biased Training Data
In the Second World War, the Statistical Research Group was asked where to add armour on bombers, and handed the damage data from the planes that came back …
-
Noticing Is Cheap, Judgment Is Scarce
The goal was never a cheaper reviewer. It was finding everything that is really there while posting nothing that isn't — and that objective, not the budget…
-
Evals Aren't the Moat
A fast eval told me a restructured module was clearly better. Comfortable margin. I ran it again to be sure, got the same verdict, promoted the new version…
-
A Pool of Models Narrows the Overlap — It Doesn't Erase It
Sakana AI shipped Fugu with a clean pitch: one endpoint that routes your task across a pool of models — calling itself recursively — and handles selection…
-
The Productivity Mirage
Sixteen experienced developers finished 19% slower with AI and believed they were 20% faster. The feeling of a fast session tracks fluency, not distance.
-
Your Codebase Is the Prompt
The AI reads from your codebase before it writes into it. Whatever's already there — your conventions, your shortcuts, your best work and your worst — is the…
