Insights

Engineering

Making AI code review useful instead of noisy

Bot comments on every diff train engineers to ignore the bot. We tuned ours for precision and merged review time dropped by a third.

ASI TECH INC · August 3, 2026 · 6 min read

The first week of AI code review is exciting. The third week, everyone mutes it.

Precision over recall A reviewer that flags twenty things where two matter is worse than one that flags two. We cap the bot at three comments per pull request and rank by severity.

Give it the context a human has Diff-only review produces shallow comments. Feed the model the changed file in full, the tests that cover it, recent related commits, and your written conventions.

Let it own the boring lane - Missing null and error handling on new branches - Secrets, keys and PII in logs - N+1 queries and unbounded loops over remote calls - Test coverage gaps on new public functions

Keep humans on design Architecture, naming and product intent stay with people. The bot buys back the attention humans were spending on mechanical checks.

More notes like this