Overview
ai-test-reviewer is a static-analysis CLI that flags weak, AI-generated-style test patterns in Playwright, Jest, and Vitest test files. It is designed to catch obvious, mechanical red flags in tests before they are relied upon. The tool automates catching these patterns but does not replace human judgment. It prints each finding with the file, line, test title, and a plain-language explanation, and includes a closing question: "if the code under test had a real bug in the specific thing this test claims to check, would this test actually fail?" The tool can be run via a command and exits with code 0 if no findings, 1 if anything was flagged, making it usable as a CI gate. It was dogfooded against two real Playwright projects, which led to fixes for a parser bug and a rule that was too broad, and it found two standing findings in a live API test suite. The tool does not yet catch happy-path-only test files or silent assertion downgrades.
Pricing
Free
Detailed plans have not been confirmed in our catalog. Check the official website for current limits and billing terms.
Visit WebsitePrices and limits may change. Confirm the currency, billing period, seat minimum and usage caps on the official website.
Use Cases
- Teams use ai-test-reviewer to flag tests that have zero expect() calls, which can never fail.
- Teams use ai-test-reviewer to flag tests where every assertion only checks a mock or spy was called.
- Teams use ai-test-reviewer to flag tests that use near-universally-true matchers like toBeDefined() or toBeTruthy().
- Teams use ai-test-reviewer to flag tests where a response's status code is the entire signal.
- Teams use ai-test-reviewer to flag create/update/delete calls with no follow-up read confirming the effect.
- Teams use ai-test-reviewer to flag arbitrary waits like waitForTimeout() or sleep().
- Teams use ai-test-reviewer to flag brittle selectors using deep positional CSS or XPath.
- Teams use ai-test-reviewer as a CI gate to fail builds when weak test patterns are detected.
Features
Analyzes test files from the CLI
Flags weak test patterns
Detects AI-generated-style test patterns
Supports Playwright test files
Supports Jest and Vitest files
Uses the TypeScript Compiler API
Reviews
No reviews yet. Be the first to share your experience!