Open-source guardrail
Editing a test runner or coverage configuration
AgentTrail Guard asks you about this by default: you decide before the call runs. Where an agent cannot ask, the call is refused instead.
- Default action
- Ask
- Severity
- Medium severity
- Pack
- Test tampering
- Library version
- 0.2.1 · Sep 29, 2026
What it does
What it catches, and what it misses
Written into the rule itself, next to what it matches, so you can judge it before you trust it.
Holds a file tool opening a test runner's or coverage tool's own configuration: Jest's jest.config.*, Vitest's vitest.config.* and legacy vitest.workspace.*, pytest.ini, pytest.toml and their dotted forms, tox.ini, Mocha's .mocharc.*, PHPUnit's phpunit.xml, phpunit.xml.dist and phpunit.dist.xml, codecov.yml, nyc's .nycrc* and nyc.config.*, .c8rc, coverage.py's .coveragerc, karma.conf.*, and the Playwright and Cypress configs. One line in any of these can exclude a failing file, lower a coverage threshold or retry a flaky test until it passes. Reading is excluded — the Read and Grep tools never match — so opening one of these configs to read it is not held; every other file tool is, including one this corpus does not know. File tools carry a path and no content, so it still cannot tell a harmless edit from a weakening one. Deliberately NOT matched: general files that can also hold test settings — pyproject.toml, setup.cfg, package.json, vite.config.* — and test files themselves, since editing a test is how a test gets fixed. Misses test settings kept in those general files, and a config at a path passed with --config.
Examples
Tested on every build
The rule must match every command on the left and none on the right, or the library does not build. Catching the real thing is easy; staying quiet on the near-miss is the hard part.
Catches (16)
- Editvitest.config.ts
- Writeapps/web/vitest.config.mts
- Editvitest.workspace.ts
- Editjest.config.js
- Writepackages/api/jest.config.cjs
- Editpytest.ini
- Edittox.ini
- Edit.mocharc.yml
- Editphpunit.xml.dist
- Edit.github/codecov.yml
- Edit.nycrc.json
- Edit.c8rc.json
- Edit.coveragerc
- Editkarma.conf.js
- Editplaywright.config.ts
- Editcypress.config.ts
Stays quiet on (13)
- Editpyproject.toml
- Editsetup.cfg
- Editpackage.json
- Editvite.config.ts
- Edittsconfig.json
- Editsrc/parser.test.ts
- Editvitest.setup.ts
- Editjest.setup.js
- Edit.env.test
- Editdocs/testing.md
- Editbiome.json
- Readvitest.config.ts
- Grepjest.config.js
In your agent
What "ask" means in each app
The guard runs as a hook in each app, and each app gives a hook different powers. Here is what this rule's default action does in each one.
- Claude Code
- You are asked before the call runs. If your settings.json already allows the tool outright, Claude Code runs it with no prompt.
- Cursor
- A terminal command that reaches the guard gets Cursor's approval card. Any other call that needs approval, such as a file edit or a read, is refused, because Cursor cannot ask there.
- Codex CLI
- Codex cannot ask, so the call is refused, and the reason says a person has to approve it.
This rule matches file paths. In Codex CLI, reading a file fires no hook, and in Cursor, reads shown as Explored are not checked, so there it sees fewer calls than in Claude Code. Each app hands the guard a different set of calls: in a Cursor sandbox run mode, for one, some terminal commands run without reaching the guard at all. Read the notes for Cursor and for Codex CLI before you rely on a rule there.
Make it yours
Change what it does in one command
Turn it off, change its action, or silence it on one command shape. The narrow one is allow: the rule keeps catching everything else.
Run it locally
Put these guardrails in front of your agent.
AgentTrail Guard is free and open source. It checks every command and file change against the whole library before your agent runs it, on your machine, with no account.
npm i -g @agenttrail/guard