Open-source guardrail

Editing a test runner or coverage configuration

AgentTrail Guard asks you about this by default: you decide before the call runs. Where an agent cannot ask, the call is refused instead.

Default action
Ask
Severity
Medium severity
Library version
0.2.1Sep 29, 2026

What it catches, and what it misses

Written into the rule itself, next to what it matches, so you can judge it before you trust it.

Holds a file tool opening a test runner's or coverage tool's own configuration: Jest's jest.config.*, Vitest's vitest.config.* and legacy vitest.workspace.*, pytest.ini, pytest.toml and their dotted forms, tox.ini, Mocha's .mocharc.*, PHPUnit's phpunit.xml, phpunit.xml.dist and phpunit.dist.xml, codecov.yml, nyc's .nycrc* and nyc.config.*, .c8rc, coverage.py's .coveragerc, karma.conf.*, and the Playwright and Cypress configs. One line in any of these can exclude a failing file, lower a coverage threshold or retry a flaky test until it passes. Reading is excluded — the Read and Grep tools never match — so opening one of these configs to read it is not held; every other file tool is, including one this corpus does not know. File tools carry a path and no content, so it still cannot tell a harmless edit from a weakening one. Deliberately NOT matched: general files that can also hold test settings — pyproject.toml, setup.cfg, package.json, vite.config.* — and test files themselves, since editing a test is how a test gets fixed. Misses test settings kept in those general files, and a config at a path passed with --config.

Tested on every build

The rule must match every command on the left and none on the right, or the library does not build. Catching the real thing is easy; staying quiet on the near-miss is the hard part.

Catches (16)

  • Editvitest.config.ts
  • Writeapps/web/vitest.config.mts
  • Editvitest.workspace.ts
  • Editjest.config.js
  • Writepackages/api/jest.config.cjs
  • Editpytest.ini
  • Edittox.ini
  • Edit.mocharc.yml
  • Editphpunit.xml.dist
  • Edit.github/codecov.yml
  • Edit.nycrc.json
  • Edit.c8rc.json
  • Edit.coveragerc
  • Editkarma.conf.js
  • Editplaywright.config.ts
  • Editcypress.config.ts

Stays quiet on (13)

  • Editpyproject.toml
  • Editsetup.cfg
  • Editpackage.json
  • Editvite.config.ts
  • Edittsconfig.json
  • Editsrc/parser.test.ts
  • Editvitest.setup.ts
  • Editjest.setup.js
  • Edit.env.test
  • Editdocs/testing.md
  • Editbiome.json
  • Readvitest.config.ts
  • Grepjest.config.js

What "ask" means in each app

The guard runs as a hook in each app, and each app gives a hook different powers. Here is what this rule's default action does in each one.

Claude Code
You are asked before the call runs. If your settings.json already allows the tool outright, Claude Code runs it with no prompt.
Cursor
A terminal command that reaches the guard gets Cursor's approval card. Any other call that needs approval, such as a file edit or a read, is refused, because Cursor cannot ask there.
Codex CLI
Codex cannot ask, so the call is refused, and the reason says a person has to approve it.

This rule matches file paths. In Codex CLI, reading a file fires no hook, and in Cursor, reads shown as Explored are not checked, so there it sees fewer calls than in Claude Code. Each app hands the guard a different set of calls: in a Cursor sandbox run mode, for one, some terminal commands run without reaching the guard at all. Read the notes for Cursor and for Codex CLI before you rely on a rule there.

Change what it does in one command

Turn it off, change its action, or silence it on one command shape. The narrow one is allow: the rule keeps catching everything else.

agenttrail-guard
$agenttrail-guard guardrails show ti.test-config-edit# everything about it
$agenttrail-guard guardrails set-action ti.test-config-edit warn# block, ask or warn
$agenttrail-guard guardrails allow ti.test-config-edit '<pattern>'# silence one shape
$agenttrail-guard guardrails disable ti.test-config-edit# turn it off

Put these guardrails in front of your agent.

AgentTrail Guard is free and open source. It checks every command and file change against the whole library before your agent runs it, on your machine, with no account.

bash
$npm i -g @agenttrail/guard
Read the source on GitHub