QA
Compress Agent Instructions Without Losing Meaning
A regression-based compression test that shortens agent instructions while preserving triggers, constraints, tool boundaries, escalation rules, and failure behavior.
The process
Work it in this order.
- Capture the baseline instruction, its owner, intended triggers, non-triggers, and a regression suite covering critical, ordinary, ambiguous, and failure cases.
- Define semantic invariants for required actions, prohibited actions, ordering, approvals, evidence standards, uncertainty language, and the final response contract.
- Create compressed candidates within an explicit edit budget, retaining the source and showing what was merged, moved, or removed without assuming equivalence.
- Execute baseline and candidate versions in a controlled environment, comparing tool choices, plans, citations, refusals, and final outputs rather than token count alone.
- Add adversarial cases for missing tools, conflicting instructions, injected content, private-data requests, and consequential actions that require a pause.
- Measure context size and operational clarity as secondary signals, investigate every behavior regression, and restore any invariant that the shorter wording weakens.
- Approve, revise, or reject the candidate with a versioned scorecard, test evidence, changed constraints, owner sign-off, and unresolved risks.
Bring this
Inputs the cat will ask for.
- baseline agent instruction and version
- semantic invariants and test cases
- controlled evaluation environment
- compression budget and approval owner
Router + one playbook
Route first. Choose one.
Cat Paw loads one playbook per task rather than merging several. Start with this router; the remaining paths are workflow-specific candidates it can inspect.
- Router:
token-efficient-agenting-pack skills/token-efficient-agenting-pack/agent-instruction-compression-safety-test/SKILL.md
Guardrails
The boundaries travel with the prompt.
- Verify the actual tools, accounts, permissions, and workspace before starting; never claim an unavailable tool, account, source, or capability.
- Use Latch/target-workspace for private code, artifacts, live probes, or non-public data; if that access is unavailable, stop at the boundary and report the blocker rather than substituting a guess.
- Pause for explicit approval before consequential external actions; return evidence and unresolved risks, assumptions, and any action still awaiting approval.
Done means
A checkable finish.
A versioned compression test demonstrates preserved agent behavior on required and adversarial cases, records the evidence and tradeoffs, and leaves no unowned semantic regression.
Sources
Where this process came from.
- github.com/JuliusBrussee/caveman/tree/2fd153c67988e980fb0b2455c90832159a6a5a25/
- agentskills.io/specification
- platform.claude.com/docs/en/build-with-claude/prompt-engineering/overview
Sources establish the workflow pattern. Reddit and community posts, where present, are treated as practitioner anecdotes rather than universal facts.