How does a mistake become a guardrail?

The skill uses a 14-day review period. If a mistake occurs twice in the same repo within 14 days, it is promoted to a 'Hot Rule' in that repo's agent file.

Does it clean up old or unnecessary rules?

Yes, if 14-30 days pass without a specific mistake occurring, the demotion procedure proposes removing the associated one-line guardrail to keep files clean.

Where are the mistakes logged?

Mistakes are stored in two locations: a global log at ~/.claude/mistakes.jsonl and a project-specific log at /memory/mistakes.jsonl.

What kind of mistakes can be tracked?

It can track any procedural error, including skipping pre-flight checks, unauthorized port closures, or failing to consult documentation before executing tasks.

Mistake Tracking & Guardrail Management

Name: Mistake Tracking & Guardrail Management
Author: mshuffett

bymshuffett

0•

分析と監視

Logs recurring AI errors and automatically promotes or demotes guardrails based on frequency to improve model reliability.

The Mistake Tracking skill implements a systematic feedback loop for Claude, allowing it to record, analyze, and learn from its own procedural errors. By logging events into structured JSONL files at both global and project levels, the skill provides a data-driven method for managing 'Hot Rules.' It features a built-in promotion and demotion logic that converts frequent mistakes into hard guardrails while pruning unnecessary rules during periods of high performance, ensuring Claude adapts to your specific repository constraints and workflows without manual intervention.

主な機能

01Automated promotion of recurring errors into project Hot Rules

02Mandatory guide consultation enforcement for high-risk procedural tasks

03Rule demotion logic to prevent instruction bloat during quiet periods

04Pre-defined event schema for structured mistake auditing

05Dual-level logging in global and project-specific JSONL files

060 GitHub stars

ユースケース

01Enforcing strict adherence to internal documentation and acceptance checks

02Self-optimizing Claude's guardrails based on 14-30 day performance cycles

03Reducing recurring git and environment errors in complex monorepos

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add mshuffett/dotfiles mistake-tracking

For use in Claude.ai and ChatGPT

Download Skill