Analytics & Monitoring Agent Skills

Debug Stuck Evals

Diagnoses and resolves stalled or failing Inspect AI evaluations running on Hawk infrastructure.

Inspect AI Eval Debugger

Diagnoses and resolves stalled or failing AI model evaluations running on METR's Inspect framework.

Debug Stuck Evals

Troubleshoots and resolves stalled or hanging AI evaluations within the METR Hawk and Inspect AI ecosystem.

Inspect AI Evaluation Debugger

Diagnoses and resolves hanging, stalled, or failing AI evaluations within the Hawk and Inspect AI framework.

Inspect AI Eval Debugger

Diagnoses and resolves stalled or failing Inspect AI evaluations by analyzing logs, pod states, and API connectivity within the Hawk cloud environment.

Inspect AI Eval Debugger

Diagnoses and resolves hanging or failing UK AISI Inspect AI evaluations running in the Hawk cloud environment.

Inspect AI Eval Debugger

Diagnoses and resolves stalled, hanging, or failing UK AISI Inspect AI evaluations in cloud environments.

Inspect AI Evaluation Debugger

Diagnoses and resolves hanging or failing Inspect AI evaluations within Hawk cloud environments.

Hawk Eval Debugger

Diagnoses and resolves hanging or failed evaluations in METR Hawk and UK AISI Inspect AI environments.

Inspect AI Evaluation Debugger

Diagnoses and resolves hanging or failing LLM evaluations within the Hawk and Inspect AI ecosystem.

Structured Logging

Implements production-grade JSON logging patterns and distributed tracing to enhance system observability and incident debugging.

Inspect AI Evaluation Debugger

Troubleshoots and resolves hung or failing UK AISI Inspect AI evaluations running in the Hawk cloud environment.

Gmail Commander Health Check

Monitors and diagnoses the operational status of all Gmail Commander subsystems and automation processes.

Asciinema Status Monitor

Monitors the health and operational status of asciinema recording daemons and terminal session files.

Inspect AI Evaluation Debugger

Diagnoses and resolves hanging or failing AI model evaluations using Hawk and the UK AISI Inspect framework.

API Cost Tracker

Monitors and calculates real-time API token usage and USD costs for specific Claude Code session operations.

Inspect AI Evaluation Debugger

Diagnoses and resolves stalled, hanging, or failing AI evaluations within the Hawk and Inspect AI frameworks.

Inspect AI Evaluation Debugger

Diagnoses and resolves stalled, hanging, or failing AI evaluations within the Hawk and Inspect AI framework.

Inspect AI Eval Debugger

Troubleshoots and resolves hanging or failing AI model evaluations running on the Hawk platform.

Inspect AI Evaluation Debugger

Diagnoses and resolves stalled, hanging, or failing AI evaluations within the UK AISI Inspect framework.

Inspect AI Evaluation Debugger

Diagnoses and resolves hanging or failing AI model evaluations running on the Hawk and Inspect frameworks.

Hawk Evaluation Debugger

Diagnoses and resolves stalled or failing Inspect AI evaluations running on the METR Hawk platform.

Asciinema Recording Analyzer

Performs semantic analysis and keyword extraction on terminal recordings to identify patterns and usage metrics.

Asciinema Daemon Log Viewer

Monitors and inspects real-time logs from the asciinema chunker daemon to troubleshoot background recording processes.

Cal.com Commander Health Check

Monitors and diagnoses the operational status of the Cal.com Commander automation suite and its underlying subsystems.

Inspect Eval Debugger

Troubleshoots and resolves stuck or failing UK AISI Inspect AI evaluations on the Hawk platform.

Inspect AI Eval Debugger

Diagnoses and resolves stalled or failing AI evaluations running on the Hawk and Inspect AI cloud platform.

dbt Artifacts Monitoring

Monitors and analyzes dbt execution metadata to track model performance, test reliability, and data quality metrics over time.

Reflect Health Check

Diagnoses and validates the health of the Specweave reflection system to ensure continuous AI learning and system stability.

Performance Optimizer

Optimizes full-stack application performance through profiling, database tuning, and frontend efficiency strategies.