When should I use this skill?

Use it when a user's message triggers the wrong workflow step, when Q&A is ignored, or when 'out-of-context' drops are happening incorrectly.

Does this skill help with testing?

Yes, it provides guidance for adding regression tests in tests/detection/ to ensure that changes to keywords or intent guards don't cause future regressions.

How does it handle the conflict between LLM and Regex signals?

It provides a workflow to compare UnifiedDetectionResult signals from the LLM against step-specific keyword classifiers, helping you decide which signal should take priority for a specific intent.

What does the oe-detection-triage skill do?

It helps developers debug and fix misclassifications in OpenEvent-AI, specifically focusing on intent detection, routing, and reconciling LLM results with regex fallbacks.

How do I enable debug mode for detection triage?

You can run your environment with WF_DEBUG_STATE=1 and set DETECTION_MODE=unified to see detailed logs of the unified detection engine.

OpenEvent Detection Triage

Name: OpenEvent Detection Triage
Author: shami-ah

byshami-ah

0•

분석 및 모니터링

Debugs and resolves intent classification, routing errors, and detection misfires within the OpenEvent-AI workflow.

This skill provides specialized guidance for troubleshooting the detection engine in OpenEvent-AI, helping developers reconcile LLM and regex signals to fix routing errors. It streamlines the triage process for misclassified intents, out-of-context (OOC) drops, and unexpected triggers—such as site visits or date changes—by providing step-by-step workflows for log analysis, state debugging, and regression testing. It is essential for maintaining the accuracy of the automated event planning pipeline.

주요 기능

01Debugging out-of-context (OOC) evidence gating

02Automated trace scripts for deterministic scenario testing

03Unified detection signal analysis (LLM vs Regex)

04Rapid navigation to routing and classification triggers

05Regression test integration for detection logic

060 GitHub stars

사용 사례

01Investigating why specific Q&A types or confirmation keywords are being ignored

02Correcting misclassified user intents that lead to the wrong workflow step

03Fixing unexpected site-visit or date-change triggers during user interactions

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add shami-ah/openevent-ai oe-detection-triage

For use in Claude.ai and ChatGPT

Download Skill