Does this skill work with both Python and Node.js?

Yes, it provides comprehensive integration patterns for both TypeScript/JavaScript using the @olakai/sdk and Python via the olakai-sdk.

What is the benefit of registering CustomDataConfigs?

Registering your custom data fields allows Olakai to use them as variables in KPI formulas, enabling advanced business metric tracking and alerting.

Can I monitor streaming LLM responses?

Absolutely. The Olakai SDK handles streaming responses automatically, sending the telemetry event once the stream is finished.

How do I handle agents that make multiple LLM calls?

The skill includes an 'Agentic Workflow' pattern that shows you how to aggregate multiple LLM calls into a single manual event for cohesive monitoring.

Olakai AI Monitoring & Observability

Name: Olakai AI Monitoring & Observability
Author: olakai-ai

byolakai-ai

0•

分析与监控

Integrates professional observability, custom KPIs, and business metrics tracking into existing AI agents and LLM applications.

The olakai-add-monitoring skill empowers developers to retrofit production-grade telemetry into AI systems with minimal code changes. By wrapping OpenAI and Anthropic clients or using manual event tracking, it captures more than just token counts—it enables the creation of business-specific KPIs, ROI tracking, and performance dashboards. This skill guides you through the entire pipeline of instrumenting code, registering custom data schemas, and establishing workflow-level monitoring for complex, multi-step agentic behaviors.

主要功能

01Automatic client wrapping for OpenAI and Anthropic SDKs

02Support for both TypeScript/JavaScript and Python environments

03Multi-step agentic workflow aggregation and session grouping

04CLI-integrated agent and workflow management

050 GitHub stars

06Custom KPI configuration for business-specific performance tracking

使用场景

01Retrofitting observability into a production AI agent without rewriting logic

02Monitoring performance trends and token costs across complex agentic workflows

03Measuring the business ROI of LLM features through custom success metrics

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add olakai-ai/olakai-skills olakai-add-monitoring

For use in Claude.ai and ChatGPT

主要功能

01Automatic client wrapping for OpenAI and Anthropic SDKs

02Support for both TypeScript/JavaScript and Python environments

03Multi-step agentic workflow aggregation and session grouping

04CLI-integrated agent and workflow management

050 GitHub stars

06Custom KPI configuration for business-specific performance tracking

使用场景

01Retrofitting observability into a production AI agent without rewriting logic

02Monitoring performance trends and token costs across complex agentic workflows

03Measuring the business ROI of LLM features through custom success metrics

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add olakai-ai/olakai-skills olakai-add-monitoring

For use in Claude.ai and ChatGPT