A/B Test Analysis Pro

This skill empowers product teams and developers to interpret A/B test results accurately by automating complex statistical calculations including p-values, confidence intervals, and sample size validation. It identifies critical experimentation pitfalls like Sample Ratio Mismatch (SRM), novelty effects, and underpowered tests while balancing primary conversion metrics against vital guardrails. By translating raw data into actionable business logic, it helps users decide whether to roll out a feature to 100% of traffic or return to the drawing board.

主な機能

ユースケース