Designs and implements statistically rigorous A/B tests and product experiments to ensure actionable, data-driven results.
This skill provides a comprehensive framework for managing the entire experimentation lifecycle, from initial hypothesis formulation to final statistical analysis. It helps product teams and developers avoid common experimentation pitfalls by providing standardized templates for data-backed hypotheses, precise sample size calculations, and robust implementation patterns for both client-side and server-side environments. Whether you are optimizing conversion rates or testing new features, this skill ensures your tests have the necessary statistical power and guardrail metrics to produce valid insights without compromising user experience.
主な機能
01101 GitHub stars
02Rigorous post-test analysis checklists and significance interpretation
03Hypothesis formulation templates with guardrail metric tracking
04Traffic allocation strategies including ramped and conservative splits
05Statistical sample size and test duration calculator
06Client-side anti-flicker patterns and server-side feature flag logic
ユースケース
01Setting up server-side experiment logic to prevent UI flickering and ad-blocker interference
02Determining the required sample size and duration for a new feature rollout
03Analyzing experiment results to distinguish between true winners and statistical noise
