A/B Test Setup & Experimentation
Designs, calculates, and evaluates rigorous A/B and split tests for ad creatives, landing pages, and marketing campaigns.
The 19-ab-test-setup skill equips performance marketers and growth teams with a disciplined framework to execute high-confidence split tests across landing pages, ad creatives, pricing models, and email copy. By calculating sample sizes, enforcing single-variable testing, establishing test duration guardrails (e.g., minimum 7-day cycles to avoid weekly seasonality bias), and setting statistical significance thresholds (p-value < 0.05), this skill helps eliminate false positives and gut-based decision-making. It guides you from hypothesis creation and tracking setup (using Meta, GA4, or PostHog) to post-test analysis and cumulative logging, ensuring you test the highest-impact elements first.