A/B Test Planner + Analyzer
Plan and analyze A/B tests with explicit hypotheses, sample sizing assumptions, and decision rules.
DocumentationRequirements & limits
Use when an A/B test needs explicit hypotheses, sample-size assumptions, and decision rules.
Inputs
- experiment_goal
- hypothesis
- variants
- primary_metric
- guardrail_metrics
- baseline_rate
- minimum_detectable_effect
- traffic_estimate
- test_window
- results_data (optional)
Outputs
- Experiment plan
- Decision framework
- Analysis summary
Before you begin
- Reading and copying the procedure require no terminal setup. Check requirements for any packaged programs separately.
Try this first
Read the procedure and supply its documented inputs. Use the full text in an agent app or chat that supports pasted instructions, following that host's guidance.
Limits for this step
- Instruction package only; it does not provide or authorize an executable runtime capability.
- Safe for planning and analysis; require human approval before launching experiments or changing traffic allocation.
Read full instructionsHide full instructions
A/B Test Planner + Analyzer
When to use
Use when proposing, reviewing, or interpreting experiments for conversion, CTR, CVR, or revenue-impact changes.
Inputs required
- experiment_goal
- hypothesis
- variants
- primary_metric
- guardrail_metrics
- baseline_rate
- minimum_detectable_effect
- traffic_estimate
- test_window
- results_data (optional)
Workflow
- Validate hypothesis and metric alignment.
- Estimate sample size and recommended duration.
- Define stop rules and decision thresholds.
- Analyze results when data is provided.
- Return decision (
ship,iterate,stop) with confidence.
Output format
- plan
- analysis
- risks
- next_tests
Guardrails
- State assumptions used for sample size.
- Mark result as inconclusive when evidence is weak.
- Never overstate causality beyond observed test design.
View file metadata
---
name: ab-test-planner-analyzer
description: Design rigorous A/B tests and analyze outcomes into clear shipping decisions with risk notes.
---Install instruction files
These commands copy guidance into the selected runtime directories. Confirm that your agent app discovers it. Any packaged programs need separate setup and verification.
Install (Codex)
./bin/skills-hub install marketing/[email protected] --runtime codex
Install (Claude)
./bin/skills-hub install marketing/[email protected] --runtime claude
Install (Generic)
./bin/skills-hub install marketing/[email protected] --runtime generic --target ./my-agent/skills