ab-test-designer

Q: How do I install ab-test-designer?

Run npx skills add https://github.com/pmprompt/claude-plugin-product-management --skill ab-test-designer in your project. The skills CLI detects the agents you use and copies the skill into the right folder. For Claude Code you can also place the skill folder at ~/.claude/skills/ab-test-designer/ (personal) or .claude/skills/ab-test-designer/ (project).

by pmpromptTesting & QA

Design robust A/B test experiments. Use when testing a new feature, validating a hypothesis, or optimizing conversion rates.

Installs: 391
Last 24h: —
Trending rank: —
Security: Not audited

Install

Works with every agent the skills CLI supports.

npx skills add https://github.com/pmprompt/claude-plugin-product-management --skill ab-test-designer

01
Install
Run the command in your project. The CLI asks which agents to install for.
02
Describe the task
Ask your agent for something this skill covers. It loads ab-test-designer automatically when relevant.
03
Review the result
The agent follows the SKILL.md steps, scripts and references bundled with the skill.

SKILL.md

The instructions your agent reads when the skill is triggered.

Domain Context

This skill implements a proven product management framework. The approach combines best practices from industry leaders and is designed for practical application in day-to-day PM work.

Input Requirements

Context about your product, feature, or problem
Relevant data, research, or constraints (recommended but optional)
Clear articulation of what you're trying to achieve

A/B Test Designer

When to Use

Testing a new feature or design variation
Validating a hypothesis before full rollout
Optimizing conversion rates or key metrics
Choosing between multiple design approaches
Need to make a data-driven decision on a change

What This Skill Does

Helps you design rigorous A/B tests with clear hypotheses, success metrics, sample size calculations, and analysis plans.

Instructions

Help me design an A/B test for [feature/change]. Include:

Hypothesis
- Current situation and metrics
- Proposed change
- Expected impact and why
Test Design
- Primary success metric
- Secondary metrics
- Sample size needed
- Test duration
- User segments to include/exclude
Variants
- Control (A): current experience
- Variant (B): new experience
- Any additional variants (C, D, etc.)
Risks and Controls
- Potential negative impacts
- Guardrail metrics
- When to stop the test early
Analysis Plan
- Statistical significance threshold
- How to handle edge cases
- Decision criteria

Feature context: [Add context about the change you want to test]

Best Practices

Start with a clear, falsifiable hypothesis
Choose one primary metric to avoid multiple comparison issues
Calculate sample size upfront based on expected effect size
Run tests for full weekly cycles to account for day-of-week effects
Set a minimum test duration (usually 1-2 weeks)
Define success criteria before running the test
Monitor guardrail metrics (revenue, errors, performance)

Example

Input: Testing new onboarding flow vs current 3-step process Output: Hypothesis (new 1-step flow will increase co...

FAQ

What does the ab-test-designer skill do?

Design robust A/B test experiments. Use when testing a new feature, validating a hypothesis, or optimizing conversion rates.

How do I install ab-test-designer?

Run npx skills add https://github.com/pmprompt/claude-plugin-product-management --skill ab-test-designer in your project. The skills CLI detects the agents you use and copies the skill into the right folder. For Claude Code you can also place the skill folder at ~/.claude/skills/ab-test-designer/ (personal) or .claude/skills/ab-test-designer/ (project).

Which AI agents can use ab-test-designer?

Any agent that supports the open Agent Skills format (a folder with a SKILL.md file), including Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, Windsurf, Cline, OpenCode and more.

Is ab-test-designer safe to install?

No partner security audit is available yet. Skills can run commands and scripts, so read the SKILL.md and any bundled files before installing.

Who maintains ab-test-designer?

It is published by pmprompt in pmprompt/claude-plugin-product-management. It has 391 recorded installs.