Simple Split Testing is live on the Shopify App Store

Simple Split Testing is now live on the Shopify App Store. Install it on any Shopify plan and start running A/B tests on your storefront without a theme rewrite.

Install Simple Split Testing on the Shopify App Store →

What it does

You add two data attributes to any theme element. The embed swaps in the right variant per visitor. Conversions are tracked against the goal you pick, with significance computed against the confidence level you choose. That is the whole product.

<h2 data-split-id="hero-copy" data-split-variant="control">
  Free shipping over $50
</h2>
<h2 data-split-id="hero-copy" data-split-variant="b">
  Free shipping on every order this week
</h2>

No framework. No theme rewrite. No JavaScript build step.

Sticky across the checkout

Every visitor is bucketed once per active test and stays in that variant for the lifetime of their 90-day cookie. The assignment is stamped onto their cart as an attribute, so it survives the checkout and orders attribute back to the right variant. No flicker, no re-bucketing on the next page load.

Real statistics, not vibes

Rate metrics (conversion rate, add-to-cart rate) use a two-proportion z-test
AOV uses a Welch t-test
You pick the confidence level: 90, 95, or 99 percent
Multi-variant tests get an automatic Bonferroni correction
The admin tells you when there is enough data to call the test and roughly how many more sessions to gather when the verdict is still moderate or low

You don’t get told a winner because two variants are 2% apart on 200 sessions. You get told the truth.

A few things worth knowing

Variants can swap entire elements, toggle CSS classes, apply inline styles, or insert content from a template tag. You don’t have to duplicate markup.
Audience targeting by URL substring, country, device, and visitor type. Visitors outside the rules see the unchanged page and never count toward results.
Signed preview links let you open a variant on the live storefront before you activate the test.
GDPR and CCPA consent gating via Shopify customerPrivacy. Visitors without analytics consent are excluded automatically.
The script short-circuits before any network call when no tests are running. Installed-but-idle costs you nothing per page view.

For developers and agencies

Tests are addressable from a documented data-attribute vocabulary, a custom-event API via Shopify.analytics.publish, and signed preview tokens. If you want to drive variants from a metafield, build a custom admin panel, or integrate with your existing analytics pipeline, that is supported. Works out of the box for merchants, extensible for anyone building on top.

See the Simple Split Testing overview or jump into the docs.