Now on the Shopify App Store
A/B test your Shopify theme
without rewriting it.
Add two data attributes to any element, bucket visitors stickily across the checkout, and measure conversion with two-proportion z-tests at the confidence level you choose.
Works with any Shopify plan and any theme. Free plan available.
What's included
A full A/B testing workflow, designed for Shopify themes.
Markup-driven variants
Add two data attributes to any theme element and the embed swaps it in or out per visitor. No theme rewrite, no JavaScript framework, no extra build step.
Sticky assignment
Every visitor is bucketed once per active test and stays in that variant for the lifetime of their 90-day cookie. No flicker, no re-bucketing.
Conversion tracking
Orders, cart adds, and custom events you define. Significance is computed per variant against the confidence level you set: 90, 95, or 99 percent.
Audience targeting
Include or exclude URLs by substring, limit a test to specific countries, devices, or visitor types. Visitors outside the rules see the unchanged page and never count toward results.
Preview links
Every draft test has a signed preview link. Open it in a new tab to see a variant on the live storefront before you activate the test.
Custom events
Define your own event names in the admin, publish them from theme code, and the web pixel forwards them. Counts and rates show up per variant.
Works out of the box. A developer or AI coding agent can extend it through the documented data attributes and custom-event vocabulary if you need something custom.
How it works
-
Step 1
Create a test in the admin
Name the test, define your variants, pick a confidence level, and choose what counts as a conversion. Tests start as drafts so you can preview them.
-
Step 2
Mark up your theme
Add
data-split-idanddata-split-variantto elements you want to vary. You can swap whole blocks, change classes, or apply inline styles without duplicating markup. -
Step 3
Preview, then activate
Open the preview link to confirm the variant renders the way you expect. When you are happy with it, activate the test. Visitors start getting bucketed immediately and results stream into the admin in real time.
-
Step 4
Read the results
Each variant gets a conversion rate, sample size, and a significance verdict against your confidence level. The admin tells you when there is enough data to call the test and what to do with the winner.
Frequently asked questions
Does this work with any Shopify theme?
Yes. The app installs a theme app block that injects a small script in the head on every storefront page. Variants are driven by data attributes you add directly to your theme markup. There is no theme rewrite and no framework requirement.
Do I need Shopify Plus?
No. Simple Split Testing works on every Shopify plan.
Will my page flash the wrong variant before the right one loads?
No. The script hides the page for the few hundred milliseconds it takes to fetch a visitor's assignment, then reveals it once the variant is applied. A safety timeout reveals the page if the fetch fails so a broken script can never keep your storefront blank.
How are visitors bucketed?
On their first eligible page view, each visitor gets a sticky assignment for each active test. The assignment is cached in a 90-day first-party cookie and stamped onto their cart, so it survives page loads and the checkout. Orders are tied back via a cart attribute for revenue attribution within the cookie's lifetime.
What can I A/B test?
Anything in your theme HTML. Headlines, hero images, button labels, prices, CTAs, banners, layout changes. You can swap entire elements, toggle CSS classes, or apply inline styles per variant. For inserted content, wrap it in a template tag and the script unwraps it for the assigned variant.
How is significance calculated?
Rate metrics (conversion rate, add-to-cart rate) use a two-proportion z-test. AOV uses a Welch t-test. You pick the confidence level (90, 95, or 99 percent) when you create the test. Multi-variant tests get an automatic Bonferroni correction. The admin labels each variant as strong, moderate, low, or inconclusive, and tells you roughly how many more sessions to gather when the verdict is still moderate or low.
Can I run more than one test at a time?
Yes. Visitors get an independent assignment for each active test, so two tests on the same page do not interfere. Plan limits apply to the number of concurrently active tests.
Does it slow down my storefront?
The embed script is small and the assignment lookup is cached. When no tests are running it short-circuits before any network call, so an installed-but-idle app costs you nothing on every page view.
Still have questions?
contact@culsin.com →Install Simple Split Testing
Add the app from the Shopify App Store, enable the theme embed, and you can ship your first test in minutes.
Install on Shopify →