Tests

Test what sells, on real shoppers

Tests is the Zyro part that shows half your shoppers a new version of a page or product. Zyro tells you when one version is clearly better. It also stops a version that is clearly losing.

  • Starter and up. From $47 a month.
Add to Shopify, free See plans

Free plan. No card. Billed through Shopify. Uninstall and billing stops.

Tests
A Zyro title test on a demo store: Linen Overshirt against Linen Overshirt, Breathable. Version 2 has an early lead, 98% sure, from 24 against 12 conversions on day 10.

The real Zyro app, shown on a demo store.

What is an A/B test?

An A/B test shows two versions of something to different shoppers. Then it counts which one sells more. Zyro splits visitors 50/50, and the split stays 50/50 for the whole test.

What you can test

  • Product titles, descriptions and photos

    Start a test from Zyro's Products page, or from the "Zyro tests" block on Shopify's own product page. Half your shoppers see the new version.

  • Another layout your theme already has

    Show half your shoppers a different template from your theme. Shopify stores only.

  • A page

    Change a headline or an image, send shoppers to a whole new page, or test your own code.

  • What Zyro does not test

    Zyro does not test prices, coupons, shipping thresholds or whole themes.

How Zyro calls a winner

Zyro shows each version's chance to beat the original. It calls a winner only when all of this is true:

  • Zyro is over 95% sure.
  • The test has run for 7 full days.
  • The lead has held for 3 days in a row.
  • The leading version and your original each have at least 30 buyers.

Before that, a lead is only an "early lead". Zyro warns you if a "winner" earns less per visitor. It also checks that the split really was 50/50.

The full rules
TestsDemo store
Zyro's Tests screen on a demo store: a photo, a description and a title test running, with their status, and 3 winners kept in 90 days.

Results by traffic source

Zyro checks every test for each traffic source, so you can see each source's result.

A losing version is stopped

Zyro checks each test every hour. If it is 95% sure your old version is better, it stops showing the new one.

Keep the winner

Keep a winning product test, and Zyro can save it to the product in Shopify. It does this only if you allow it, and you can undo it.

Auto-pick winner

Growth and Scale

Turn on Auto-pick winner for a test. When the result says "Winner", Zyro ends the test and keeps the winner for you. It never moves more shoppers to one version during the test.

Careful tests Growth and Scale

Careful tests wait for at least 2 weeks and 50 buyers per version before a verdict.

Help with ideas

Starter and up

AI can write 3 versions of your words in your brand's style. It can change a line when you ask, or suggest 4 test ideas for a page. It never adds a price, number, deadline or promise your page does not already make. Fair use is 60 requests a store a day.

Headline suggestions

This is off until you turn it on. Zyro picks a busy page you have not tested, with 200 or more real visits in 30 days. AI writes 2 new main headlines. Zyro then drafts the test for you to start, or starts it for you.

At most 2 of these tests run at once, with one new idea every 6 hours. It changes the main headline only. Starting tests for you on Shopify needs Growth or Scale.

Choose who sees a test

Starter and up

Show a test only to some shoppers: by device, country, campaign, where they came from, or new and returning shoppers.

How many tests each plan runs

  • Starter: 15 live tests at once, up to 15 versions each.
  • Growth: 50 live tests, up to 20 versions each, plus Auto-pick winner and Careful tests.
  • Scale: 250 live tests, up to 25 versions each.
See plans and prices

Questions about Tests

Is testing on the Free plan?

No. Tests start on Starter, at $47 a month. The Free plan shows your profit, sales by channel and store alerts.

How long does a test take?

At least 7 full days, and the lead must hold for 3 days in a row. Quiet stores take longer, because Zyro also needs enough visitors and buyers.

Can Zyro test prices?

No. Zyro does not test prices, coupons, shipping thresholds or whole themes.

Does Zyro send more shoppers to the winning version?

No. The split stays 50/50 until the test ends.

Will a test change my products?

Only when you keep a winner and allow Zyro to write it back. You can undo it.

Does AI pick the winner?

No. Winners follow fixed rules: over 95% sure, 7 full days, a 3-day hold, and enough visitors and buyers.

More from Zyro

Find out what sells, with real shoppers

Add to Shopify, free See plans

Free plan. No card. Billed through Shopify. Uninstall and billing stops.