A/B tests are on Starter, Growth and Scale. By default, half your visitors see your current page and half see the new version, and the sales decide. Install Zyro first.
Steps
- Start a test. Open Tests in the left menu and choose New test.
- Set it up. Choose what to test: text and headlines, images, page actions or advanced HTML. Name the test and pick the goal it should improve. Then choose the page and point at the element with the visual picker.
- Make your version. On Variants, create the new version. Your current page stays as the original.
- Launch. The launch settings are optional. By default everyone is included and traffic splits 50/50. Choose Launch test, or Save as draft to finish later.
- Read the result. Open the test from Tests. Until there's enough data it says Too early to call and shows what it still needs. When a version wins, choose End test & keep it, and Zyro keeps showing that version.
If a new version is clearly losing sales, Zyro pauses it for new visitors and says so on the result page. It waits at least 3 days, and for real traffic on both versions, before it steps in.
What each plan adds
- Starter runs up to 15 tests at once, Growth 50 and Scale 250.
- Growth and Scale add Bayesian results, which show how likely each version is to win, and bandit tests, which send more visitors to the leading version as results come in.
- On Shopify, open Tests in the Zyro app to test product titles, descriptions and photos.
If it doesn't work
- "This test isn't reaching visitors." The page address on the test usually doesn't match the one shoppers visit. Choose Check the page address on the result.
- No visitors at all. Make sure Zyro is installed on that page. See Zyro stopped seeing visits.
- You can't launch another test. All your live test slots are in use. End a test, or move to a plan that runs more.
- You can see tests but not launch them. Contributors and Viewers can't run tests. Ask the Owner, an Admin or a Manager.
Related articles