Theme Tests – How to Set Up
This guide walks you through setting up a Theme Test in Eraya, from creating your test to launching it live on your store.
Step 1: Name and Description
In this step, you define the identity and purpose of your test.
Fields:
Test Name: Choose a clear, descriptive name for your Theme Test (e.g., Homepage Layout Experiment).
Description (Optional): Write your hypothesis or goals. Example:
“We believe that updating the homepage banner layout will increase add-to-cart rate by 10%.”
Click Next once completed.
Step 2: Configure Test Variations
Set up the test variations and control traffic allocation.
Fields:
Control: The live version of your store (baseline).
Variation 1: The modified version of your theme.
Traffic Allocation: Divide visitor traffic (default 50/50).
💡 You can use Auto-Distribute to balance traffic between all variations. Currently, up to one variation can be tested at a time.
Click Next to continue.
Step 3: Configure Theme Test
Select which themes to associate with each variation.
Control Theme: Automatically set to your published Shopify theme.
Variation Theme: Select your edited or alternate theme version for testing. Make sure this theme includes all required features, apps, and code snippets (including the Eraya Script).
Click Next to proceed.
Step 4: Targeting
Define who should see each version of the theme.
Device Targeting
Choose the devices included in the test:
✅ Mobile
✅ Desktop
✅ Tablet
Or select All Devices
Visitor Type
All Visitors – Default option (recommended)
New Visitors Only – Ideal for first-impression tests
Returning Visitors Only – For evaluating changes on existing customers
Click Next to continue.
Step 5: Review & Launch
Review all your configuration details before starting the test.
Review Sections:
Test Details – Confirms name and description
Theme Configuration – Displays selected themes and their traffic percentages
Targeting – Lists selected devices and visitor filters
When everything looks correct, click Launch Test to start.
After Launch
Once launched:
Eraya automatically splits traffic according to your allocation.
Analytics begin tracking immediately — including conversion, engagement, and revenue.
You can monitor performance from the Analytics Dashboard.
Tips for Successful Theme Tests
Ensure both the control and variation themes have Eraya Script enabled.
Keep only one active Theme Test at a time.
Run each test for a statistically valid duration (at least 2–3 weeks of traffic).
Apply winning changes to your live theme once results are conclusive.
Last updated