Theme Tests – How to Set Up

This guide walks you through setting up a Theme Test in Eraya, from creating your test to launching it live on your store.

---

Step 1: Name and Description

In this step, you define the identity and purpose of your test.

Fields:

• Test Name: Choose a clear, descriptive name for your Theme Test (e.g., Homepage Layout Experiment).

• Description (Optional): Write your hypothesis or goals. Example:

  “We believe that updating the homepage banner layout will increase add-to-cart rate by 10%.”

Click Next once completed.

---

Step 2: Configure Test Variations

Set up the test variations and control traffic allocation.

Fields:

• Control: The live version of your store (baseline).

• Variation 1: The modified version of your theme.

• Traffic Allocation: Divide visitor traffic (default 50/50).

💡 You can use Auto-Distribute to balance traffic between all variations. Currently, up to one variation can be tested at a time.

Click Next to continue.

---

Step 3: Configure Theme Test

Select which themes to associate with each variation.

• Control Theme: Automatically set to your published Shopify theme.

• Variation Theme: Select your edited or alternate theme version for testing. Make sure this theme includes all required features, apps, and code snippets (including the Eraya Script).

Click Next to proceed.

---

Step 4: Targeting

Define who should see each version of the theme.

Device Targeting

Choose the devices included in the test:

• ✅ Mobile

• ✅ Desktop

• ✅ Tablet

• Or select All Devices

Visitor Type

• All Visitors – Default option (recommended)

• New Visitors Only – Ideal for first-impression tests

• Returning Visitors Only – For evaluating changes on existing customers

Click Next to continue.

---

Step 5: Review & Launch

Review all your configuration details before starting the test.

Review Sections:

• Test Details – Confirms name and description

• Theme Configuration – Displays selected themes and their traffic percentages

• Targeting – Lists selected devices and visitor filters

When everything looks correct, click Launch Test to start.

---

After Launch

Once launched:

• Eraya automatically splits traffic according to your allocation.

• Analytics begin tracking immediately — including conversion, engagement, and revenue.

• You can monitor performance from the Analytics Dashboard.

---

Tips for Successful Theme Tests

• Ensure both the control and variation themes have Eraya Script enabled.

• Keep only one active Theme Test at a time.

• Run each test for a statistically valid duration (at least 2–3 weeks of traffic).

• Apply winning changes to your live theme once results are conclusive.