# A/B Testing on Shopify

# Introduction

Implementing any new technology on Shopify should have a positive return on investment (ROI) and justifiable total cost of ownership (TCO). For product discovery solutions in particular, this validation often comes through A/B testing themes against each other, but not all metrics are created equal when measuring the impact of product ranking and relevance.

# Key Metrics

# Revenue Per Visitor (RPV)

Revenue Per Visitor (RPV) measures the average amount of revenue generated for every unique visitor to your Shopify storefront. It directly reflects the overall monetary effectiveness of your traffic and user experience.

# Conversion Rate (CVR)

Conversion Rate (CVR) is the percentage of visitors who complete a purchase. It indicates how effectively your site persuades visitors to achieve this goal.

# Add-to-Cart Rate (ATC)

Add-to-Cart Rate (ATC) represents the percentage of visitors who add at least one item to their shopping cart during their session. This metric signals product interest and is a key step towards a potential conversion.

# Understanding These Metrics

While conversion rate (CVR) indicates if more visitors are making a purchase, revenue per visitor (RPV) is more important for product discovery A/B tests because it reflects the total value generated. Add-to-Cart rates can help indicate higher search relevance for specific queries or collection pages.

Product discovery solutions can increase CVR by guiding users to cheaper or less relevant items, which could actually decrease overall revenue. RPV, however, directly measures whether the changes are leading to higher-value engagement and purchases, providing a truer picture of business impact and profitability.

# A/B Testing Partners

We've partnered with several leading A/B testing solutions in the Shopify ecosystem to help you measure the success (or failure) of Vertex AI Search for Commerce on your storefront using a neutral third party.

# Shoplift

# Intelligems

# Visually

# Convert