[New feature] Spend X Get Y – now with tiered rewards! ⭐️

Shopify AB Testing: How to do it right, best practices, and examples

Table of Contents

Shopify AB testing: If you’ve never heard of AB testing and don’t know why it’s important for your Shopify store – you’re in the right place! AB testing may sound technical and complicated, but this is actually a really simple concept that can have a big impact on your e-commerce success. Read on to learn everything you need to know about Shopify AB testing for your store.

What is Shopify AB testing?

AB testing is sometimes called split-run or bucket testing. Simply put, it’s a user-experience test method that allows you to compare two distinct elements, option A and option B. 

If we think specifically about what is Shopify in e-commerce terms, Shopify AB testing may help you to compare two versions of a landing page, or two different product page layouts, in order to see which results in more conversions. Completing rigorous Shopify AB testing helps provide you with the peace of mind that your store design is optimal for driving conversions.

Who should perform Shopify AB testing?

AB testing can benefit just about anyone with an e-commerce store. Even if you’re happy with your conversion rates, Shopify AB testing can help improve other elements of your store that may be slowing you down, such as your ad return, cart abandonment, or hits on specific products or collections. No matter what your e-commerce industry is, Shopify AB testing helps you to create the best possible version of your store.

While there is ample data to support the benefits of AB testing for large e-commerce businesses, small stores can also benefit. If you’re just starting out, make sure you’re getting the most for your money by using Shopify AB testing for as many store elements as possible – it will help you to better understand your customers and their needs.

Why is Shopify AB testing so crucial for your store’s success?

If you’re not yet convinced in the power of AB testing, take a look at Amazon. Although it’s hard to believe, this e-commerce giant was a fairly ordinary website selling books not too long ago. Now the largest e-commerce retailer in the world, much of Amazon’s success can be credited to its constant testing and experimenting. Many of Amazon’s key features, such as 1-click ordering, re-order buttons, powerful product recommendation engines, and two-day shipping all went through rigorous AB testing to ensure their success.

If you’re still not convinced, let’s take a look at an example of AB testing in action. This simple test compared the effects of a red call to action button against a green one – everything else on the page remained exactly the same.

shopify ab testing
Source: blog.hubspot.com/blog/tabid/6307/bid/20566/the-button-color-a-b-test-red-beats-green.aspx

Their results were fairly staggering. The buttons were tested across 2,000 store visits over several days, and the red button outperformed the green by 21%. The drastic difference between the two buttons should provide you with some idea of just how important Shopify AB testing can be – by optimizing each page in your store you can significantly increase your downstream traffic.

Even for a small store, a Shopify AB testing app can have profound, lasting effects on not just your conversions but on other elements such as customer satisfaction and loyalty.

Shopify AB testing examples and real-world applications

There are plenty of great examples of AB testing out there, some of which you may be able to apply to your own store. It’s important to realize that AB testing needs to be performed on a case-by-case basis – your customers are unique and you may see completely different results compared to an AB test carried out with a different audience. Here are some case studies of real AB testing scenarios:

1. Humana

Humana is a US-based insurance provider that carried out one of the best webpage examples of A/B testing. They tested two versions of a banner that featured a simple headline, an image, and a call to action.

shopify ab testing
Source: blog.hubspot.com/marketing/a-b-testing-experiments-examples

As you can see, the treatment banner featured a different image, much less text, and a stronger call to action. Staggeringly, the simple changes in this version resulted in a 433% increase in clickthroughs!

2. Netflix

If you find yourself browsing through Netflix’s offerings again and again (don’t worry – we all do it), you may notice that the powerhouse streaming service sometimes changes the artwork accompanying each show/movie.

shopify ab testing
Source: netflixtechblog.com/selecting-the-best-artwork-for-videos-through-a-b-testing-f6155c4595f6

Netflix relies heavily on A/B testing to find artwork that appeals to the largest number of customers. In fact, they have conducted so many A/B tests that they have been able to detect trends that allows them to more rapidly identify and create artwork that will best engage their viewers.

3. Zalora

Fashion retailer Zalora was determined to optimize their e-commerce product pages to result in a greater checkout rate. They found that by changing the design of their product pages to focus on some attractive features like free shipping and returns, they could increase their checkout rate by 12.3%.

They tested two new product page versions against their control:

shopify ab testing
Source: vwo.com/success-stories/zalora/
Source: vwo.com/success-stories/zalora/

After extensive testing, Zalora found that Variation 1 was a better performer than both the control and variation 2. As you can see, this variation easily highlights the free delivery and return features of Zalora purchases, which was likely a big reason for the increase in conversions.

4. Designhill.com

AB testing isn’t just a tool for your e-commerce store. You can use Shopify AB testing for all elements of your online presence, including your email and SMS marketing campaigns. When it comes to A/B testing for these campaigns, you’re looking to find options that result in the highest number of opens and clickthrough rates. One of the best examples of AB testing for email marketing is from Designhill.com, which tested different versions of an email’s subject line.

shopify ab testing
Source: abtasty.com/blog/learn-from-5-ab-test-case-studies/

By using fewer words and eliminating the “Check out My Recent Post” portion of the text, emails with the shorter subject saw a 2.6% increase in open rates and an almost 6% increase in clickthroughs. This highlights the importance of email subjects – it’s the first thing your customer sees and plays a huge role in whether or not they open the email – choose your words carefully!

Shopify AB testing and upselling

Upselling is a really important part of any successful e-commerce store, but it won’t work as effectively if you’re not AB testing your upselling offers. As explained with the examples above, you can dramatically increase the number of clickthroughs by ensuring you use the best images, wording, and layout of your upselling offers. 

Investing in a Shopify AB testing app is extremely worthwhile if you’re looking to grow and optimize your store. Given the complexity of sales and upselling psychology, and the fact that what has worked for others might not necessarily work for your specific customer base, performing your own AB tests is essential when it comes to optimizing your product deals and offers. 

Shopify AB testing with PickyStory

Adding PickyStory to your Shopify store generates more revenue from every store visit through upselling features like Shop the LookProduct Bundles, and Product Kits. When you integrate these features into your store, it’s beneficial to then use a Shopify AB testing app to optimize these features and make the most highly desirable to your specific customer base. Luckily, PickyStory is highly customizable – you can change the colors and style of the app to best suit your brand, and to facilitate AB testing.

For example, you can perform Shopify AB testing on product bundles to first determine the most effective products to bundle together. Add varying complementary products to the initial product the customer is viewing and evaluate which additional products are most frequently added to carts.

You can conduct similar AB tests for your store’s shoppable looks. Try testing different colored button options, different placements of your shop the look button, or even different text (for example, “shop the look” vs. “buy the look”). Although they may seem insignificant, these details can have a huge impact when it comes to conversions.

Shopify AB testing: Don’t overlook the benefits for your store

Shopify AB testing is relatively simple to perform, but can generate a huge amount of helpful data that will allow you to optimize your store. By testing everything from homepage banners to different selections of product images, you will learn valuable information about your customers that can ensure your e-commerce success well into the future.

Boost your revenue & AOV with PickyStory

Personalize and offer deals just in time with PickyStory

Back to top
pickystory

Book a demo to learn more about PickyStory's e-commerce upsell platform

By entering your email, you agree to receive marketing emails from PickyStory.


Trusted by the fastest-growing
e-commerce brands

vertical logos
Icon

Not enough sales?

Capture every drop of revenue with PickyStory's complete upsell platform.

See the MAGIC Live

PickyStory in action

Frequently Bought Together

Present bundles of products that are frequently purchased together, simplifying the decision-making process for your customers

What is Frequently Bought Together?

It is a recommendation scenario that suggests additional products to the shopper, which are often purchased by other customers in conjunction with the item they are currently viewing or considering purchasing.

Why are brands using it?

How Zenbivy uses Frequently Bought Together

Zenbivy simplifies the shopping experience by displaying all the needed pieces of its sleeping systems on one page, under each product that is part of a sleeping system. This way, shoppers don't need to go through multiple pages and guess what goes with what. Zenbivy enjoys much larger orders, and shoppers can have a seamless experience.

www.zenbivy.com

Create Frequently Bought Together

Build Your Own Bundle

Offer shoppers the ability to create their own bundle of products by selecting from a range of available options

What is Build Your Own Bundle?

Build Your Own Bundle scenario provides shoppers with the flexibility to select specific items or features that best meet their individual needs and preferences. The selection is based on a pre-curated set of products by the merchant.

Why are brands using it?

How Prodigy uses Build Your Own Bundle

Prodigy enables its shoppers to build their own bundle of golf discs, fully personalizing the shopping experience. Shoppers get an easy way to select their favorite discs while Prodigy consistently increases its AOV.

www.prodigystore.eu

Create Build Your Own Bundle

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Gravity Fitness uses Bundle as Product

Gravity Fitness knows that it's not an easy task for shoppers to collect all the required pieces for a complete home gym. That's why they have created pre-made home gym bundles for an easy shopping experience. Now they have fewer SKU issues, a higher AOV, and happier customers.

www.gravity.fitness

Create Bundle as product

Complete the Bundle

Encourage shoppers to add the missing items to complete the bundle when they add items to cart

What is Complete the Bundle?

Complete the Bundle popup is a deal that appears when a shopper has added some items to their shopping cart but has not yet added all the recommended or related products that typically go together.

Why are brands using it?

How Petliking.com uses Complete the Bundle

Petliking.com never misses an opportunity to offer more products to its shoppers after they add an item to cart. By offering to complete the bundle, Petliking.com helps shoppers to discover additional related items that complement each other while increasing its order size.

www.petliking.com

Create Complete the Bundle

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Doodle Couture uses Bundle as Product

Doodle Couture makes it so easy for shoppers to equip their best friend with the required outfit. Instead of moving back and forth between pages, Doodle Couture offer a complete bundle for pets on one page with a single click. This boosts AOV while making the shopper happy.

www.doodlecouture.com

Create Bundle as product

Complete the Bundle

Encourage shoppers to add the missing items to complete the bundle when they add items to cart

What is Complete the Bundle?

Complete the Bundle popup is a deal that appears when a shopper has added some items to their shopping cart but has not yet added all the recommended or related products that typically go together.

Why are brands using it?

How A&D Performance uses Complete the Bundle

A&D Performance always seizes intent-based opportunities to offer additional supplements when shoppers add items to their cart. By displaying a 'Complete the Bundle' popup, A&D Performance increases their Average Order Value (AOV) while helping their customers discover more products.

www.andperformance.com

Create Complete the Bundle

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Koala Babycare uses Bundle as Product

Koala Babycare simplifies its shoppers lives by offering complete cream & oil sets. Shoppers can easily pick their favorite bundles and save while Koala Babycare increases its AOV and number of orders.

www.koalababycare.com

Create Bundle as product

Spend X Get Y

Encourage shoppers to spend a certain amount of money (X) in order to receive a specific benefit or reward (Y)

What is Spend X Get Y?

"Spend X, Get Y" promotions are designed to motivate shoppers to spend more money with the promise of receiving something valuable in return. It's a win-win situation where customers get a benefit, and the store increases its sales.

Why are brands using it?

How Jose Pizarro uses Spend X Get Y

Jose Pizarro takes advantage of PickyCart and 'Spend X Get Y' to reward shoppers with free shipping when they spend £75 in-store. This is a win-win offer for both sides - while Jose Pizarro increases the AOV, shoppers receive a sweet reward.

www.josepizarro.com

Create Spend X Get Y

Complete the Bundle

Encourage shoppers to add the missing items to complete the bundle when they add items to cart

What is Complete the Bundle?

Complete the Bundle popup is a deal that appears when a shopper has added some items to their shopping cart but has not yet added all the recommended or related products that typically go together.

Why are brands using it?

How Agrestis uses Complete the Bundle

Agrestis makes sure to consistently display a variety of spirits to their shoppers at the right moment. As shoppers add spirits to the cart, Agrestis extends an offer to include more related spirits, resulting in an improved shopping experience and a higher Average Order Value (AOV).

www.stagrestis.com

Create Complete the Bundle

Build Your Own Bundle

Offer shoppers the ability to create their own bundle of products by selecting from a range of available options

What is Build Your Own Bundle?

Build Your Own Bundle scenario provides shoppers with the flexibility to select specific items or features that best meet their individual needs and preferences. The selection is based on a pre-curated set of products by the merchant.

Why are brands using it?

How Wisdom Foods uses Build Your Own Bundle

Wisdom Foods wanted to upgrade its shopping experience by making it easy for shoppers to pick their desired syrups. Now it allows shoppers to build their own bundles of syrups from a single page and checking out. This increases Wisdom Foods' order sizes while providing a personalized experience to their shoppers.

www.wisdomfoods.com.au

Create Build Your Own Bundle

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Dineamic uses Bundle as Product

Dineamic takes advantage of bundles to package their pre-made meals by dietary requirements, so every shopper can quickly and easily find the desired category of meals and add them all with a single click. This simplifies the shopping experience and benefits both sides, as Dineamic boosts its Average Order Value (AOV).

www.dineamic.com.au

Create Bundle as product

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Line Furniture uses Bundle as Product

Line furniture simplifies its shoppers lives by offering complete furniture sets in different styles. Now shoppers can easily find their favorite living room and save while Line Furniture increases its AOV and number of orders.

www.linefurniture.se

Create Bundle as product

Complete the Bundle

Encourage shoppers to add the missing items to complete the bundle when they add items to cart

What is Complete the Bundle?

Complete the Bundle popup is a deal that appears when a shopper has added some items to their shopping cart but has not yet added all the recommended or related products that typically go together.

Why are brands using it?

How Sobel Home uses Complete the Bundle

Sobel Home never misses an opportunity to offer more products to its shoppers after they add an item to cart. By offering to complete the bundle, Sobel Home helps shoppers to discover additional related items that complement each other while increasing its order size.

www.sobelathome.com

Create Complete the Bundle

Frequently Bought Together

Present bundles of products that are frequently purchased together, simplifying the decision-making process for your customers

What is Frequently Bought Together?

It is a recommendation scenario that suggests additional products to the shopper, which are often purchased by other customers in conjunction with the item they are currently viewing or considering purchasing.

Why are brands using it?

How By Benson uses Frequently Bought Together

By Benson never misses an opportunity to offer more options to its customers. While shoppers visit their product pages, they constantly offer to extend or upgrade the targeted product, resulting in better service and larger orders.

www.bybenson.com

Create Frequently Bought Together

Build Your Own Bundle

Offer shoppers the ability to create their own bundle of products by selecting from a range of available options

What is Build Your Own Bundle?

Build Your Own Bundle scenario provides shoppers with the flexibility to select specific items or features that best meet their individual needs and preferences. The selection is based on a pre-curated set of products by the merchant.

Why are brands using it?

How By Benson uses Build Your Own Bundle

As a professional destination for home gardeners, By Benson understands that it might be tricky to select all the necessary tools to make your garden shine. That's why By Benson helps its shoppers choose bundles of tools with a single click, while boosting their Average Order Value (AOV).

www.bybenson.com

Create Build Your Own Bundle

Build Your Own Bundle

Offer shoppers the ability to create their own bundle of products by selecting from a range of available options

What is Build Your Own Bundle?

Build Your Own Bundle scenario provides shoppers with the flexibility to select specific items or features that best meet their individual needs and preferences. The selection is based on a pre-curated set of products by the merchant.

Why are brands using it?

How Good Store uses Build Your Own Bundle

Good Store encourages its shoppers to build their own custom bundles of soaps. They provide a variety of soaps to choose from and leave the selection itself to the shopper. This is fun, rewarding, and makes both sides happy.

www.good.store

Create Build Your Own Bundle

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How Westman Atelier uses Bundle as Product

Westman Atelier understands that the attention span of the average shopper is quite short. Furthermore, with numerous options available, it's often easier to opt for a suggested bundle that's already curated for you.

www.westman-atelier.com

Create Bundle as product

Frequently Bought Together

Present bundles of products that are frequently purchased together, simplifying the decision-making process for your customers

What is Frequently Bought Together?

It is a recommendation scenario that suggests additional products to the shopper, which are often purchased by other customers in conjunction with the item they are currently viewing or considering purchasing.

Why are brands using it?

How Aim’n uses Frequently Bought Together

Aim'n never misses a shopper when it comes to its product pages. It utilizes the 'Frequently Bought Together' feature to suggest additional sizes to product viewers, ensuring that no shopper is left without a solution while keeping its main sizes as the default option.

www.aimn.se

Create Frequently Bought Together

Bundle as Product

Combine multiple individual products into a bundle and sell them as a single unit

What is Bundle as Product?

Bundle as Product scenario involves bundling multiple individual products together and selling them as a single unit. This strategy offers shoppers a curated selection of items that work together or complement each other.

Why are brands using it?

How BLANQI uses Bundle as Product

BLANQI make it easy for their shoppers to find complete maternity sets. While shoppers receive a fast, single-click shopping experience, BLANQI enjoys higher order amounts without investing any additional resources.

www.blanqi.com

Create Bundle as product

Build Your Own Bundle

Offer shoppers the ability to create their own bundle of products by selecting from a range of available options

What is Build Your Own Bundle?

Build Your Own Bundle scenario provides shoppers with the flexibility to select specific items or features that best meet their individual needs and preferences. The selection is based on a pre-curated set of products by the merchant.

Why are brands using it?

How Carly Jean uses Build Your Own Bundle

Carly Jean offers its shoppers the opportunity to build their own custom looks by selecting the individual items that comprise their desired outfit. 'Build Your Own Bundle' enables Carly Jean to easily provide a personalized experience that shoppers love and want to return to again and again.

www.carlyjeanlosangeles.com

Create Build Your Own Bundle

Spend X Get Y

Encourage shoppers to spend a certain amount of money (X) in order to receive a specific benefit or reward (Y)

What is Spend X Get Y?

"Spend X, Get Y" promotions are designed to motivate shoppers to spend more money with the promise of receiving something valuable in return. It's a win-win situation where customers get a benefit, and the store increases its sales.

Why are brands using it?

How Proclamation Jewelry uses Spend X Get Y

Proclamation Jewelry encourages its shoppers to spend at least $500 on jewelry in-store to receive free shipping. This is a win-win for both the shoppers, who get free shipping (which can be expensive at times), and the brand, which maintains a higher average order value.

www.proclamationjewelry.com

Create Spend X Get Y

pickystory

Get matched with the right partner. PickyStory will do all the work to connect you with one of our awesome partners.

Trusted by the fastest-growing
e-commerce brands

vertical logos
pickystory

Convert more visitors into buyers with PickyStory's e-commerce conversion platform

By entering your email, you agree to receive marketing emails from PickyStory.


Trusted by the fastest-growing e-commerce brands