5 Crafty Ways to Split Test Your Google Shopping Ads

One of the best ways to increase your profitability? A/B split testing. Google Ads has a feature called the Experiments where you can create custom experiments for your campaigns and compare how your test group performs against your original campaigns (control group) over time.

Only problem is, this is only available for Search and Display campaigns. Not for Shopping. Luckily, I’ve come up with five ways you can test multiple variations of your Shopping campaigns, which is what we’ll be diving into in this post.

How to A/B test product information

A/B testing product information like titles, images, or extensions can be useful for optimizing your product feed

This can be done in the set-up of your feed, either via a feed management tool or manually in Google Merchant Center. Once you’ve decided what you want to test, you’ll need to create equal groups of products. This can be done in several ways, I mainly use the following two methods:

1. The cluster analysis method

With a cluster analysis you’ll divide based on historical performance (e.g., dividing your products into equal groups based on metrics like clicks, revenue, costs, and conversion value). You can do this via spreadsheet for smaller datasets or in R (or other programming languages) for larger datasets.

2. The random split method

A random split can be done based on the ID of your product. For example, if you use numeric values as product IDs, you can assign group A to all even numbers and B to all uneven numbers.

The most important thing while splitting your products is to make sure that all groups of your experiment have an equal number of products and that your key metrics are also very close.

Once you’ve made the split, make the changes to the product IDs in your test group. Make sure you’re able to report on all of your product IDs and corresponding groups. This way you can analyze them and find winners. Below you can find an example of how this would look in your feed.

How to A/B test campaign settings

If you want to split test campaign settings like ROAS, targeting, or different campaign types, you’ll need to make splits based on something other than product IDs. Ideally, you’ll want to offer the same products in both your control and test groups because performance can vary by product. There are three different splits you can make to test your settings. Just like the test set-up on product content, creating equal groups is key. With all methods, you need to do the data cluster analysis yourself. Create two or more equal groups and analyze based on the differences.

3. The Customer Match split method

With Customer Match, you can target first-party audiences in Google Ads. It works by uploading a list of email addresses from your existing database that you want to target, and Google will match those email addresses to Google accounts.

How to do it

If you’re using Customer Match, you should be able to create a cookie split in your CRM software.  Then you can create two different campaigns using two different Google Customer Match Audiences. Change the setting that you want to test in your test campaign, and keep everything else the same in your control campaign. And that’s it.

Note: If you’re using Customer Match, make sure you have a third campaign running for all potential customers that are not inside of your database. This way you don’t lose any potential conversions.

Image source

Pros

• Random split: By splitting cookies you actually have a random split which is often used in other A/B tests.
• Reliable data: Because of the random split, the results are reliable and reproducible.

Cons

• Hard to implement: Not every advertiser has the resources to implement Customer Match or make the random split in their CRM.
• Not 100% complete: This experiment only applies to existing customers in your database. That means the results aren’t valid for new potential customers.

4. The geo split test method

Geo splits are often used to find incremental uplifts in campaigns. This could answer questions like: Is there incremental value in advertising on branded keywords?

How to do it

In a geo test, a market is divided into smaller geographical regions called geos. Each geo gets assigned either a control or a test group. Users in the test geos are exposed to the changed campaigns while users in the control geos are served the control campaigns. The split can be done on country or region, as long as both regional groups are highly correlated. You’ll need to use the cluster anaysis to determine your groups.

Pros

• Easy to set up: Everyone with a bit of Google Ads experience can set this up.
• Reliable: Since we split the same campaigns, seasonality cannot be an influence.

Cons

• Behavior can vary widely by geo. It’s essential to have two highly correlated groups. Also, seasonality can differ by geo-location. It’s not ideal to compare Alaska with Texas if you sell outdoor gear.
• Somewhat hard to prepare: Cluster analysis on location targeting can be tricky when dealing with smaller geo-locations.

5. The campaign split method

In a campaign split, you simply divide your campaigns or accounts into two highly correlated groups. Both groups need to have an equal number of key metrics like clicks, conversions, and costs.

How to do it

In one group of campaigns (test group), you make the changes while in the control group your current best practices will serve. If you label and track the different groups of campaigns, you can tell something about the differences in performance.

Budget and bidding strategy are two settings you could test.

Pros

• Very easy to set up: You only need to change settings in half of your campaigns and that’s it.

Cons

• Least reliable: Seasonality can play a part in different campaigns, especially if your campaigns are divided by product category (have you tried the priority bidding campaign structure?).
• Preparation can be hard: Cluster analysis on campaign groups can be hard when dealing with smaller sets of campaigns and data.

Final thoughts

That’s it! Five different ways to run A/B tests for your Google Shopping ads:

1. Test product feed attributes, creating groups with a cluster analysis.
2. Test product feed attributes, creating groups with a random split.
3. Test campaign settings with Customer Match groups.
4. Test campaign settings with geos.
5. Test campaign settings with campaign groups

 

The quality of the outcome is dependent on the quality of your preliminary (cluster) analysis and setup. What you get out is what you put in. Hopefully this helps you with the optimization of your Google Shopping campaigns. If you try any of these methods, share the results in the comments! For now, have a wonderful day and keep optimizing!