What Does Apples to Apples mean?
Simply put “apples to apples” in this case means you are taking multiple creative that look exactly the same in every way, shape and form except one single variable and testing them against each other. This one single variable is the most important part of the testing methodology and could lead to 25-50% improvement in your marketing campaigns (see below).

Control Creative
So as you can see above all your creative remain the same except for that one variable. In this case the background square highlighting the silhouette of the girl changes and everything else stays the same. Although this seems like a simple example, the testing method is simple by nature. As you can see below one creative is the clear winner with an increase click through rate (CTR) of one hundred and thirty percent, not bad for your first test.

 
Statistically Relevant Sample Size
The sample size is the number of impressions you run against your creative. Different creative sizes have different statistical relevant thresholds. Here are the thresholds:

425×600 – 500,000 – 750,000 impressions
300×250 – 750,000 to 1 MM impressions
160×600 – 800,000 – 1 MM impressions
120×600 – 900,000 – 1.1 MM impressions
728×90 – 1 MM – 1.2 MM impressions
468×60 – 1 MM – 1.5 MM impressions

In this case you need to test all of your creative at the same volume of impressions. For example: If you have four different creatives measuring 300×250 in size you would run the control creative at 55% while running the other three at 15% till you reach the statistically relevant number above. The reason you keep the control running at a higher level of 55% is to maintain a successful campaign while you test. Just because your testing doesn’t mean you should sacrifice the already proven success of your control, you might end up finding out the control beats all of your tests in the end anyway (this happens quite often actually). If you can’t afford the amount of impressions it takes to run a 4 creative test then just reduce the amount of test creative you run at one time. This will allow you to garner results at a faster rate which will turn into dollars before you know it.

Call To Action
You need to test your call to action just as much as you test different layouts, background colors and button colors. Think about what you want your customer to do:
“Watch Now”
“Buy Now”
“Register Now”
You need to have your call to action very clear and concise so that the customer doesn’t have a chance to forget what you want them to do. Don’t forget when your testing your call to action, you can’t be testing anything else at the same time. You need to isolate one variable at a time or you will never know if it was that change that made the difference.

Landing Page
When you’re creative testing you should send all of your users to the same landing page which is consistent with your creative’s look and feel. Consistency in your messaging along with the same look and feel can increase your conversions up to 35%. Again don’t forget, you can only isolate one variable at a time. If you test landing pages at the same time you are testing creative you will never know if it was truly your creative that made people perform the action you are asking them to perform or was it the landing page? That’s why isolating this one variable at a time method works so well, you know what you changed and you know if that one thing made a difference.

I hope this simple “Apples to Apples” creative testing explanation helps you and your marketing efforts in the future. feel free to post any questions and happy testing.