Optimization Sequence Question

jetto

STRICTLY BUSINESS
Feb 20, 2010
703
5
0
So say I have 3 ads and I'm split-testing each ad not only for CTR but also for conversion because each ad has its own conversion. And then I have 3 LPs that I wanna split-test against each other too.

What's the best way to do this?

Run 3 ads on 1 LP, find the best performer and then run that ad on 3 LPs and find the best LP?

Or run all 3 ads on all 3 LPs at the same time and have 9 subids?
 


Obviously running 3 ads on all 3 lps with different subid's

but then you can also add time and geo tracking too

there really is no limit at how much you can track, the more you can track, the higher your ROI obviously

if you want us to tell you it's ok to just run it the easiest way, then do it, but it will reflect directly on your bottom line ROI. Whether the time and effort is worth maximizing return is completely up to you.
 
there really is no limit at how much you can track, the more you can track, the higher your ROI obviously

WRONG. The more you use the data gained by tracking the higher your ROI. Tracking is not = ROI. Optimization is IF done correctly.
 
You have 2 categories of variables you're looking to test in terms of their optimal performance, the LP and the ad. You will be testing 9 potential configurations. LP1 + ad1, ad2, and ad3, LP2+ad1, ad2, and ad3, and lp3 +ad1, ad2, and ad3. You must account for every possibility. If lp 1 + ad1 does better than lp2 + ad2 then you don't know whether it's the LP that provided the increased CVR or the AD or the combo of both. So you have 9 subids to make basically. If you have your own adserver or google website optimizer or whatever just 33/33/33 rotate the ads with indiv subids and 33/33/33 rotate the lps.

The reason you want 9 subids to begin with is that if you just choose the ad that performs the best on LP1, it
might not perform better than the alternative LP1 ads on LP2, but you'd never know this because you only tested the ad that did best from LP1.

I don't mean to overcomplicate this. Just test the 9 variations so you factor everything into account. That's how multivariate testing is done.

This might be obvious to you, so forgive me if it is, but if you want to compare the LP's alone irrelevant of the ad then just compare lp1+ad1 to lp2+ad1 to lp3+ad1. Keep one variable the same and change the other.

Multivariate testing is this: You have a single ad with 5 typefaces, t1, t2, t3, t4, and t5. You also have 5 different images of a person, p1, p2, p3, p4, and p5. You also have 3 different backround colors, c1, c2, and c3. In order to account for every single variable you must have 5x5x3 tracking IDs. 75 total ids. The big boys track hundreds if not thousands of these potential variables in high level optimization.
 
  • Like
Reactions: jetto
Let me add that CPA publishers, unless you do a lot of work with presells and landers and >$20 dollar payout offers that require presells, need not worry so much about the very intricate optimization variables. However, if you're a corporate level ecommerce site, you better believe you're going to be hiring someone for 100k a year just dedicated to optimizing, tracking, and split testing every little minor detail of your page.
 
You have 2 categories of variables you're looking to test in terms of their optimal performance, the LP and the ad. You will be testing 9 potential configurations. LP1 + ad1, ad2, and ad3, LP2+ad1, ad2, and ad3, and lp3 +ad1, ad2, and ad3. You must account for every possibility. If lp 1 + ad1 does better than lp2 + ad2 then you don't know whether it's the LP that provided the increased CVR or the AD or the combo of both. So you have 9 subids to make basically. If you have your own adserver or google website optimizer or whatever just 33/33/33 rotate the ads with indiv subids and 33/33/33 rotate the lps.

The reason you want 9 subids to begin with is that if you just choose the ad that performs the best on LP1, it
might not perform better than the alternative LP1 ads on LP2, but you'd never know this because you only tested the ad that did best from LP1.

I don't mean to overcomplicate this. Just test the 9 variations so you factor everything into account. That's how multivariate testing is done.

This might be obvious to you, so forgive me if it is, but if you want to compare the LP's alone irrelevant of the ad then just compare lp1+ad1 to lp2+ad1 to lp3+ad1. Keep one variable the same and change the other.

Multivariate testing is this: You have a single ad with 5 typefaces, t1, t2, t3, t4, and t5. You also have 5 different images of a person, p1, p2, p3, p4, and p5. You also have 3 different backround colors, c1, c2, and c3. In order to account for every single variable you must have 5x5x3 tracking IDs. 75 total ids. The big boys track hundreds if not thousands of these potential variables in high level optimization.

Quality reply +rep.

I was thinking to do it in 2 stages:

1) 3 ads to LP1. Find best ad.
2) Best ad to 3 LPs. Find best LP.

I see why it wouldn't be as accurate as 9 subids because a certain LP may perform better only with a certain ad. But in reality would "my method" be much worse than the 9 subids method?
 
Quality reply +rep.

I was thinking to do it in 2 stages:

1) 3 ads to LP1. Find best ad.
2) Best ad to 3 LPs. Find best LP.

I see why it wouldn't be as accurate as 9 subids because a certain LP may perform better only with a certain ad. But in reality would "my method" be much worse than the 9 subids method?


Anyone?
 
Quality reply +rep.

I was thinking to do it in 2 stages:

1) 3 ads to LP1. Find best ad.
2) Best ad to 3 LPs. Find best LP.

I see why it wouldn't be as accurate as 9 subids because a certain LP may perform better only with a certain ad. But in reality would "my method" be much worse than the 9 subids method?

The worst performing ad to LP1 may be the best performing ad to LP2.
 
Quality reply +rep.

I was thinking to do it in 2 stages:

1) 3 ads to LP1. Find best ad.
2) Best ad to 3 LPs. Find best LP.

I see why it wouldn't be as accurate as 9 subids because a certain LP may perform better only with a certain ad. But in reality would "my method" be much worse than the 9 subids method?

The way you're doing is basically the same but requires a little more effort. In the end you'll eventually split test all the 9 combinations.

But why not just split test them all at once? It's the same but requires less effort.