2/4 lessons completed
No items found.
Next Module →
My Learning
→
→
Project: How to Read Ad Results and Optimize Ads
Playbook
⌛
minute read
Completed [date]

Project: How to Read Ad Results and Optimize Ads

Learning Objectives

Your ads have been set up. The sun is shining. Potential customers are singing. You can feel the beauty of a low CAC (Cost of Acquiring a Customer) about to grace your future.

But you’re not quite done.

In fact, the most important part of your growth journey is yet to come.

See, without exception, it is always the case that you need to optimize your ads after you set them up. It can be the difference between running ads profitably and unprofitably. And no matter what, it’s going to make your ads a hell of a lot cheaper to run.

What is ad optimization?

Ad optimization, fundamentally, means turning off old ads and ad sets, creating new ads and ad sets, and changing the rest of your funnel to make it cheaper to get new customers. Based on the data you get.

The goal is to find the combination of copy, creative, placement, audience, timing, platform, and more that leads to the lowest CAC.

For example: you may find that women between the ages of 30 and 45 click through your ads twice as much as anyone else. Except in New York and California. With that knowledge, you might:

A) Restrict your ad set targeting just to those women.

B) Exclude New York and California from your ad set.

C) Redesign and rewrite your landing page for a female audience.

D) Show pictures of women in the midwest, instead of generic pictures of the coast, on your landing page.

Another example: you may find that your video ads are four times cheaper (in Cost per Purchase) than the other types of ads you’re trying. With that knowledge, you might:

A) Turn off all the non-video ads

B) Make new video ads that hit different value props

C) Make new video ads with a different “feel” like an animated ad, if you’ve only used live people in your videos.

High level overview

We’re going to use Facebook as our main example for this project, mainly because it shows you many options and data to optimize. But this advice applies all ad channels (Pinterest, Snapchat, Quora, etc.)

Phase 0: Set reminders

As soon as you’ve launched your ads, you should be setting reminders for yourself to optimize ads in 1 day, 4 days, 7 days, 14 days, 17 days, and 21 days. (And every week afterwards.)

We’ll dive into each of these intervals in depth in the following phases.

If you’re running Facebook ads, make sure you’ve set up your metrics correctly (see Facebook and Instagram > Project: Setting up Facebook Metrics).

1 day

This is where you make sure that nothing egregious has gone wrong (like forgetting to turn on an ad set or mistyping a budget).

4 days

Look at initial results and cut out obviously low performing ads and adsets.

7 days

Heavier optimization.

14, 17, 21 days, and every week after that.

Continuing optimization.‌

Check back to see if results have changed significantly, especially if your product has a longer sales cycle (it takes longer for people to buy).

Phase 1: 1 day check

This is a fairly quick run through. Run through this checklist:

  • Are the ads running at all?
  • Is spend crazy high? Check the “Amount Spent” column. Make sure it’s in line with what you budgeted.
  • Are CPCs (cost per click) crazy high?
    • Check the “Cost per Unique Outbound Click” column.
    • Multiply your CPCs by 10.
      • (Assumption: 1 out of every 10 people who click your ad actually buy. Use your real conversion rates from your site if you have those)
    • If that’s more than 3 times your CAC, you can turn off the ad set.
      • Why? It’s going to be too expensive to acquire customers and too much work to optimize. But first check to make sure nothing is wrong.
    • Check your click-through rate (Unique Outbound CTR on Facebook): If it’s under 0.5%, your ad is performing abnormally poorly. There’s either a problem with your audience or your ad.
  • Is there one ad set that’s performing so much worse than the others that it’s worth saving yourself the money?
    • This is very very rarely the case early on. Do not just judge this based on CPCs — we’ve had a number of clients where the CPC is higher for a few audience that are actually cheaper per purchase.
    • Keep your eyes on the prize: the purchase. Don’t think too much about the intermediate metrics like clicks or signups.
  • If, for some reason, there’s an ad set running that has no purchases and you’ve already spent 3 times your acceptable CAC, you can turn it off for now.‌

You’ll want to revisit it later (21 days later, and possibly sooner) to see whether it took time for those leads to convert (meaning, actually buy).

Phase 2: Initial optimization – 4 day check‌

And now, the meat of the work. Here’s a checklist you can use as you follow along.

Phase 2a: Open dashboard

Head to your ad dashboard.‌

Make sure you can see every live combination of ad sets on the dashboard. (These are called “Campaigns” on Twitter and LinkedIn. Wherever you set your audience and group your ads is what matters).

Phase 2b: Set your date range

Do “Lifetime” if possible. Include today’s date in the data. This is a common gotcha — we’ve drawn many wrong conclusions because the date range is gone. This happens frequently.

Bookmark this page with the Lifetime date range as your default starting page whenever you visit the channel. For example, whenever you want to visit Ads Manager on Facebook, use the bookmark you made that uses the Lifetime date range to start (unless you’re trying to look at specific data).

If you’re on Twitter, make sure you include today’s date in the data (otherwise Twitter only looks at the day before). Selecting “This Year” is a good way to do this (unless it’s January 1st or early in the year).

Phase 2c: Sort by your Holy Grail Metric or amount spent

Watch this video.

Ideally, your Holy Grail Metric should be whatever you record when a customer makes a purchase. Or, if there’s not enough data on it, it should be as downfunnel as possible.

In the example below, our Holy Grail Metric is “Cost per Web Content View”. Sort by “Descending”.

You may not be able to sort by your Holy Grail, depending on your ad channel. There’s a chance you’ll have to look at Google Analytics or Mixpanel/Heap Analytics/etc. to see how you’re actually doing downfunnel.

This is why UTM tags are so important — they let you keep track of which ads and ad sets are converting well, even after your ad channel (e.g., LinkedIn — especially LinkedIn) loses track.

If you don’t have many purchases yet, it’s sometimes better to sort by amount spent and rule out ad sets where you’ve spent too much.

LinkedIn note: LinkedIn’s conversion tracking is notoriously broken. Their own reps admit it. So even if you are tracking conversions, you can’t trust it. You’ll need to get data from GA or your analytics tool.

Phase 2d: Figure out if you have enough data to do anything

Watch this video.

Run through each ad set.

Fundamentally, there are two things you need to ask before you can touch an ad set:

  1. Does my ad set have at least 1,200 reach? Based on Demand Curve’s experience, this is the bare minimum amount of data we’ve found we need for initial patterns to hold up.
  2. Do two or three marginal conversions make a difference? (Explained below.)

To optimize an ad set, the answer to #1 should be yes and the answer to #2 should be no.

Does my ad set have at least 1,200 reach?

In the example above, notice that the top ad set is much more expensive than the others ($17.41 vs. $1-3). You might think, “Boy, that’s an order of magnitude more expensive. I should turn that off.”

If you’re absolutely strapped for cash, sure. Turn that puppy off.

But guess what. There ain’t much data. Only one person has done what we want, and only 646 people have seen our ad set.

Almost always, you’ll want your ad to reach at least 1,200 people before you do anything. There’s too much variability otherwise.

Do two or three marginal conversions make a difference?

In the example above, it only takes two more people to bring your CPA back within range. (CPA means “Cost Per Acquisition” — an “Acquisition” is a “Website Content View” in the example above.) Two more people brings you to three total.

$17.41 (your total amount spent) divided by 3 is $5.80. That’s pretty close to the other ad sets. So at this point, leave the ad set on for another day or two. See if it comes back within range of your acceptable CAC.

Here’s the rule: We care about the difference that two to three more conversions would make.

“Marginal conversions” mean “two or three more conversions”: what would your CAC look like with 3 or 4 conversions instead of 1?‌

We don’t want you to burn your money. So we’re going to act on data in the most profitable way we can.

Don’t turn off your ad set just yet, though. First…‌

Phase 2e: Pause poorly performing ads

Watch this video.

Facebook will pause some ads for you automatically — other platforms likely won’t. And Facebook doesn’t always pause the right ads.

Before you even think about turning off an ad set, you’ll want to break it down by ad. Sometimes, one ad will drastically outperform the others, but your platform (Facebook/Quora/etc.) is optimizing for the wrong thing.

Click into one of your ad sets. Sort by your holy grail metric. (Sometimes, sorting by “Amount Spent” saves you more time here.)

Turn off the ads that are two to three times as expensive as the others, assuming the marginal conversion (explained above) doesn’t make a difference.‌

Do this within each ad set.

Phase 2f: Break down across as many metrics as possible

Watch this video.

Don’t turn off an ad set until you’ve ruled it out across all major demographics and metrics.

Different platforms give you more or fewer metrics — we’re using Facebook as an example because it has by far the most ways to break down your data.

Head back to your “Campaign View”, where you can see all your ad sets at once.

Click on “Breakdown”, then “By Delivery”. Start with “Age”

See if there are differences in performance between age ranges (if you have enough data). Do the same thing at the ad level.

Specifically, you’ll want to look for poorly performing audiences (that have a 3x CAC or higher) to exclude them from your targeting. Instead of only focusing on top-performing ones. For example, by excluding New York and California from the US instead of only targeting Kentucky, you’ll still able to serve ads to other states in the midwest and get more data on them.

This way, you can reach more people than by restricting your targeting only to the best audiences. And it will take longer for people to get tired of your ads.

If there are any audiences that are borderline (the CAC is 1x to 2.5x what it should be), exclude them and target them in separate ad sets with creatives and landing pages specifically tailored to them.

For example, if you're seeing that 55-65 year old women are responding with a 1.5x CAC, exclude them from the original ad set. Then, make a separate ad set targeting only 55-65 year old women, and serve them offer ads with senior discounts, pointing to a new landing page with an older woman in the image.

Productivity Bonus - Filters

If you’re running a bunch of ad sets, the number of rows can get overwhelming and confusing. You’ll want to cut your results down to a manageable number of rows.

Usually, this will mean looking at only one ad set. Here’s how.

Let’s say you only want to look at your retargeting ad set. Hit “Search”, then Ad Set name:

Then, when you break down your data, you’ll only see your retargeting ad set. Much less overwhelming.

Another example: if you’re looking at cities, but you want to restrict to ad sets where you’ve reached over 6,000 people total, hit “Filters”, then “Ad Set Metrics” > Reach:

Break down by other categories‌

You’ll want to break down by each of the categories below. We’re including examples from how we’ve optimized for clients in the past.

These categories have historically been the largest variables for advertising performance.

  • Age
  • Gender
    • This can also inform whether other ad channels are worth testing.
    • For example, if women drastically outperform men, it opens up Pinterest as a potential channel to test (which typically performs well for women between 22 and 45).
  • Age and Gender
    • This combination is particularly important to look at. There might be an interaction you’re missing if you only broke down by Age and Gender.
    • For example, you might discover that you perform well with moms but not dads — when at first you thought you appealed broadly to parents.
  • Country
    • We’ll often separate countries out into separate ad sets as well
  • Region (this really means “State” in the United States)
    • DMA Region
    • This roughly breaks down by county.
    • In the past, for example, we’ve found high-converting counties in the past and written specific ad creatives tailored to that county or city.
      • To do that, you’ll sometimes need to include a broad area, and then exclude specific sub areas with a given radius. For example, in the past, we’ve included San Francisco and Oakland, but excluded South San Francisco to avoid the less profitable parts of SF.
    • You’ll need to wait a while to get enough data to draw conclusions here. But if you sort by descending reach, you can sometimes exclude larger counties that don’t perform well (with enough data).
  • Impression device
    • This is where, for example, you could see that it’s way cheaper to get customers on Android than on iOS.
  • Platform
    • If you’re on a budget and had to combine Facebook and Instagram into one ad set, this is where you’d see which one performed better.
  • Platform & Device
    • Same argument as for viewing the “Age and Gender” combination.
  • Placement
    • Extremely important. This is, for example, whether you perform better in the Instagram feed or in an Instagram story.
  • Placement & Device
    • Same argument as for viewing the “Platform & Device” combination.
  • Time of Day (Viewer’s Time Zone)
    • If you’re a startup and strapped for time, it’s a lot of work to set up an ad set that only runs in, say, New York during NY’s commuting hours, and another running in Beijing during their commuting hours.
    • But putting in that extra work does make a difference.
    • The shortcut is to add a buffer for time zones that are close together and run ads to them all at once.

Phase 2g: Make new ads

You may have already done this, but take what you’ve learned from breaking down your data and put it into practice. Target new audiences, make new ads.

Guidelines: Making New Ads

  • Make new ads tailored to the audiences that are converting best.
    • For example, if dog owners from Florida are performing particularly well, test copy that reads “The only organic dog food in Florida that delivers right to your door” and put it in its own ad set, targeting dog owners in Florida.
    • This includes retargeting ads; write copy that assumes they’ve already been to your site and are familiar with your product in general.
  • Make retargeting ads specific to the products that people visit.
    • We’ve found this to be particularly successful for clients.
    • If you sell 10 different products: dog food, a dog bowl, dog chew toys, etc., make a different retargeting ad for each one.

Note: only duplicate ad sets when you can't change an existing ad set.

Ordinarily, you might think, "That doesn't make sense! I'd rather keep things organized to run a cleaner test." Here's the problem: the ads in the new ad set will lose all their engagement — likes, comments, and shares – which can drastically hurt performance.

So: it’s better to use the same ad than to make a new one.

Phase 2h: Now pause poorly performing ad sets

Watch this video.

Great. You’ve broken down by metrics and probably made some changes.

If there are any ad sets that are performing an order of magnitude worse than the others, or have hit 3x your CAC, turn those suckers off.‌

Make sure to check the ad sets that you’ve spent a lot on that have no conversions. Those can often slip through the cracks.

Phase 2i: Update your log

We like to update a Dropbox Paper doc with only the major changes and optimizations we make. It’s particularly useful when you’re trying to look at data starting with the date you made a major change.

For example, you might want to look at your ad set performance after you excluded certain locations and added a new video ad.

Here’s an example we used internally for a real client.

There’s a place in the Facebook UI to see every change you’ve ever made, but it’s a pain to use because Facebook keeps specific track of everything, down to when you adjusted a budget. There’s a lot of noise. But you can follow the instructions to do it here if you want.

Phase 3: Initial optimization – 7 day check

Run through the steps in Phase 2 again.

Why a 7 day check? We sometimes see different behavior on the weekend compared to during the week, so it’s ideal to wait for a whole week to finish before optimizing too much.

You’ll also have more data to make better decisions.

More importantly, if you have a longer sales cycle (people take more time between seeing your ad and buying it), you need to wait at least a week or more before you see reliable results.

Phase 3a: Get a social boost

Find your highest performing ads. Check the box next to them and hit “Preview”. Then click the little square with the arrow on the top right.

Then click “share a link”. Copy that link.

Then, send it to your happiest customers asking them to leave a genuine review of you in a comment with a like.

Why?

The more likes and comments an ad has, the more Facebook promotes it in the newsfeed. Which means you don’t have to bid as much to show up — making your CAC cheaper.

Lots of likes and comments also makes your product look more trustworthy and legit. So people will click through the ad more. And are more likely to convert.

Assuming your product is good enough to have happy customers, this is a good-hearted hack that has worked wonders for us.

Phase 4: Continuing optimization - 14, 17, 21 day checks and beyond

You may need to run through Phase 2 again, but you may have already started optimizing and finding ad sets that perform well, as well as cutting out the ones that aren’t performing well. Good work.

We now do a different type of optimizing. “Continuing optimization”: keeping what works working, and fixing (or getting rid of) what doesn’t.

You’ll want to check your ads twice a week at minimum. If ads turn out to be the primary way you’re getting revenue, you’ll want to check daily.‌

Phase 4a: Check your Holy Grail Metric

As more and more people see your ads you’ll need to keep an eye on your Holy Grail Metric (Cost per X) to make sure it doesn’t start to rise above your acceptable CAC (or acceptable CPA).

Phase 4a.a: If your Holy Grail Metric is acceptable…

You’ve won. Congratulations. This is huge for your business. For now.

You can start to spend more and reach more people profitably. But, if you spend too much, you’ll “blow out” your ad set and people will get “fatigued”, meaning they’ll see your ads too often.

On most platforms, you can get a sense of your overall reach or daily impressions by editing the ad sets.‌

On Facebook, check your ad set’s overall reach by editing it and looking at the Potential Reach on the graph on the right. Increase your daily budget until the top number (your estimated daily reach) is 1/55th of your Potential Reach. We’ve found that two months (~55 days) tends to be enough time for people to move into and out of audiences.

If your potential reach is “Unavailable”...

  1. Start removing the custom audiences you’re excluding and see if potential reach shows up.
  2. If it does, you’ll need to account for the size of the audiences you’re excluding.
  3. To estimate that, go into the Audiences section of Facebook and look at the audience size.
  4. If you’re targeting a lookalike audience in your ad set, you can use the audience overlap tool and see how much overlap there is between the lookalike and the excluded audiences. Subtract that overlap out.
  5. But if you’re targeting an interest-based audience, you can’t see the overlap. So just look at the size of the excluded audience and subtract that out to get to the worst case scenario.
  6. If potential reach is still "Unavailable", increase your budget by 1 to 2 times the amount and keep doubling it every 4-7 days. Be careful. It’s hard to know how big your audience actually is, and you risk blowing it out.

Congrats. You can skip the rest of phase 4.

Phase 4a.b: If your Holy Grail Metric is rising or too high…

Go through the phases below. Also run through phase 2 to see if you can improve your audience at all.‌

Phase 4b: Check attribution

It can be really hard to tell how many purchases your ads are really causing. Your ad manager only tracks people who directly see your ad and buy on your site. We found that we weren’t tracking over $50,000 a month for some clients!

Phase 4c: Check your Frequency

Once your ads have been running for a week or two, you’ll need to keep an eye on your Frequency: this is how many times people have seen your ad, overall. This is especially an issue when your audience has a small overall reach: there are only so many people you can show an ad to.

Once it rises above 3, people will start to get fatigued; they’ll gloss over your ad because they’ve seen it before and already “get it”.

This is also why ideal audiences are “living and breathing”. For example, if you’re targeting people who “Recently Moved” on Facebook (a real targeting option), you won’t have to refresh your ads very often; new people move every day and enter your audience; people who have lived somewhere for a while will drop out of your audience. So the people you care about won’t have seen your ads before.

Exception: you can afford a much higher frequency (up to 10) for retargeting ads; you’re not spamming people because they already know your product; you’re trying to get them to come back by catching their attention at the right moment.

If your Frequency is high, you have four options…

  • Expand your audience
  • Refresh your ad creatives
  • Turn off the ad set (if your Holy Grail Metric is also too high)‌

Phase 4d: Expand your audience

You have a few levers you can pull here. Edit your ad set.

Expand targeting

On LinkedIn, you can add new industries or job titles to targeting that you may have forgotten before (for example).

On Quora, you can add new interests and topics that are a bit farther away from your original ones.

Now that you’ve gotten some data on who has come to your site, you can also make new lookalike audiences off the people who have visited, signed up, purchased, etc.

On Facebook, you can do the same. There’s also that little checkbox we ignored before in the “Detailed Targeting” section.

You can try checking it. Checking this box makes it harder to control our experiments between ad sets, but once you’ve been running ads for a while and have narrowed down to your top-performing ad sets, it’s less of a risk.

Expand Placements

On Facebook, you can try adding placements in the “Audience Network”. These are other web sites and mobile apps (for example, The Huffington Post) that use Facebook’s targeting to show ads on their site. These tend to convert worse, which is why we don’t have you target these sites up front, but we have seen some success. It’s worth a shot if your ad sets are failing.

You can see a list of some other sites that are in the Audience Network here.

Also, you can try expanding to Instagram Story ads -- they can convert well -- but you'll need to make creatives that follow that placement's format.

Expand Your Lookalikes

On Facebook and Quora, you set lookalikes as a percentage of a country's population. If a 1% lookalike audience is performing well, try expanding to 2%, 3%, etc. to get more volume.

Refresh Your Uploaded Audience Lists

If your lookalike audience is saturated, and the seed audience is a list of customer emails that you uploaded a while ago, upload an updated list of customers and make a new lookalike audience.

Note: if you're using a lookalike audience with a seed audience that automatically updates using the pixel (for example, 30 day site visitors), you don't need to refresh the lookalike audience. According to Facebook's support, Facebook will do that automatically every 3 to 7 days.

Phase 4e: Refresh your ad creatives‌

This means making new ads with new designs and new copy, especially hitting new value props.‌

If you need help coming up with those, you can run through our ad copy and ad creative projects again. At this point (assuming you’ve gotten ads to work for you), it’s worth hiring a designer to come up with another batch of ad creatives. Just make sure they follow our overall guidelines.

Dynamic Ads

If you're an eCommerce company with a bunch of products, and you're running Facebook/Instagram ads, you can try running dynamic ads. These let you upload your product catalog and autogenerate ad copy with each product.

It's not worth doing to start, but if you're having trouble getting CAC down but are within 30% or so, it's worth looking into.‌

Phase 4f: Turn off the ad set

Sometimes, you just can’t make it work. The Cost of Acquiring a Customer is too high. Your target audience is too small. It happens.

Don’t spend money on ads unprofitably. Turn them off. Try a different ad set. Or a different channel.

Phase 4g: Update your log with your changes

Update your log doc with the major changes you made

Phase 5: Schedule recurring checks

In practice, you’ll want to look at your ad performance every 3 or 4 days. To remind ourselves, we set recurring calendar reminders and create automatic tasks in our digital to-do lists.

đź’¬