top
30,000 hours of Expertise for Only $1K?!  Click Here for Your Own Strategic Audit from World Renown PPC Expert Kirk Williams 
Kirk Williams
 • 
General PPC

Stop Testing Unless You've Agreed On the Risks

Date Published: 
November 25, 2025
Last Update: 
November 25, 2025

Stop Testing Unless You've Agreed On the Risks

10/25/19 UPDATE: Hello Facebook Agency Visitor Person!  We’re delighted to have you visit this awesome post. About a year ago, ZATO stopped offering Facebook Ads solutions so we could focus solely on what we do best: Google Ads. Because of this, we’re always interested in partnerships with great Social Advertising agencies (like yourself, wink wink!) and we offer referral fees for signed clients!  Anyway, back to it, and happy reading…

Post Summary

Are you treating your marketing tests like guarantees? True testing involves genuine risk, if victory were certain, it would simply be a "best practice." In this pondering piece, Kirk explores why "playing it safe" is actually dangerous for long-term business growth. Inspired by industry experts, Kirk breaks down the non-negotiables of successful PPC testing: aligning on objectives upfront, accepting the potential for financial loss, and valuing negative outcomes as critical data. Read on to learn how to define your organization's risk tolerance and properly structure your experiments for profitable discovery.

Good morning on this exciting BFCM week for ecommerce! I've been in breakfast burrito kick lately, so while trying a new one (for me) in town, I scrolled social media as is my common breakfast practice. The day before, I had seen Charley Brennand (she hosts Performance MCR, a conference in Manchester I'm speaking at in 2026!) post a list of helpful PPC things, and one of them leapt out at me. It was on testing, but not simply how to go about testing, it was a comment on the importance of ensuring everyone involved is on the same page from beginning to end regarding clear objectives. 


Here is what she said: 

charley brennand of performance mcr discusses ppc testing

So this morning, I was pondering this more and decided to jot down my own thoughts down, because what I think Charley is getting at here is really really crucial.

I don’t think she is simply encouraging collaboration between the tactical implementation specialists and strategic direction deciders at your org or client… she is saying more (which I completely agree with ). I think she is saying that goals and objectives of the test MUST be established before the test is created otherwise we won’t even agree on the test results or purpose… and the quiet part out loud with that is: if we don’t agree on the test results or purpose, then someone will ultimately be viewed as “messing up” and… hint, it won’t be the strategic decisions makers who take the fall here ;) 

More importantly, I think this helps reveal a crucial piece of the puzzle to testing, that I don’t think many fully understand. That is: 

A test is called a test because there is actual risk involved. 

Even in the most thought-through, well-designed, objective-focused test, there is risk. If there was no risk, it wouldn't be a test, it would be a best practice, or even a guarantee.

Get it? If you were guaranteed that something would work, there would be no point in testing, you would just implement that with the expectation that it would work. 

But with testing, you may identify a new audience to try, or new creative to run in which you actually do not know how it will work (again, thus the reason for a solid testing structure). Thus, there is an unknown factor which, and this is the crucial part, means your test could fail and you could lose money on your test. 

By the way, crucially, being able to actually utilize the test, even a negative outcome test, for your benefit also means you will have needed to create the test in a properly structured way. Brie Anderson does a great job noting that here

brie anderson of analytics fame discusses the actual framework for a successful test

Of course, even a negative outcome is a crucial testing discovery, and valuable because it helps guide where you *should* invest money in the future if done correctly.  But this goes to risk tolerance, too few understand the need for (1) well designed testing procedures (2) the ability to lose money to refine where to spend money. 

If there is no place or stomach for "risk" in your organization, or clients, it's probably time to pull back and deal with that philosophy before trying to continue with various tests. 

That "pull back" may just mean that you all acknowledge "we're not in a place of testing right now because our risk tolerance is so low". That's perfectly okay, but then that means there is less discovery and prospecting happening as well, since the riskiest parts of business growth are in outreach. So frankly, THAT is risky. You are preventing your business from profitable growth (and possibly long-term survival if you never grow and inflation slowly buriesr) it could be receiving by playing too cautiously. 

So, again, it's really important to identify what everyone's risk tolerance (and understanding of tests) is before just running after testing this, that, and all the stuffs.

I’d like to close by pointing you to another of my friends, Sam Tomlinson, who has this healthy whiteboard video on Google Ads A/B testing procedures

All that to say, test… but make sure you all agree on
(1) the risk involved in a test

(2) the testing procedure so you can be confident in it

(3) the objectives of the test: how can you positively use whatever the outcome is in order to shape future testing or campaign optimizations?

What about you? Follow me on LinkedIn and toss in an opinion here. What did I get right? Wrong? Let’s discuss and grow together!

Want more free content like this delivered directly to your inbox?
Subscribe Here
Kirk Williams
@PPCKirk - Owner & Chief Pondering Officer

Kirk is the owner of ZATO, his Paid Search & Social PPC micro-agency of experts, and has been working in Digital Marketing since 2009. His personal motto (perhaps unhealthily so), is "let's overthink this some more."  He even wrote a book recently on philosophical PPC musings that you can check out here: Ponderings of a PPC Professional.

He has been named one of the Top 25 Most Influential PPCers in the world by PPC Hero 6 years in a row (2016-2021), has written articles for many industry publications (including Shopify, Moz, PPC Hero, Search Engine Land, and Microsoft), and is a frequent guest on digital marketing podcasts and webinars.

Kirk currently resides in Billings, MT with his wife, six children, books, Trek Bikes, Taylor guitar, and little sleep.

Kirk is an avid "discusser of marketing things" on Twitter, as well as an avid conference speaker, having traveled around the world to talk about Paid Search (especially Shopping Ads).  Kirk has booked speaking engagements in London, Dublin, Sydney, Milan, NYC, Dallas, OKC, Milwaukee, and more and has been recognized through reviews as one of the Top 10 conference presentations on more than one occasion.

You can connect with Kirk on Twitter or Linkedin.

In 2023, Kirk had the privilege of speaking at the TEDx Billings on one of his many passions, Stop the Scale: Redefining Business Success.

Continue reading

Find what you're looking for here: