How do you talk your boss into AB testing?

ExperimentationBy Catherine Meira

Ever had your boss pushed back on AB testing? Statements like “this will cost us money” are common, so you're not alone! This article is here to show you how you can overcome this challenge.

When it comes to boosting customer satisfaction, data is a gold mine. AB testing is the best method for gathering valuable insights into what resonates with your audience, empowering you to make well-informed decisions. But we understand that getting your boss on board with it can be a hurdle. All you need to do here is demonstrate how it can drive conversions using compelling arguments for its adoption.

Learn how to boost subscription ratesBrazil Journal increased the newsletter subscription rate by +93% with segmented AB tests.
Ecommerce personalization

The importance of data-driven decision-making

Relying on gut instincts and assumptions like in Mad Men is no longer enough. AB testing your hypotheses to fund assumptions with real data is the relevant substitute. Businesses can gain valuable insights into customer behavior, preferences, and trends by gathering and analyzing users' browsing information.

AB testing involves creating two or more versions of a webpage and testing them against each other to see which performs better. It allows you to make informed decisions based on accurate user data rather than guesswork.

This approach minimizes the risk of making costly mistakes since data-driven decisions are more objective and less prone to biases. It ensures that your choices are based on facts rather than personal opinions.

Customers' preferences and behaviors constantly evolve, so relying on a single approach can make you miss seasonalities and lose money. You should stay agile and adapt quickly. When continuously testing and refining your strategies, you can keep up with changing market dynamics and maintain a competitive edge.

Benefits of AB testing

AB testing offers many benefits for businesses of all sizes. Here are some of them:

Continuous Improvement

AB testing is an iterative process that allows you to make the most of your marketing efforts continuously. It’s directly connected to user experience since testing and refining strategies will help you tailor content for each user.

Improved user experience

Testing hypotheses helps you understand how different design elements, content, or functionalities impact user experience. You can create a more user-friendly website or suggest readings and products that resonate with one’s choice. This increases the time users spend on your site and ultimately boosts conversions.

Increased conversions

AB testing allows you to identify the elements of your website or marketing campaigns that drive the highest conversions for small samples of your audiences. You can significantly improve your conversion rates and generate more qualified leads by applying those changes to the rest of your audience.

Higher ROI

The ultimate consequence of driving more conversions is having a clear ROI. Relying on AB testing can yield a high return on investment. You can optimize campaigns based on data-driven insights to allocate your resources more effectively and get more value out of your marketing budget.

Get the most value out of your personalization strategyCARE used AB testing and personalization to increased the conversion rate by 35% and the ARPU by 97%.
Ecommerce personalization

Why your boss may be skeptical about AB testing

Despite its proven effectiveness, AB testing is still met with skepticism by some. They fear that the long-term benefits won’t outweigh the initial investment and may lose income if they do not decide on the strategy ASAP.

These are the most common misconceptions about AB testing:

AB testing is complicated: It may sound complex, but with the right tools and resources, it can be easily implemented. There are user-friendly platforms available that streamline the testing process and provide actionable insights. You can use them to modify and pause ongoing experiments, test your hypotheses using frequentist or Bayesian analysis, and fit the results in your market timing.

Dashboard showing performance per goal in which two variants present different numbers for five specific metrics.
Tests results at Croct's dashboard

AB testing is expensive

Contrary to popular belief, it doesn't have to be costly. Many tools offer affordable pricing plans, and the potential return on investment makes it worthwhile. You can start your tests with free platforms and tools, and invest as you see the results and find it needed. Moreover, you can plan for the effort you want to put in each test while collecting valuable data from your website sessions.

AB testing is only for large corporations

On the contrary, it benefits businesses of all sizes, from startups to multinational corporations. The insights from AB testing can help small businesses compete with larger companies and achieve their goals. For example, while a global company focuses on many products or services, smaller companies can analyze what specific audiences find more valuable in one particular service. Many businesses become leaders in their fields due to their expertise in AB testing and data-driven decision-making.

Implementing the winning variant takes time

A common fear of marketing professionals is that implementing the winning variant may take too long, which will invalidate all the research done in some cases. However, there are user-friendly platforms focused on making your marketing team more autonomous. After the initial setup, you can change and test your website content with a few clicks and no technological expertise.

How to convince your boss to embrace AB testing

Now that you understand the importance and benefits of AB testing, you have all the tools to convince your boss to adopt this powerful strategy. Here are some tips to help you pose compelling arguments:

1. Showing them success cases

When talking your boss into new approaches, it's essential to focus on the benefits it can bring to the business. Highlight the potential of AB testing for increased conversions, user experience, higher ROI, and enhanced customer insights. Provide real-world examples and case studies from your industry to support your claims and demonstrate the positive impact of AB testing on other companies.

2. Support ideas with internal benchmarking

Understanding industry trends and competitor successes is key to gaining a competitive edge. But you should also look for internal benchmarks. Some segmentations that work on paid media or email lead nurturing might also suit website content strategies. Leverage past experiences to create even more trust.

3. Overcoming objections

Your boss may have concerns or objections about implementing AB testing, some of them mentioned before in this article. Take the time to address these concerns and provide solutions. For example, if your boss worries about the time and resources required, explain how AB testing platforms can streamline the process, and bring a plan detailing which human and technical resources you will need to put that into practice. You could also provide a forecast on how AB tests could affect the overall marketing results. The more complete your plan is, the more likely that your boss will embrace it.

If cost is a concern, highlight the potential return on investment and the affordability of many AB testing tools. Although it may look like a shot in the dark, testing will always bring you essential data and insights you can use throughout your business journey.

4. Tools and resources for implementing AB Testing

To make your argument more convincing, provide information about the tools and resources available for implementing AB testing. Numerous platforms and software solutions make the process simpler. Research and recommend platforms that align with your company's needs and budget. Many platforms will offer you free trials or plans you can use to collect data and address your boss's concerns and priorities.


AB testing offers numerous benefits that can significantly impact your business's success. One of the key advantages is the ability to make data-driven decisions. By testing different variations of your website, you can identify the most effective elements for driving conversions. This could be anything from the color of a call-to-action button to the placement of a form.

Emphasize the long-term benefits of AB testing for gaining budget and time. While some initial investment may be required, the insights gained from it can lead to significant cost savings in the long run. By optimizing your strategies and focusing resources on what works best, you can eliminate wasteful spending and maximize your return on investment.

Another concern your boss may have is the potential impact on website performance. It's important to address this concern by highlighting the controlled nature of AB testing. Headless CMS platforms such as Croct will allow you to perform AB tests and implement changes while ensuring your website remains stable during updates.

Sign up for a free account and discover how easy it is to manage your website content.

Let's grow together!

Learn practical tactics our customers use to grow by 20% or more.