Want to get into A/B Testing on YouTube? This starter’s guide has everything you need to begin testing your videos.
Pro Tip: Click “Show Sections” to easily navigate this guide.
We’re not going to bore you with stuff you don’t know…. But, to understand YouTube A/B Testing, you need to know the roots of this principle.
Answer: A/B testing (or split testing) is a method used to compare two versions of something (e.g. a YouTube video) to determine which one performs better.
“Comparing the outcomes of two different choices (A and B) by running a controlled mini-experiment.”
— Harvard Business School
Got it? Let’s move on to our context.
Answer: A/B testing on YouTube is when creators or advertisers experiment with different versions of their videos to see which one performs better with viewers.
YouTubers might test different thumbnails, titles, descriptions, or even content itself to figure out what resonates most.
It’s like a trial-and-error method to optimize engagement and reach on the platform.
Answer: YouTubers A/B test to improve their content’s performance and audience engagement.
Here is Nolan from Think Media to explain this (in ~20 sec):
By experimenting with different elements like thumbnails, titles, or content, creators can learn what resonates best with viewers and optimize their videos accordingly.
Ultimately, it helps them attract more views, subscribers, and revenue.
Fun Fact: A/B testing works for old YouTube videos too, not just for new uploads.
To start A/B testing on YouTube, make multiple versions of a video’s thumbnail and title — don’t hesitate making them very different from each other.
This help you understand elements bring more views.
Join us, and let’s see your current options to A/B testing.
Answer: To A/B test a YouTube video’s thumbnail, go to ThumbnailTest.com and connect your channel. Select a video, upload thumbnails, and begin the test.
Few hours/days later, you can come back to this test and check the video’s analytics to see how many clicks you get for each thumbnail.
This’ll help you figure out which thumbnail drives a better CTR for the video. More importantly, Thumbnail Test will help you understand why that happens.
Just like on the thumbnail A/B test, you’ll see analytics for this test as well.
You’re probably wondering: “Is Thumbnail Test really is the only A/B Tester?” — without biasing this, the real answer is Yes.
Reason being that YouTube has cancelled this feature for over 5 years now, which doesn’t give people another option.
And that’s just one Reddit comment. There’s more like that.
Besides, here’s how YouTube compares to Thumbnail Test:
| Factor | YouTube | Thumbnail Test |
|---|---|---|
| Platform | YouTube Studio | Connects with YouTube |
| Testing | Thumbnails, Titles | Thumbnails, Titles |
| Quantity | 3 per video | 10 per video |
| Cost | Free, part of YouTube | Paid, discount for small channels |
| Availability | Not released | Available for everyone |
| Duration | Limited test duration | Flexible test duration + frequency |
| Setup | Easy, directly in YouTube | 1-click connection to YouTube |
| Support | None, just articles | Live Support, Email, Community |
This comparison is based on what we know YouTube’s feature will be like and comments from fellow beta testers who already have access to the feature.
Winner: Thumbnail Test.
As new A/B testers come out, we’ll update this guide to let you know the 100% honest answer.
By now, you may ask: “What is an example of AB testing?” → This section covers an honest example of a successful A/B testing case.
This story can also be seen as a testimonial. Fear not, we’ll break it down to the points of interest for a beginner in A/B Testing.
Here’s Ali Abdaal to explain how his video got 800k views just by changing the thumbnail:
No need to read the whole post (tweet) if you don’t have the time for it.
Ali Abdaal’s video views went from 300,000 to 1.1 million after changing the thumbnail.
So then… Titles + Thumbnails serve as packaging, enticing viewers to watch the video.
Making the perfect thumbnail requires creativity and an understanding of audience preferences.
Ali’s experience shows the importance of optimizing thumbnails for increasing engagement metrics and channel growth.
The answer is yes, but not for everybody. YouTube rolled out Test & Compare in June 2024, but only for what they call “eligible creators”.
Answer: YouTube Thumbnail Tester (Test & Compare) is a feature designed to help you upload and cycle 3 different thumbnails for one video.
You’d do this to find out which thumbnail works better for your audience → which image brings you more clicks, and why.
Yes, you can A and B test a YouTube Thumbnail, but YouTube’s feature is not available to the public.
Feel free to use Thumbnail Test instead.
Got any questions? Get in touch with us by clicking the purple bubble in the bottom-right corner of this page.
You’ll get connected to one of our support team’s members. We’re always happy to help!
Thank you for reading this,
David Ch
Chief Editor of Thumbnail Test
