www.demandgenreport.com Open in urlscan Pro
162.159.134.42  Public Scan

Form analysis
3 forms found in the DOM

GET https://www.demandgenreport.com/

<form role="search" method="get" class="et_pb_menu__search-form" action="https://www.demandgenreport.com/">
  <input type="search" class="et_pb_menu__search-input" placeholder="Search …" name="s" title="Search for:">
</form>

GET https://www.demandgenreport.com/

<form role="search" method="get" id="searchform" class="searchform" action="https://www.demandgenreport.com/">
  <div class="search-wrapper">
    <input type="text" value="" name="s" id="s" placeholder="Search…">
    <button type="submit" id="searchsubmit"><i class="fa fa-search" aria-hidden="true"></i></button>
  </div>
</form>

GET https://www.demandgenreport.com/

<form role="search" method="get" id="searchform" class="searchform" action="https://www.demandgenreport.com/">
  <div class="search-wrapper">
    <input type="text" value="" name="s" id="s" placeholder="Search…">
    <button type="submit" id="searchsubmit"><i class="fa fa-search" aria-hidden="true"></i></button>
  </div>
</form>

Text Content

×
 * Emerald Media Network
 * Advertise
 * B2B Marketing Exchange
 * B2B Marketing Exchange East

 * Emerald Media Network
 * Advertise
 * B2B Marketing Exchange
 * B2B Marketing Exchange East

 * Follow
 * Follow
 * Follow
 * Follow


ADVERTISEMENT
 * Latest
   * View All Posts »
   * Industry News
   * Demanding Views
   * Financial News
   * Solution Spotlight
   * Case Studies
   * Podcasts
   * Blogs
 * Topics
   * View All Posts »
   * ABM/ABX
   * Content Strategy
   * Demand Generation
   * Go-To-Market Strategy
   * Personalization
   * Predictive Marketing
   * Revenue Operations
   * Sales Enablement
 * Resources
   * View All Resources »
   * “State Of” Guides
   * Tactical Guides
   * Research
   * Reports
   * Webinars
   * E-books
   * White Papers
   * iPapers
   * Infographics
 * Podcast
 * Events
 * More
   * About Us
   * Advertise
   * Editorial Calendar
 * Subscribe

 * Latest
   * View All Posts »
   * Industry News
   * Demanding Views
   * Financial News
   * Solution Spotlight
   * Case Studies
   * Podcasts
   * Blogs
 * Topics
   * View All Posts »
   * ABM/ABX
   * Content Strategy
   * Demand Generation
   * Go-To-Market Strategy
   * Personalization
   * Predictive Marketing
   * Revenue Operations
   * Sales Enablement
 * Resources
   * View All Resources »
   * “State Of” Guides
   * Tactical Guides
   * Research
   * Reports
   * Webinars
   * E-books
   * White Papers
   * iPapers
   * Infographics
 * Podcast
 * Events
 * More
   * About Us
   * Advertise
   * Editorial Calendar
 * Subscribe


MENU

Trending
B2BMX Rebranded
Top 3 Content Formats
A/B Testing Fallacies
Tiga.ai Launch
Outreach Sales Suite

Demanding Views


7 MISCONCEPTIONS ABOUT EMAIL A/B TESTING

Published: August 12, 2024Author: Lauren McGrath, DMi Partners

bestforbest — stock.adobe.com

bestforbest — stock.adobe.com

Few email marketing initiatives are as important — or as misunderstood — as A/B
testing. Over the years, we’ve guided brands with A/B testing initiatives that
help drive growth and insights, educating and empowering our clients along the
way. In that spirit, let’s identify and correct the most persistent
misconceptions about A/B testing in email campaigns.


MISCONCEPTION 1: IT’S ALL ABOUT THE SUBJECT LINE

For lots of marketers, “A/B email testing” starts and stops at the subject line.
The truth is that there’s several variables you can and should test, such as:

 * Open rates at different times of the day and week, along with varying subject
   lines; and
 * Post-open engagement and conversion factors, such as body copy, headline
   copy, offer/promo, CTA, background colors or the order of content blocks.

You should make a point of updating your list periodically with other elements
to test. The more you test, the more you learn.

One last note on this subject: Changes in open rate are relatively murky
post-iOS 15, which is even more reason to expand the scope of variables to test.




MISCONCEPTION 2: YOU CAN TEST EVERYTHING, EVERYWHERE, ALL AT ONCE

Clean A/B tests involve one variable, not many: Don’t switch up a subject line
and time of send and day of week, or you won’t know which one(s) made a
difference. Beyond that, they require focus on specific elements within that
variable.

Since people love to talk about subject lines, let’s use that as an example.
Wildly different subject lines will perform differently, but you won’t
understand why. On the other hand, if you’re testing specific differences like
emojis versus no emojis, question versus statement, etc., you’ll have a clear
takeaway from the data.


MISCONCEPTION 3: INSTANT WINS ABOUND

One of the biggest misconceptions is that each A/B test might just produce a
silver bullet. In fact, A/B testing results are best seen in aggregate, over the
long term. If you’re structuring your tests well and getting information to
optimize future sends, the wins will mount steadily over time.

One reason you shouldn’t expect instant results is that the audience for the
test will be split in half: Even if one version knocks the other out of the
park, 50% of your audience will still be underperforming in comparison.

Last thing here: Depending on the test, you might not find any kind of winner.
Inconclusive findings are fairly common, and it doesn’t mean the test was
flawed. Instead, it simply means the variable you introduced — e.g., changing
the copy format to bullet points — didn’t move the needle one way or the other.


MISCONCEPTION 4: ONCE A WINNER, ALWAYS A WINNER

A winning test from six months ago might not be a winner if the same test were
run today. That’s not to say you should relaunch tests in rigid six-month
intervals, but you should keep an eye on any winning campaigns to make sure
their performance remains strong. If you see engagement trending steadily down
over time (rather than witnessing one bad send and over-reacting), it might be
your signal to take another look.


MISCONCEPTION 5: THE TRUTH IS UNIVERSAL

We love a good best practice at DMi, but we also know there are exceptions to
every rule that you won’t know until you test. For instance, for one client, we
personalized a CTA to reflect the person’s location (e.g. “Find businesses in
{city}!”), and performance was far lower than the email with the
non-personalized CTA.

In other words, work with guidelines — not assumptions —and be prepared for some
surprises along the way.


MISCONCEPTION 6: A/B TESTS ARE ALWAYS A GOOD IDEA

Speaking of universal truths, while we love A/B tests, they aren’t always a good
strategic move! If you need to push out an email for the sake of engagement and
performance, put your best foot forward (informed by all the learnings from past
A/B tests, of course) rather than segmenting your audience and risking a
less-than-optimal performance from 50% of the list.


MISCONCEPTION 7: THERE’S NO VALUE IN FAILURE

If you test a great idea that falls flat, it can be hard on the ego — but it’s
also important knowledge that you need to file away for reference. Remember that
the aggregate value of A/B testing comes in the insights you can apply over
time, and you’ll reframe “failure” as a valuable piece of information.

How important is it to get A/B email testing right? Well, as media costs soar
and first-party data usage becomes even more important, email marketing has a
very important role in holistic marketing strategies. Great A/B testing that
helps you raise the levels of your email engagement over the long term is one of
the best investments you can make for your marketing growth.

--------------------------------------------------------------------------------

Lauren McGrath is an Associate Email Strategy & Execution Manager at digital
marketing agency DMi Partners, which she joined in 2021. Lauren, a New Jersey
native who earned a bachelor’s degree in fashion merchandising and an MBA from
Thomas Jefferson University, builds and optimizes email campaign execution
processes for a portfolio of brands across B2C, CPG and B2B verticals. She began
her email marketing career in 2018 and is passionate about raising the bar for
email performance standards across the marketing industry.

 

 

 

 

Posted in: Demanding Views

Tagged with: DMi Partners


ADVERTISEMENT



ADVERTISEMENT


LATEST POSTS


NOT YOUR GRANDPARENT’S PRESIDENT’S CLUB: THE NEXT GENERATION OF
INCENTIVIZATION  


THE SMS EVOLUTION: HOW TEXT MESSAGING CAN ENHANCE YOUR COMMUNICATION STRATEGIES


IN THE AGE OF AI, HUMAN VALUE IS CLEARER THAN EVER


GENERATIVE AI EXPERIENCES: 3 WAYS TO TAP INTO A NEW RETARGETING GOLDMINE



ADVERTISEMENT


GENERAL

 * Industry News
 * Demanding Views
 * Financial News
 * Case Studies
 * Solution Spotlight
 * Podcasts
 * Blog
 * Subscribe

 * Industry News
 * Demanding Views
 * Financial News
 * Case Studies
 * Solution Spotlight
 * Podcasts
 * Blog
 * Subscribe


TOPICS

 * ABM/ABX
 * Content Strategy
 * Demand Generation
 * Go-To-Market Strategy
 * Personalization
 * Predictive Marketing
 * Revenue Operations
 * Sales Enablement
 * View All Topics »

 * ABM/ABX
 * Content Strategy
 * Demand Generation
 * Go-To-Market Strategy
 * Personalization
 * Predictive Marketing
 * Revenue Operations
 * Sales Enablement
 * View All Topics »


RESOURCES

 * “State Of” Guides
 * Tactical Guides
 * Research
 * Reports
 * Webinars
 * E-books
 * White Papers
 * iPapers
 * View All Resources »

 * “State Of” Guides
 * Tactical Guides
 * Research
 * Reports
 * Webinars
 * E-books
 * White Papers
 * iPapers
 * View All Resources »


ABOUT US

 * Overview
 * Advertise
 * Editorial Calendar

 * Overview
 * Advertise
 * Editorial Calendar


EVENTS

 * B2B Marketing Exchange
 * B2B Marketing Exchange East

 * B2B Marketing Exchange
 * B2B Marketing Exchange East


CONTACT US

Phone:
1.888.603.3626

Email:
info@demandgenreport.com

Social:

 * Follow
 * Follow
 * Follow
 * Follow

Ⓒ 2024 Emerald X, LLC. All rights reserved.
ABOUTCAREERSAUTHORIZED SERVICE PROVIDERSYour Privacy ChoicesTERMS OF USEPRIVACY
POLICY
 * Latest
 * Topics
 * Resources
 * Podcast
 * Events
 * More
 * Subscribe

View All Posts »Industry NewsDemanding ViewsFinancial NewsSolution SpotlightCase
StudiesPodcastsBlogs
View All Posts »ABM/ABXContent StrategyDemand GenerationGo-To-Market
StrategyPersonalizationPredictive MarketingRevenue OperationsSales Enablement
View All Resources »"State Of" GuidesTactical
GuidesResearchReportsWebinarsE-booksWhite PapersiPapersInfographics
About UsAdvertiseEditorial Calendar
Q

This website uses cookies to enhance user experience and to analyze performance
and traffic on our website. We also share information about your use of our site
with our social media, advertising and analytics partners.Privacy Policy
Cookies Preferences Reject Non-Essential Cookies Accept All Cookies



PRIVACY PREFERENCE CENTER




 * YOUR PRIVACY


 * STRICTLY NECESSARY COOKIES


 * OPT-OUT OF SALE OR SHARING

YOUR PRIVACY

When you visit our website, we store cookies on your browser to collect
information. The information collected might relate to you, your preferences or
your device, and is mostly used to make the site work as you expect it to and to
provide a more personalized web experience. However, you can choose not to allow
certain types of cookies, which may impact your experience of the site and the
services we are able to offer. Click on the different category headings to find
out more and change your default settings according to your preference. You
cannot opt-out of our First Party Strictly Necessary Cookies as they are
deployed in order to ensure the proper functioning of our website (such as
prompting the cookie banner and remembering your settings, to log into your
account, to redirect you when you log out, etc.). If you wish to opt out of the
processing of your personal information for any of the above purposes, and your
state of residence provides for such opt-out right, please complete this form.
For more information on your rights and our privacy practices, please read our
Privacy Policy

STRICTLY NECESSARY COOKIES

Always Active

These cookies are necessary for the website to function and cannot be switched
off in our systems. They are usually only set in response to actions made by you
which amount to a request for services, such as setting your privacy
preferences, logging in or filling in forms. You can set your browser to block
or alert you about these cookies, but some parts of the site will not then work.
These cookies do not store any personally identifiable information.

 * FUNCTIONAL COOKIES
   
   Always Active
   
   These cookies enable the website to provide enhanced functionality and
   personalisation. They may be set by us or by third party providers whose
   services we have added to our pages. If you do not allow these cookies then
   some or all of these services may not function properly.

OPT-OUT OF SALE OR SHARING

Opt-out of Sale or Sharing


You have the right to opt-out of the sale or sharing of your personal
information to third parties. These cookies collect information for analytics
and to personalize your experience with targeted ads. You may exercise your
right to opt out of the sale or sharing of personal information by using this
toggle switch. If you opt out we will not be able to offer you personalized ads
and will not hand over your personal information to any third parties.
Additionally, you may contact our privacy department for further clarification
about your rights as a consumer by using this Exercise My Rights form. If you
have enabled privacy controls on your browser (such as a plugin), we have to
take that as a valid request to opt-out. Therefore we would not be able to track
your activity through the web. This may affect our ability to personalize ads
according to your preferences.

 * PERFORMANCE COOKIES
   
   Switch Label
   
   These cookies allow us to count visits and traffic sources so we can measure
   and improve the performance of our site. They help us to know which pages are
   the most and least popular and see how visitors move around the site. All
   information these cookies collect is aggregated and therefore anonymous. If
   you do not allow these cookies we will not know when you have visited our
   site, and will not be able to monitor its performance.

 * TARGETING COOKIES
   
   Switch Label
   
   These cookies may be set through our site by our advertising partners. They
   may be used by those companies to build a profile of your interests and show
   you relevant adverts on other sites. They do not store directly personal
   information, but are based on uniquely identifying your browser and internet
   device. If you do not allow these cookies, you will experience less targeted
   advertising.

Back Button


COOKIE LIST

Filter Button
Consent Leg.Interest
checkbox label label
checkbox label label
checkbox label label

Clear
checkbox label label
Apply Cancel
Confirm My Choices
Reject All Allow All