E-mail Bounces, Hard and Soft

  |  July 10, 2008   |  Comments

Sort out the confusion over e-mail bounce terminology and build a more effective list.

Whenever I discuss bounces with marketers, someone inevitably asks about hard and soft bounces. Virtually every information request that crosses my desk asks whether we split bounces this way. A straw poll of deliverability professionals indicates they all struggle with the same issue: disagreeing with the concept of hard and soft but having to live with it.

The reason for this preoccupation is the psychologically neat and intuitively obvious differentiation between temporary and permanent bounces. Unfortunately, the real world is nowhere near as tidy; using these artificial distinctions can be very harmful to your metrics and lists.

There's no agreement on hard and soft bounce definitions. The e-mail delivery protocol, SMTP (define), classifies failures as transient or permanent. Some people consider a soft bounce to be a transient failure and a hard bounce a permanent failure. This is an excellent, accurate definition, but it doesn't address future deliverability for an e-mail address, which is what marketers usually try to determine with the hard/soft distinction. Also, many e-mail systems don't record transient failures unless they persist for several days, then most are pretty much permanent.

Other people suggest that a soft bounce is a condition such as a full mailbox. Yet such situations are often indicated by SMTP permanent failure codes, as ISPs consider these to be permanent. For example, Yahoo's delivery instructions specifically cite "mailbox full" as a permanent condition that should cause removal of an address from a mailing list.

There are numerous other definitions that vary in precision and clarity. This disagreement on nomenclature results in great confusion, with marketers talking at cross purposes, but it doesn't cause direct harm. The problem occurs when decisions are made based on these definitions.

Many e-mail metrics are based on delivery rate and are where the confusion starts:

  • Deliveries = recipients - bounces

  • Open rate = (opens * 100)/deliveries

  • Click-through rate = (clicks * 100)/deliveries

  • ROI = (revenue - cost)/deliveries

Are bounces defined as all bounces or only hard bounces? Does this include transient failures? Does it include just permanent failures (where the precise definition of what constitutes permanent varies by provider)?

What matters for the metrics isn't an address's future deliverability, but whether the e-mail was successfully delivered. The hard/soft distinction is unnecessary for metrics.

Hard/soft is simply too blunt an instrument. Failures don't split neatly into temporary and permanent. Some may be permanent unless corrective action is taken. A Sympatico block, for example, is permanent, unless you contact the vendor to get it removed. Other failures may be temporary but become permanent if you take the wrong action. An AOL temporary block will expire unless you do something wrong, such as failing to reduce complaints or bounces. Both cases can occur with blocklistings. Transient errors (such as "unable to connect to server") may be permanent.

Furthermore, bounce reason codes aren't universally accurate or descriptive. A database failure can result in a "user unknown" error for perfectly valid addresses. Some sites will return with "system error" for a blocklisting, while others return it for a temporary configuration problem. Some may even return "user unknown" for a blocklisting.

Reliance on automatic classification can cause good addresses to be rejected through overly aggressive hard-bounce culling while bad addresses remain on a list due to failure to cull soft bounces. Leaving bad addresses on a list can be disastrous, resulting in high bounce rates and spamtrap hits as ISPs repurpose addresses that have been undeliverable for a long time.

For these reasons, you must put aside convenient yet misleading concepts like hard/soft and look beyond to the untidy reality that is e-mail delivery. Your marketing metrics and your list hygiene will benefit from the simplification and the complexity this entails.

Until next time,

Derek

Derek is off this week. Today's column ran earlier on ClickZ.

ClickZ Live Toronto On the heels of a fantastic event in New York City, ClickZ Live is taking the fun and learning to Toronto, June 23-25. With over 15 years' experience delivering industry-leading events, ClickZ Live offers an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!

ClickZ Live San Francisco Want to learn more? Join us at ClickZ Live San Francisco, Aug 10-12!
Educating marketers for over 15 years, ClickZ Live brings together industry thought leaders from the largest brands and agencies to deliver the most advanced, educational digital marketing agenda. Register today and save $500!

ABOUT THE AUTHOR

Derek Harding

Derek is the managing director of J-Labs, Javelin Marketing Group's technology skunkworks, a role that draws on his 20 years of experience and leadership in the fields of marketing and technology. A British expatriate based in Seattle, Washington, Derek is perhaps better known as the founder and technologist behind Innovyx, one of the first email service providers later acquired by the Omnicom Group. An industry veteran and thought-leader, Derek is a regular expert author, contributor, conference speaker, and takes an active role in a number of industry and trade groups.

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Email newsletters delivered right to your inbox. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

Gartner Magic Quadrant for Digital Commerce

Gartner Magic Quadrant for Digital Commerce
This Magic Quadrant examines leading digital commerce platforms that enable organizations to build digital commerce sites. These commerce platforms facilitate purchasing transactions over the Web, and support the creation and continuing development of an online relationship with a consumer.

Paid Search in the Mobile Era

Paid Search in the Mobile Era
Google reports that paid search ads are currently driving 40+ million calls per month. Cost per click is increasing, paid search budgets are growing, and mobile continues to dominate. It's time to revamp old search strategies, reimagine stale best practices, and add new layers data to your analytics.

WEBINARS

Resources

Jobs

    • GREAT Campaign Project Coordinator
      GREAT Campaign Project Coordinator (British Consulate-General, New York) - New YorkThe GREAT Britain Campaign is seeking an energetic and creative...
    • Paid Search Senior Account Manager
      Paid Search Senior Account Manager (Hanapin Marketing) - BloomingtonHanapin Marketing is hiring a strategic Paid Search Senior Account Manager...
    • Paid Search Account Manager
      Paid Search Account Manager (Hanapin Marketing) - BloomingtonHanapin Marketing is hiring an experienced Paid Search Account Manager to...