Home  › Email › Email Marketing

Understand SpamAssassin for Better Delivery Rates

  |  November 23, 2005   |  Comments

A peak into how SpamAssassin works, and how to test e-mail before you send.

Reputation, accreditation, and authentication are the newest weapons in the war on spam, but ISPs and companies still rely primarily on anti-spam filters to determine if they deliver email messages to the inbox, bulk folder, or infamous black hole.

Filters were the first defense against spam although crude and ineffective. Some of those one-strike-you're-out programs are still around, especially on business mail servers. Filtering has since evolved into more sophisticated programs. They use a complex collection of tests to measure the probability a message is spam, rather than trash it at the first offense.

One well-known application is SpamAssassin, an open-source project of the Apache Software Foundation. In a corporate setting, usually small to midsized businesses and ISP mail servers, it runs each email message through hundreds of tests that analyze headers, text, and HTML coding and checks domains and IP addresses against DNS (define) blocklists and filtering databases.

When a message flunks a test, it scores anywhere from a fraction of a point to multiple points. If a message scores too many points, SpamAssassin rejects it. But the message can also receive negative points (a good thing) that help offset the unwanted positive points. Check out the list of tests to get a basic understanding of what SpamAssassin checks for.

Though it can reject permission-based messages, SpamAssassin has many positives:

  • There's more latitude with content. Using a word such as "free" too often in copy might cost half a point, but the filter won't reject your message outright as some others do.

  • If your email is rejected, the ISP or receiving business may provide this detail in a bounce message; not inform you (the sender) at all; or simply insert the word "SPAM" at the beginning of the subject line when the message is delivered to the recipient. In some cases, the receiving entity will return the message with a detailed report showing exactly which tests it violated and how many points it accumulated. (This email can go back to either your reply-to email address listed in the header or your sender address. Make sure somebody monitors those mailboxes.)

  • SpamAssassin rewards you if you're listed on an individual or corporate whitelist, or with a reputation or certification agency, such as Habeas, Bonded Sender, or ISIPP's Email Senders Accreditation Program. Habeas accreditation can take 4.3 (for single opt-in) to 8 (for confirmed/double opt-in) points off your score, for example.

A couple negatives, besides the rejection potential: End users, whether individuals or corporations, can set the maximum score as high or low as they want, although a score of 5 or so is most common. They can also decide which tests to apply. The scores vary according to how SpamAssassin is configured, and users can boost or reduce them if they want.

Also, SpamAssassin penalizes messages more heavily for factors you might not control, such as using open relays or blacklisted IP addresses, or using malformed HTML or MIME (define) coding. If you flunk one of those tests, notify your HTML designer or email service provider (ESP), pronto.

This Is a Test...

Most SpamAssassin tests target obvious spammer tricks, such as misspelling potentially offensive words and forging domains or dates.

Other tests seem innocuous but could cost you, such as "g a p p y t e x t" (0.5 points), and the subject or body IN ALL CAPS (0.3 points).

Below is a sample list of 10 tests (the point values vary depending on how the end user configures SpamAssassin):

  • The subject line is all capital letters. Score: 0.459 to 1.049.

  • The message date is 12 to 24 hours before the receive date: 0.881 to 1.247.

  • The domain in the sender line doesn't match the domain in the "received" line in the headers: 0.217 to 2.127.

  • The subject contains "As Seen:" 1.511 to 1.757.

  • The subject starts with "Free": 0.286 to 0.034.

  • The message has bad MIME encoding in the header: 2.255 to 3.100.

  • The message is 90 percent to 100 percent HTML: 0.113 to 0.587.

  • The HTML font size is large: 1.182 to 1.575.

  • The message mentions Oprah Winfrey with an exclamation mark: 0.366 to 1.386.

  • "Remove" appears in a URL (e.g., www.xyz.com/remove) or email address (e.g., mailto:remove@xyz.com): 0.383 to 1.109

Check Your Content Before Sending

A message content checker can help target potential problems prior to distribution. It runs your receiver and sender addresses, subject line, and message content past a collection of SpamAssassin rules. It then reports how your message fared and whether it's likely to be filtered. Most checkers suggest a score of 5.0 will get your email sent to the spam scrap heap.

All the major delivery monitoring companies include a content checker in their offerings, as do many ESPs. One of our favorite free checkers is the Lyris' Content Checker (full disclosure: Lyris and EmailLabs are now sister companies, both having been acquired by J.L. Halsey). It delivers a more complete analysis and doesn't give you a sales pitch. Just fill in the blanks, including your email text or the full HTML coding, and submit it. You'll get an instant score on the next screen and a more detailed report by return email.

Filters will probably always be with us, whether they remain primarily anti-spam tools or evolve into mechanisms that evaluate trustworthiness. At least the playing field is more level now than it was when filters trashed your messages for a single offense.

Next, we'll look at some sample email messages that failed the SpamAssassin test, what drove the score up, and how the messages scored after making some simple changes.

Check your content, and keep on deliverin'!

Want more email marketing information? ClickZ E-Mail Reference is an archive of all our email columns, organized by topic.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Oct 3 to take advantage of Early Bird Rates!

ABOUT THE AUTHOR

Kirill Popov and Loren McDonald

As director of ISP relations and delivery, Kirill Popov creates and enforces strict usage and anti-spam policies, maintains ISP and community relations, and oversees all abuse and policy investigations and inquiries for EmailLabs clients. Kirill works with clients on best practices, content, design, and list hygiene to minimize potential delivery issues. He's a registered member of the SpamCon foundation and representsEmailLabs on AIM's Council for Responsible E-Mail.

Loren McDonald is vice president of marketing at e-mail marketing automation company EmailLabs, overseeing corporate marketing activities and client consulting services. He has 20 years experience in marketing, consulting and strategic planning. Earlier, Loren was founder and president of Intevation, an e-marketing services firm specializing in e-mail and SEM. He's held executive marketing positions at companies including USWeb/CKS (marchFIRST), NetStruxr, and Arthur Andersen.

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Email newsletters delivered right to your inbox. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

Resources

Jobs

    • Digital Marketing Analyst
      Digital Marketing Analyst (GovLoop) - Washington D.C.Are you passionate about audience acquisition? Love effective copy and amazingly effective...
    • Product Specialist
      Product Specialist (Agora Inc. ) - BaltimoreDescription: The Product Specialist is hyper-focused on the customer experience and ensures that our...
    • Partnerships Senior Coordinator
      Partnerships Senior Coordinator (Zappos.com, Inc.) - Las VegasZappos IP, Inc. is looking for a Partnerships Senior Coordinator! Why join us? Our...