Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 
Computerworld 2007Subscribe to Computerworld
40 years of the most authoritative source of news and information for IT leaders.

Open-source spam-blocker gets high marks at Cornell

Cornell's CIO said the antispam tool is 99% effective in blocking unwanted e-mail
 

Sign up to receive Security Resource Alerts

August 04, 2003 (Computerworld) -- When the academic year begins this fall, students at Cornell University's Johnson Graduate School of Management will be armed with what its CIO sees as a powerful new weapon to battle spam.

For the past two months, the school's IT organization has been beta-testing an open-source tool called the SpamBayes Outlook Plug-in and is preparing for a broad rollout.


The SpamBayes tool blocks spam using a unique form of statistical analysis that's far more efficient and customizable than any commercially available antispam product, according to Larry Fresinski, the school's CIO.


"It's been extraordinarily effective," he said. "It catches 99% of my spam." Fresinski said he has contacted 20 other business schools to inform them about the technology.


The university has been testing the SpamBayes Outlook Plug-in with Microsoft Corp.'s Outlook XP, Outlook 2003 Beta and an Exchange 2000 server. Cornell's management school is a beta tester of Outlook 2003, which, like other e-mail products, comes with its own antispam technology. As a tester of SpamBayes, the Ithaca, N.Y.-based school has recommended the approach to Microsoft, Fresinski said.


SpamBayes is the name of an open-source project working to develop an antispam filter based on Bayesian theory, a method of statistical analysis.


The approach is different from traditional antispam technologies that use predefined rules to look for specific features or words in mail headers and body text to identify unsolicited mail. Many of these technologies also use blacklists to block mail from certain addresses.


The problem with such approaches is that they rely on a predefined and general description of spam and not on a user-specific definition of the term, Fresinski said.


SpamBayes first analyzes a user's legitimate e-mail and spam mail for clues as to what makes each different. It then applies those clues to the headers, content and style of incoming messages to determine whether they are spam.


The greater the number of initial samples and the broader the variety, the more quickly Bayesian filters can be "trained" to recognize spam, said Brian Burton, president of Burton Computer Corp., a consultancy in LaVale, Md. The company has developed an open-source tool called SpamProbe, which uses similar techniques to block spam.


"That is one of the weaknesses of this approach," Burton said. "You've got to get it to a point where it can start making the right decisions."


Although SpamBayes won't prevent Cornell's mail servers from getting spammed, it will allow end users to weed out spam more effectively, Fresinski said. So far, there hasn't been one instance in which the software has stopped legitimate mail from getting through or failed to stop spam, he said.


"It's open-source software. It's free," Fresinski said. "The beauty of it is that it continually learns what is spam to you, and not [to] some external database."













How It Works





SpamBayes



It first analyzes samplings of "good" e-mail and spam.


It builds a database of clues from these samples to ascertain what differentiates the two.


It uses these clues to examine new messages and calculate the probability that the messages are spam.










Print this Story Send Us Feedback E-mail this Story Digg! Digg this Story Slashdot this Story
Open-source spam-blocker gets high marks at Cornell
"Sometimes, no matter how much you try to protect your computer, you need to get down and dirty with the..." Read more...
"Oooh, it's IT Blogwatch: in which OpenOffice.org 3.0 breaks cover, to delight and frustrate in equal measure. Not to mention..." Read more...
Read more Desktop Applications posts or See all Blogs
Update: Microsoft to appeal $1.3B EU fine
XP SP3 cripples some PCs with endless reboots
Windows Vista more secure than XP, says security company
More top stories...
Microsoft grows DAISY for blind computer users while Adobe wilts
Sun's JavaOne show re-dubbed 'VomitOne' after stomach bug hits
Leopard at six months: Does it live up to the early hype?
Mistakes such as putting down co-workers or burning bridges when you resign are surefire ways to darken your career prospects. Here's how to avoid them
Hype and promises abound in the IT world, but these six breakthroughs really will change your life, says author and former IT manager John Brandon.
Baby boomers are retiring and taking their knowledge with them. Why do so few in IT seem to care?
Computerworld editors share stories of their first PCs, including some classics and some real clunkers -- then we ask readers to share their early-PC tales.
Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS.
Four years from now, the IT field will be a vastly different place. Will you be ready?
All Zones
Application Performance Zone
Enterprise-Class Security Zone
Enterprise Solutions Zone
The File Data Management Zone
Grid Computing on Windows Zone
Security Management Zone
ITIL Best Practices Zone
The SAS Zone
Storage Virtualization Zone
The Data Center Management Zone

Ads by TechWords

See your link here
Computerworld Report: Storage Gets Strategic
Download this Computerworld Report, free, compliments of HP.
(Source: Computerworld) Data Storage has emerged from the back room to become a key part of regulatory compliance, disaster recovery and strategic tecnhology plans. Learn more in this new this Computerworld report, a $49.95 value, available free for a limited time, compliments of HP.
Download this executive briefing download
E-Mail As a Service: Time for Another Look?
E-Mail As a Service: Time for Another Look?
Download this webcast, compliments of Google.
Go to the webcast 
3 Building Blocks for a Profitable Green IT Strategy
Get this white paper now!
(Source: Verdiem) This practical white paper compares "greening" your IT department to "greening" your home: the key to a lasting return is starting with small steps. Learn how to create an IT carbon footprint baseline, draft a list of objectives, and implement for the best ROI.
Download this white paper go
White Papers
Read up on the latest ideas and technologies from companies that sell hardware, software and services.
New Fujitsu High-End Itanium Windows- and Linux-Based PRIMEQUEST Servers Offer the Utmost in High Availability
New Fujitsu High-End Itanium-Based PRIMEQUEST Servers Offer Industry-Leading System Management for Linux and Windows
Symantec State of the Data Center Report 2007
View more whitepapers