Microsoft's OneCare improves antivirus test ranking

Computerworld - Microsoft Corp.'s Windows Live OneCare climbed from March's dead last to 14th place in a test of 17 antivirus programs, an Austrian security researcher reported today.

Andreas Cleminti's AV Comparatives latest test pitted the top antivirus software against the 20,000-some threats that debuted during the last three months to measure how well each could finger unknown exploits. Cleminti stopped updating each product's virus database, or "signature," Feb. 2, but continued to probe their defenses with every newly discovered virus, malicious script, worm, Trojan, or backdoor until May 2.

"Even if most antivirus products provide daily or hourly [signature] updates, without heuristic/generic methods [of detection] there is always a time frame where the user is not protected," Cleminti said in the report issued today.

Cleminti tallied the number of threats each program detected without the benefit of new signatures, as well as totaled the "false positives," the term for when antivirus software flags an innocent, legitimate file, and timed how long it took the software to scan the test PC's hard drive.

Only one program, ESET LLC's NOD32 AntiVirus was pegged by Cleminti with the highest-possible "Advanced+" label. NOD32 correctly identified 68% of 20,522 new threats that appeared in the three months. Avira GmbH's AntiVir PE Premium and Fortinet Inc.'s FortiClient actually detected more threats -- each spotted 71% -- but high numbers of false positives downgraded the final ranking of both.

Behind NOD32 were AEC Ltd.'s TrustPort AV WS, which detected 58% of the malware, and BitDefender's same-named BitDefender Professional Plus, at 48%. GriSoft Inc.'s AVG Anti-Malware posted an 8% detection rate to rank last.

Microsoft's OneCare, which placed 17th out of 17 in March when Cleminti tested signature-updated software against nearly half a million pieces of malware, fared better this time. Although it detected only 18% of the new exploits, that was good enough for 14th place.

After Cleminti released the March report that said OneCare held last place, Microsoft conceded that their antivirus software's performance was "not stellar" and promised it would make changes to boost its rankings. Today, however, when asked what the company's anti-malware team thought of its slight climb from 14th to 17th, a spokeswoman e-mailed a stock statement that representatives had used before.

"We are looking closely at the methodology and results of the test to ensure that Windows Live OneCare performs better in future tests and determine whether any learnings from these tests can be used to improve our services," the spokeswoman said.

Symantec Corp.'s Norton AntiVirus, which detected 24% of the new threats, was the only product of the 17 tested that raised no false alarms. "Norton was again [for the third time] the only antivirus product in this test which had no false positives," the report said. "This is an indication of high quality assurance tests before the release of updates in order to avoid false positives."

The praise was poorly timed, as Symantec released a signature a week ago that mistook critical Windows files for a Trojan, and after falsely quarantining the files, crippled thousands, perhaps millions, of PCs in China.

Cleminti's report is available online (click on "Comparatives" in the nav bar, then report #14).