Again argues that benchmarks don't tell the whole story, calls them 'at worst, misleading'
Computerworld - Microsoft's top executive for Internet Explorer (IE) today dismissed browser speed trials as "at best, not very useful, and at worst, misleading."
Microsoft's Platform Previews are skeletal editions that lack a user interface, and omit such critical navigational tools as the address bar.
In a lengthy entry on the IE blog, Hachamovitch argued that benchmarks don't realistically reflect the speed of a browser, but instead said what he called "real world scenarios" make a better yardstick.
"We think people should evaluate browser performance with real-world scenarios," said Hachamovitch. "Real-world scenarios involve using all the subsystems in the browser together rather than looking at single subsystems in isolation. Using a narrow slice of features to assess the big picture makes as little sense here as using the Acid tests to understand standards compliance."
Acid3 is the standards benchmark that most browser makers trumpet when they match their software against rivals.
Last August, for example, he pointed out that IE9 Platform Preview 4 scored better on the SunSpider suite than all rivals except Google's Chrome and Opera Software's Opera.
On one test that Hachamovitch cited as an alternative to SunSpider, IE9 Platform Preview 7 actually took longer to solve 1,000 Sudoku puzzles than Chrome's current beta version on Windows. (However, Microsoft's preview beat Chrome's "dev" build, which is roughly equivalent to IE9's Platform Preview, in the same test.)
According to Computerworld's last SunSpider tests, IE9 Beta, which launched in mid-September, lags behind the closest comparable versions of browser from Opera, Mozilla, Google and Apple.
Mozilla and Google did not immediately respond to requests for comment about Microsoft's take on browser performance.
Gregg Keizer covers Microsoft, security issues, Apple, Web browsers and general technology breaking news for Computerworld. Follow Gregg on Twitter at @gkeizer or subscribe to Gregg's RSS feed . His e-mail address is firstname.lastname@example.org.
- IE6: Retired but not dead yet
- Chrome users won't give up, keep pressing Google to restore old-style new tab page
- Google quashes 31 vulnerabilities, restores Metro mode 'steppers' with Chrome 34
- Firefox's UI face-lift on track for April debut
- Ex-Mozilla engineer blames Microsoft's rules for Metro Firefox's death
- Mozilla patches 20 Firefox flaws, plugs Pwn2Own holes
- Google reverses field, promises to restore Chrome's scrollbar arrows
- Update: Google ships Chrome 33, patches 28 bugs
- Mozilla's top exec defends in-Firefox ads, revenue search
- Mozilla taps in-Firefox ads as it searches for more revenue
Read more about Desktop Apps in Computerworld's Desktop Apps Topic Center.
- Gartner Magic Quadrant for Client Management Tools The client management tool market is maturing and evolving to adapt to consumerization, desktop virtualization, and an ongoing need to improve efficiency.
- Path Selection Infographic Path Selection Infographic
- Hyperconvergence Infographic A wide range of observers agree that data centers are now entering an era of "hyperconvergence" that will raise network traffic levels faster...
- Preparing Your Infrastructure for the Hyperconvergence Era From cloud computing and virtualization to mobility and unified communications, an array of innovative technologies is transforming today's data centers.
- Cloud Knowledge Vault Learn how your organization can benefit from the scalability, flexibility, and performance that the cloud offers through the short videos and other resources...
- LIVE EVENT: 5/7, The End of Data Protection As We Know It. Introducing a Next Generation Data Protection Architecture. Traditional backup is going away, but where does this leave end-users? All Desktop Apps White Papers | Webcasts