Anticiparallelism

Computerworld - Microsoft Corp. researcher Eric Horvitz says he's trying to figure out "what a computer should worry about when its thumbs are twiddling." Computers spend a huge amount of time twiddling their digital digits, wasting computational resources, he says.
Computers shouldn't be surprised by requests, especially from regular users, says Horvitz. For example, a PC running a network application could, while temporarily idle, prefetch and cache content from the Internet that a user may need later. Horvitz calls this "continual computing," in which computers stay busy by anticipating users' wishes.
Ethernet inventor Bob Metcalfe estimates that more than 99% of the world's computer capacity is wasted. He points out that modern microprocessors, such as Intel Corp.'s Itanium, engage in speculative execution - in which some values are computed or retrieved before they are needed - while doing other work. He says that principle should be moved to higher levels, to the operating system and to application software.
"What's done at the hardware level is really minuscule compared to what could be done," says Metcalfe, a partner at Polaris Venture Partners in Waltham, Mass. "This is a very old, deep idea that needs to be pursued much further than it has." He calls the idea "anticiparallelism."
Metcalfe argues for new control structures in languages that make it easier for programmers to enable anticiparallelism. "We need constructs that would let you say, 'Here's a bunch of things that need doing, and here's an expression of their priority,' " he says.
Some elements of continual computing are embodied in IBM's Autonomic Computing initiative, which aims to make systems self-managing. IBM is developing software that can reconfigure itself while constantly striving to optimize its own performance. "It will monitor its constituent parts and fine-tune workflow to achieve predetermined system goals," according to IBM.
In Horvitz's model, continual computation requires the computer to examine possible actions and execute those with the highest "expected value." Expected value is calculated by multiplying the probability that the user will want to take a path by the value of having it done in advance. The greater the delay avoided, the greater the value.
Many applications could take advantage of continual computation, Horvitz says. "Imagine if [Microsoft] Outlook maintained a set of probabilities based on you as the user - what you tend to do with e-mail messages, how you tend to view them, how you go back to them," he explains. Delays would be minimized because Outlook would perform many tasks before being asked, Horvitz claims.
"And Microsoft Project could