Skip the navigation
News

How Linux mastered Wall Street

Linux has become a dominant player in finance due to the OS kernel's ability to pass messages very quickly

By Joab Jackson
August 15, 2011 02:17 PM ET

IDG News Service - When it comes to the fast-moving business of trading stocks, bonds and derivatives, the world's financial exchanges are finding an ally in Linux, at least according to one Linux kernel developer working in that industry.

This week, at the annual LinuxCon conference in Vancouver, British Columbia, Linux kernel contributor Christoph Lameter will discuss how Linux became widely adopted by financial exchanges, those high-speed computerized trading posts for stocks, bonds, derivatives and other financial instruments.

As an alternative to traditional Unix, Linux has become a dominant player in finance, thanks to the operating-system kernel's ability to pass messages very quickly, Lameter said in an interview with the IDG News Service. In fact, the emerging field of high-frequency trading (HFT) would not be possible without the open-source operating system, he argued. Lameter himself was hired as a consultant by one exchange -- he won't say which one -- based on his work in assembling large-scale Linux clusters.

The largest exchange, the New York Stock Exchange (NYSE) Euronext, is run on a Linux system that can generate 1,500,000 quotes and process 250,000 orders every second, offering acknowledgments of each transaction within two milliseconds.

As late as 2007, Wall Street exchanges were still largely run on Unix, such as HP's AIX and Sun Microsystems' Solaris. Over the past few years however, Linux crept into this market, showing up first in ancillary systems and then running a few core exchanges.

"The release cycles with Solaris and AIX were very long -- two to three years between updates. Linux was able [to make the changes needed] within a month or so," Lameter said.

Financial exchanges need their servers to execute trades as quickly as possible. Even an edge of a few milliseconds could, over the course of trading billions of dollars a day, provide a competitive edge. This intensity created a hotbed of innovation that couldn't be easily encapsulated within multiyear release cycles, Lameter explained.

"The trading shops saw that the lowest-latency solutions would only be possible with Linux," Lameter said. "The older Unixes couldn't move as fast as Linux did."

One key attribute was the TCP/IP stack, the configuration of which determines how fast a message can be passed between two systems. Another appealing attribute has been a revamped scheduler, which ensures that a process -- one performing a trade for example -- isn't interrupted once it has been started. Lastly, thanks to an army of volunteer developers, Linux was able to offer drivers for new hardware more quickly than the large Unix vendors.

Linux also offered financial firms the ability to modify the source code to further speed performance, Lameter said. "It depends on how daring the exchange is," Lameter said, noting that NASDAQ uses a modified version of the Gentoo Linux distribution.

Reprinted with permission from IDG.net. Story copyright 2014 International Data Group. All rights reserved.
Our Commenting Policies
Blog Spotlight
Richi Jennings

Crafty hackers hack craft stores -- again.

Michaels Stores (NYSE:MIK) has finally confirmed the details of the point-of-sale hack revealed in January. It's unclear what's taken them so long -- the company claims the hack was "highly sophisticated," but everyone uses a blah-blah phrase like that.

Your humble blogwatcher notes that the problem persisted for more than a month after the news first broke. smh.

In IT Blogwatch, bloggers are aghast that, for the second time, the company's POS was hacked -- lasting almost nine months.

Robert L. Mitchell
Sharky