Microsoft's Dryad technology to take on Google's MapReduce
IDG News Service - Addressing the growing market for tools that handle large data sets, Microsoft has released a beta set of technologies, called Dryad, to manage and analyze large amounts of information across a cluster of Windows Servers.
The company has released Community Technology Preview editions of three packages -- called Dryad, DSC, and DryadLINQ -- that will install Dryad on Windows HPC Server 2008 R2 Service Pack 1.
"These technologies allow you to process large volumes of data in many types of applications, including data-mining applications, image and stream processing, and some scientific computations," the Microsoft Windows HPC Team Blog post stated.
First developed by Microsoft research, Dryad is a platform for running programs across multiple servers. Dryad-based programs can be broken up across multiple nodes. The pieces are connected using a process similar to Unix pipes.
Dryad can be used to analyze log data and other forms of massive collections of non-relational data, much like Google MapReduce technology does, explained Bob Muglia, Microsoft's president of server and tools, in an interview with IDG reporters.
Because Microsoft is still testing the software, the beta release can only work with up to 2,048 partitions and does not support all queries. Microsoft itself is using parts of Dryad for its own online advertising network.
- IDC Report: Optimize IT and Business Gains This IDC Whitepaper outlines how CIOs can understand what the "total cost of data" is across their entire organization and how Delphix can...
- Operationalizing the Buzz: Big Data 2013 The 2013 EMA/9sight Big Data research surveyed 259 business and technology stakeholders around the world.
- The Big Data Security Analytics Era Is Here New security risks and old security challenges often overwhelm legacy security controls and analytical tools.
- Building an Intelligence-Driven Security Operations Center The openness of today's networks and the growing sophistication of advanced threats make it almost impossible to prevent cyber attacks and intrusions.
- Charting Your Analytical Future - "Making predictive analytics part of your business processes" Webinar This session will show how predictive analytics can be used throughout the organization by anyone looking for answers and how organizations can make...
- Capturing Data in Motion: Delivering Real-Time Insight from Data Streams This webcast will help organizations of all types and sizes learn about a technology and business strategy for tapping into the wealth of... All Business Intelligence/Analytics White Papers | Webcasts
Our new bimonthly Internet of Things newsletter helps you keep pace with the rapidly evolving technologies, trends and developments related to the IoT. Subscribe now and stay up to date!