Data Finds a Place on the Grid
Vendor support and standards are just evolving, but companies are looking to share data across grids.
Computerworld - The data grid has been playing second fiddle to the compute grid when it comes to media attention. But companies and public institutions searching for better ways to share and manage large amounts of data are beginning to take notice.
A compute grid allows users to take the computing resources in a distributed and heterogeneous environment, manage those disparate resources as one and focus them on problem solving.
A data grid acts in a similar way. It has a middleware layer and metadata framework to give users a centralized view of distributed data without physically centralizing the data.
That means the data can be located on Windows, Unix or Linux systems running multiple formats. It can be structured or unstructured and can consist of different media types. A data grid and a compute grid can operate togetherthe principles are the same.
But there are limits to what a grid can do. A grid, for instance, doesn't offer a means for discovering and categorizing unstructured data. What the data grid provides is a standards-based framework for interconnecting that information once those tasks are addressed.
Data-grid technology is in the early-adopter phase, drawing the interest of research institutions with large and scattered data repositories, such as Pfizer Global Research & Development in Groton, Conn., and the University of Arkansas Center for Advanced Spatial Studies in Fayetteville, as well as research consortiums such as the European Union's DataGrid project, led by particle physics research center CERN.
Data grids will find broader applications as standards mature and technology problems, such as managing security in a grid's distributed environment, are solved, say analysts and users.
"I think the whole promise of grid is pretty exciting," says Paul Lewis, director of research information architecture at Pfizer. But more work is needed, he adds.
Products that support data in a grid environment are emerging. For example, Pfizer uses Avaki Inc.'s data-grid software. The Center for Advanced Spatial Studies takes advantage of the grid capabilities in Oracle 10g, Oracle Corp.'s flagship database.
But the very concept of grids involves interconnectedness among disparate applications and data sources. Until vendors include standards-based grid capabilities, interfaces and processes in their products, data-grid adoptions are going to be limited.
"Vendors have got to step up and say, 'We're going to make our products grid-enabled,' " says Lewis. "If more vendors grid-enable products, it makes our job easier, because then we can plug in more computers when we need more capacity."
Emerging data-grid products, such as Avaki's, are being used within companies. But some of the leading thinkers behind the data-grid effort imagine developing systems that connect large numbers of enterprises, entire supply chains and customer bases.
"The equivalent of the Internet Protocol for remote access to data is still a work in progress," says Ian Foster, senior scientist and head of the Distributed Systems Lab at Argonne National Laboratory in Illinois and co-director of the grid standards effort at the Globus Alliance.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- The value of smarter oil and gas fields With global energy requirements continuing to rise, the exploration, development and production of new oil and gas resources are shifting to increasingly challenging...
- Smarter Environmental Analytics Solutions: Offshore Oil and Gas Installations Example This IBM Redbooks® Solution Guide describes a solution for implementing smarter environmental monitoring and analytics for oil and gas industries. The solution implements...
- Piecing Together the Business Intelligence Puzzle Business intelligence (BI) technology collects and analyzes company data, delivering relevant information to corporate decision-makers in an effort to produce favorable outcomes.
- Harness IT -- An Introduction to Business Intelligence Solutions Learn the key selection criteria required to provide your organization with the capability to address structured data, unstructured data and mobile demands so...
- Live Webcast Increasing the Value of Your Reports and Dashboards Learn how incorporating other analytical capabilities such as predictive modeling and visualization can increase the value of your reports and dashboards by providing...
- The Software-Defined Data Center: Is your ADC ready? Data center transformation is accelerating beyond virtualization to next-generation cloud architectures and software-defined data centers, bringing new challenges for application performance, scalability and...
- Application Acceleration: Optimize the End-User Experience Watch this on-demand webcast and learn how you can optimize your web content, accelerate performance across any device and browser combination, and offload... All Business Intelligence/Analytics White Papers | Webcasts