How to plan for data migration
Computerworld - Last month, we addressed business-continuity fundamentals including data migration (see "A Business Continuity Checklist"). It's a topic that deserves its own column. In addition to business continuity, other scenarios are driving our customers to tackle data migration.
Companies are seeking well-managed storage systems to comply with regulatory requirements such as the Sarbanes-Oxley Act -- in part to combat high-cost alternatives such as distributed storage. Upgrades or migration to more commoditized platforms also present a strategic opportunity to move data.
The prospect of data migration can be overwhelming. Some of the common conditions we find among our clients are familiar to many IT managers:
- Lack of clear definition of requirements for all data. Data rules should focus on security, availability and recoverability. It's easy to imagine that documents with temporary data and permanent data could be intermingled, making it difficult to determine which data is important and which isn't.
- Distributed islands of data. Often, a business unit will implement a new application and request that the infrastructure for it remain close at hand. Unfortunately, organizational politics can exacerbate this phenomenon in the IT department, too.
- Funding constraints. Tight budgets may limit technology decisions and options, or a company may invest in technology for projected bottom-line benefits -- only for other factors to interfere with hoped-for business impact.
- Lack of expertise in heterogeneous storage environments. With each vendor's support limited to its own products, incompatibility between storage technologies becomes the problem of the IT manager.
Data migration has much in common with storage consolidation. However, storage consolidation tends to be a better-organized project because it's usually backed by executive sponsorship with specific goals for cost reduction. The CIO often understands and controls conditions that determine the success of the venture. Data migration, on the other hand, tends to be departmental in scope and/or limited to tactical objectives, which minimize project size and potential returns. We frequently advise clients to focus on the similarities between storage consolidation and data migration, to ensure that the work that's done has strategic value.
- Detail security and availability requirements. Sometimes called data classification, this requires the security and infrastructure teams to jointly identify the needs of the IT environment and ways in which data may be segregated and protected. Data classification describes conditions for data access, retention requirements and security measures such as encryption. Even a limited set of classifications will have tremendous benefit.
- Define migration requirements -- which determine success criteria. These may include new service-level agreements, expectations for the new storage infrastructure, and objectives such as reduced management costs, reduced storage expenditures, greater insight into expenditure, a simplified vendor model or greater technical flexibility or stability.
- Survey the IT environment. IT departments often use tools and scripts to do this. But migration requires a complete understanding of infrastructure technology involved, including the networks and file servers. The location of data is just as important: Without providing sufficient bandwidth capacity to support heavy network access, relocating data to a centralized repository could have adverse effects. A survey should detail the following:
- The location of the data, its capacity and growth requirements.
- Data usage as a measurement of the I/O load, sometimes called an I/O characterization.
- Data importance, which can reveal potential effect on network load and influence retention and availability requirements.
- Data classification. IT managers can decide what data requires the most expensive storage and stringent protection and what could be re-created or restored easily from an archive. They can then make well-informed, strategic decisions about future systems.
- Management costs for the current environment. This often-overlooked step offers the best opportunity to define benefits of migration.
- Design the appropriate consolidation or replacement platform, including technology, management and backup tools and procedures. Data classification and a good survey reduce the chance of an overengineered system and contribute to a platform design that will accommodate growth, availability and performance. Plus, a consistent management environment can trim the most expensive aspect of the storage environment, administration.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- The value of smarter oil and gas fields With global energy requirements continuing to rise, the exploration, development and production of new oil and gas resources are shifting to increasingly challenging...
- Smarter Environmental Analytics Solutions: Offshore Oil and Gas Installations Example This IBM Redbooks® Solution Guide describes a solution for implementing smarter environmental monitoring and analytics for oil and gas industries. The solution implements...
- Piecing Together the Business Intelligence Puzzle Business intelligence (BI) technology collects and analyzes company data, delivering relevant information to corporate decision-makers in an effort to produce favorable outcomes.
- Harness IT -- An Introduction to Business Intelligence Solutions Learn the key selection criteria required to provide your organization with the capability to address structured data, unstructured data and mobile demands so...
- Live Webcast Increasing the Value of Your Reports and Dashboards Learn how incorporating other analytical capabilities such as predictive modeling and visualization can increase the value of your reports and dashboards by providing...
- The Software-Defined Data Center: Is your ADC ready? Data center transformation is accelerating beyond virtualization to next-generation cloud architectures and software-defined data centers, bringing new challenges for application performance, scalability and...
- Application Acceleration: Optimize the End-User Experience Watch this on-demand webcast and learn how you can optimize your web content, accelerate performance across any device and browser combination, and offload... All Business Intelligence/Analytics White Papers | Webcasts