QuickStudy: Web Harvesting

Russell Kay   Today’s Top Stories   or  Other Business Intelligence Stories  

Driving BI Value with Data Integration: Overcoming the Thorniest Challenges Get a Grip on Storage Growth and Reduce Costs What's Next? Real Answers for Tough Times Survey: Share your Perspectives on Key IT Products and Industry Trends Survey: Business Intelligence Maturity and the Quest for Better Performance BI @ The Speed of Business Computerworld Report- Large Enterprises Pay More for IPAM An Apple for Your Enterprise? Six Questions To Ask About Information And Competition Sign up to receive Data Mining Resource Alerts

June 21, 2004 (Computerworld) -- It's hard to argue with the proposition that the World Wide Web is the largest repository of information that has ever existed. In just over a decade, the Web has moved from a university curiosity to a fundamental research, marketing and communications vehicle that impinges upon the everyday life of most people in the developed world. But there's a catch, of course. As the amount of information on the Web grows, that information becomes ever harder to keep track of and use.

Search Isn't Enough

Search engines are a big help, but they can do only part of the work, and they are hard-pressed to keep up with daily changes. For all the power of Google and its kin, all that search engines can do is locate information and point to it. They go only two or three levels deep into a Web site to find information and then return URLs. They also find and return meta descriptions and meta keywords embedded in Web pages, but these may well be inaccurate.

Consider that even when you use a search engine to locate data, you still have to do the following tasks to capture the information you need:

• Scan the content until you find the information.
• Mark the information (usually by highlighting with a mouse).
• Switch to another application (such as a spreadsheet, database or word processor).
• Paste the information into that application.

A better solution, especially for companies that are aiming to exploit a broad swath of data about markets or competitors, lies with Web harvesting tools.

Web harvesting software automatically extracts information from the Web and picks up where search engines leave off, doing the work the search engine can't. Extraction tools automate the reading, copying and pasting necessary to collect information for analysis, and they have proved useful for pulling together information on competitors, prices and financial data of all types.

Continued...
1 | 2 | NEXT  

Print this Story

Send Us Feedback

E-mail this Story

Digg this Story

Slashdot this Story

Sidebar: Web harvesting and libraries Sidebar: Resources for more information on Web harvesting

Web Harvesting Sidebar: Also Known As ...

"Yahoo's owners have spoken and Jerry Yang is out as Yahoo CEO. Does this mean that Microsoft is in?..." Read more... "In five years, IT will still be a viable career path, but it will no longer exist as the stand-alone..." Read more... Read more Business Intelligence posts or See all Blogs

Microsoft dissed Intel's 915 chipset before making 'Vista Capable' changes Microsoft dumps OneCare, slates free security software for '09 Ballmer: Yahoo acquisition won't happen, despite Yang's departure More top stories...

Obama administration to inherit tough cybersecurity challenges BlackBerry Storm sales should be strong, Verizon says Google deal produces 91% of Mozilla's revenue

2008 Salary Survey: IT pay takes tiny leaps If you're like our 7,000 survey respondents, your paycheck this year has been flattened and your bonus obliterated. We offer 12 ways to plump up your paycheck. Windows 7 in-depth review and video: This time Microsoft gets it right Microsoft's next OS might more accurately be called Windows 6.5: It's essentially a better version of Vista. Twitter for business: 5 ways to tap the power of the tweet Twitter can be a valuable business tool -- if you know what you're doing. Here's how to juice it for all it's worth. Microsoft's 'Vista Capable' changes outraged HP, insider e-mails show By helping Intel with loosened 'Vista Capable' requirements, Microsoft 'severely damaged' its credibility, said an HP exec in a newly unsealed Feb. 2006 e-mail. Windows 7 Get the latest news, reviews and more about Microsoft's newest desktop operating system More Continuing Coverage Windows 7 Voting Technology Google's Chrome browser Economy in turmoil: Latest news and tips iPhone 3G Bill Gates moves on Windows Vista A to Z Mac A to Z 2008 Salary Survey Find wage data for 50 IT job titles. More Special Reports 2008 Premier 100 IT Leaders 2007 Premier 100 IT Leaders 2008 Best Places to Work in IT 2007 Best Places to Work in IT 2008 Salary Survey 2007 Salary Survey 2006 Salary Survey 2008 IT Forecast 2007 IT Forecast 40 Years of Computerworld Top 12 Green-IT Users The FAQs About Going Green IT Schools to Watch iPhone: One Year Later Global Mobile Your Next Data Center Management: Reinventing IT Stop Data Leaks Web 2.0 Security Surviving Disasters Managing Storage Virtualization The Lean Storage Machine Storage on Trial Can Web 2.0 Save BI? Bypass These BI Potholes All Zones Business Continuity Zone The File Data Management Zone Security Management Zone The SAS Zone Business Intelligence and Analytics Zone The Enterprise Search Zone Software as a Service Zone The Security Zone See your link here

Speeding the time to intelligence Get this Computerworld report free for a limited time, compliments of SAS. Time To Intelligence -- a concept defining how long it takes to get accurate and timely information into the hands of workers who need it most. Do it slower than your competitors and your company is toast. Do it faster, you scorch them. Business Intelligence is the key to optimizing Time To Intelligence, and success there is a combination of people, policies, and technology. Download this executive briefing  Transforming Disaster Recovery - VMware Infrastructure for rapid, reliable and cost-effective Disaster Recovery Download this white paper today! (Source: VMware) VMware Infrastructure transforms disaster recovery by providing you fast, reliable and cost-effective disaster recovery. Why suffer from the slow, expensive and unreliable problems associated with traditional disaster recovery solution? VMware makes disaster recovery affordable through consolidation savings and re-use of existing servers for your disaster recovery site. Experience the speed of virtualization! Download this white paper  Turning information into a Competitive Advantage Turning information into a Competitive Advantage View this webcast now! Go to the webcast  White Papers Read up on the latest ideas and technologies from companies that sell hardware, software and services. Deploying Virtualized NetWare on Linux Whitepaper Collaboration Tools and Organizational Success Driving Business Success Through Workgroup Choice and Flexibility View more whitepapers

• Sidebar: Web harvesting and libraries
• Web Harvesting
• Sidebar: Resources for more information on Web harvesting
• Sidebar: Also Known As ...

• Microsoft dissed Intel's 915 chipset before making 'Vista Capable' changes
• Obama administration to inherit tough cybersecurity challenges
• Microsoft dumps OneCare, slates free security software for '09
• More top stories 

"Turning information into a Competitive Advantage" Companies today are realizing that competitive advantage is harder to sustain when based solely on gains in productivity and cost efficiency. The focus is shifting to invest more in business optimization initiatives which rely on trusted information to develop new insights that deliver better business results. But how can this be done efficiently in a business environment across multiple applications and processes. The answer is an Information Agenda - an innovative approach to transforming business information into a strategic asset for competitive advantage. View this webcast now!  See more Webcasts

Work Less. Deliver More. We are talking about fewer reports to create & schedule. Automatic report delivery day or night. Secure end user access to live interactive reports. Learn how in this complimentary podcast with Crystal Reports® Server 2008 — take the rush out of IT. Listen to this podcast now