Google sheds light on 'Dark Web' by searching scanned documents
Adds OCR technology so Google engine can index and search scanned PDF documents
October 31, 2008 12:00 PM ETComputerworld - Google Inc. this week took another step in its effort to shed light on the so-called Dark Web, announcing that its engine can now search scanned documents in a PDF.
Using optical character recognition (OCR) technology, Google's search engine now can convert scanned PDF documents into text that can be searched and indexed, the company said. Thus, government reports, academic papers and other scanned documents can now show up in search results. Search engines generally interpret PDF documents as images of text rather than text.
"While we've indexed documents saved as PDFs for some time now, scanned documents are a lot more difficult for a computer to read," Evin Levey, a Google product manager, wrote in a blog post. "To people reading these documents, the distinction between words and pictures of words makes little difference, but for a computer the picture is almost unintelligible. In the past, scanned documents were rarely included in search results as we couldn't be sure of their content. We had occasional clues from references to the document -- so you might get a search result with a title but no snippet highlighting your query."
This is part on an ongoing effort by Google to shed more light on the Deep, or Dark Web, where lies a massive amount of information that can be accessed but not indexed by a search engine because it is behind databases or in a format -- like PDF -- that can't be easily searched. In April, Google announced that it had started experimenting to find ways for its search engine to index HTML forms such as drop-down boxes or select menus that otherwise couldn't be found or indexed.
Jason Kincaid, a blogger at TechCrunch, noted that searching scanned documents equates to a "feat that requires and an immense amount of processing power" and advanced optical imaging technology.
"In the past, Google would attempt to index these image files as well as possible, but could typically search only file titles and nearby metadata -- not the contents of the documents," he added. "From now on, Google searches will include the text within these scanned images in normal search results. Such technology has existed for quite a while, but accuracy has always been an issue -- and the fact that Google is doing it on such a massive scale makes it a very impressive accomplishment. It also opens the doors to much more thorough searching, especially for content that is often found in printed documents (like academic papers)."
Additional Resources



White Papers & Webcasts
The 2009 Handbook of Application Delivery
Learn how to become better with application delivery.
Aligning IT to Business: The Rising Importance of Application Delivery Networks
Application Delivery Networking (ADN) will play a vital role in helping enterprises incorporate strategic technologies to achieve business initiatives.
Unified Application Delivery
By providing a unified Application Delivery Networking platform, F5 BIG-IP offers the ability for organizations to adopt a single platform for all its...
Preparing Your Business Services for the Future
Would you trust your network monitoring tools enough to know when something is truly halting a business service?
ROI of Application Delivery Controllers
How modern offload technologies in Application Delivery Controllers can drastically reduce expenses in traditional and virtualized architectures, with a fast ROI.
BMC Application Performance and Analytics: Predictive Intelligence in Action
See the highlights of BMC's Application Performance and Analytics today!
Gartner: Magic Quadrant for Application Delivery Controllers, 2009
The market for products to improve the delivery of application software over networks remains dynamic and innovative. Vendors focused on solving enterprises' most-pressing...
IPAM: Slashing Network Costs
Slashing Network Costs by Consolidating and Automating Core Network Services
Gartner: Load Balancers are Dead
This research shifts the attention from basic load-balancing features to application delivery features to aid in the deployment and delivery of applications.
Extending Client Refresh - 11 Steps to Maximize Savings
Register Now!
Computerworld Reports
Disaster Recovery & Cost Savings Zone
Thousands of customers world-wide have turned to virtualization solutions from Riverbed as a way to reduce costs.
