Google sheds light on 'Dark Web' by searching scanned documents
Adds OCR technology so Google engine can index and search scanned PDF documents
Computerworld - Google Inc. this week took another step in its effort to shed light on the so-called Dark Web, announcing that its engine can now search scanned documents in a PDF.
Using optical character recognition (OCR) technology, Google's search engine now can convert scanned PDF documents into text that can be searched and indexed, the company said. Thus, government reports, academic papers and other scanned documents can now show up in search results. Search engines generally interpret PDF documents as images of text rather than text.
"While we've indexed documents saved as PDFs for some time now, scanned documents are a lot more difficult for a computer to read," Evin Levey, a Google product manager, wrote in a blog post. "To people reading these documents, the distinction between words and pictures of words makes little difference, but for a computer the picture is almost unintelligible. In the past, scanned documents were rarely included in search results as we couldn't be sure of their content. We had occasional clues from references to the document -- so you might get a search result with a title but no snippet highlighting your query."
This is part on an ongoing effort by Google to shed more light on the Deep, or Dark Web, where lies a massive amount of information that can be accessed but not indexed by a search engine because it is behind databases or in a format -- like PDF -- that can't be easily searched. In April, Google announced that it had started experimenting to find ways for its search engine to index HTML forms such as drop-down boxes or select menus that otherwise couldn't be found or indexed.
Jason Kincaid, a blogger at TechCrunch, noted that searching scanned documents equates to a "feat that requires and an immense amount of processing power" and advanced optical imaging technology.
"In the past, Google would attempt to index these image files as well as possible, but could typically search only file titles and nearby metadata -- not the contents of the documents," he added. "From now on, Google searches will include the text within these scanned images in normal search results. Such technology has existed for quite a while, but accuracy has always been an issue -- and the fact that Google is doing it on such a massive scale makes it a very impressive accomplishment. It also opens the doors to much more thorough searching, especially for content that is often found in printed documents (like academic papers)."
Read more about Web 2.0 and Web Apps in Computerworld's Web 2.0 and Web Apps Topic Center.



- Excel 2010 Cheat Sheet
- Register for this Computerworld Insider Cheat Sheet and gain access to hundreds of premium content articles, guides, product reviews and more.
- Why Business Ethernet Services?
- Everybody's heard the cliché, "the network is your business." But that's not going to help you choose the best wide area networking service...
- Overcome Top 7 Admin Challenges of Active Directory
- As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable,...
- Insiders Can Ruin Your Company. Take Action.
- Did you know that 80 percent of threats to an organization come from the inside? The threat from insiders is often overlooked in...
- Top Solutions and Tools to Prevent Devastating Malware
- Custom malware frequently goes undetected. According to Forrester Research, the best way to reduce risk of breach is to deploy file integrity monitoring...
- Streamline Compliance and Increase ROI
- Streamline, simplify, and automate compliance related activities; especially those that impact multiple business units. This white paper from NetIQ, outlines solutions that will... All Web 2.0 and Web Apps White Papers
- Optimizing Networks for the Cloud
- Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
- Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
- Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
- Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
- Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
- Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
- Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
- Virtualize Business-Critical Applications with Confidence
- Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®... All Web 2.0 and Web Apps Webcasts