Google sheds light on 'Dark Web' by searching scanned documents
Adds OCR technology so Google engine can index and search scanned PDF documents
Using optical character recognition (OCR) technology, Google's search engine now can convert scanned PDF documents into text that can be searched and indexed, the company said. Thus, government reports, academic papers and other scanned documents can now show up in search results. Search engines generally interpret PDF documents as images of text rather than text.
"While we've indexed documents saved as PDFs for some time now, scanned documents are a lot more difficult for a computer to read," Evin Levey, a Google product manager, wrote in a blog post. "To people reading these documents, the distinction between words and pictures of words makes little difference, but for a computer the picture is almost unintelligible. In the past, scanned documents were rarely included in search results as we couldn't be sure of their content. We had occasional clues from references to the document -- so you might get a search result with a title but no snippet highlighting your query."
This is part on an ongoing effort by Google to shed more light on the Deep, or Dark Web, where lies a massive amount of information that can be accessed but not indexed by a search engine because it is behind databases or in a format -- like PDF -- that can't be easily searched. In April, Google announced that it had started experimenting to find ways for its search engine to index HTML forms such as drop-down boxes or select menus that otherwise couldn't be found or indexed.
"In the past, Google would attempt to index these image files as well as possible, but could typically search only file titles and nearby metadata -- not the contents of the documents," he added. "From now on, Google searches will include the text within these scanned images in normal search results. Such technology has existed for quite a while, but accuracy has always been an issue -- and the fact that Google is doing it on such a massive scale makes it a very impressive accomplishment. It also opens the doors to much more thorough searching, especially for content that is often found in printed documents (like academic papers)."
Read more about Web Apps in Computerworld's Web Apps Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Face Time Anytime Real-time communications facilitates team collaboration from nearly anywhere in the world. With facts and figures you can use to justify an investment
- Riverbed Stingray Application Firewall: Securing Cloud Applications with a Distributed Web Application Firewall Responsibility over IT security is moving away from the network and IT infrastructure and to the application and software architecture itself. IT organizations...
- Now is the time to implement a video conference solution Video conferencing is getting a lot of buzz lately due to the recent cost decrease, making it tangible for many law firms. It's...
- Video drives engagement Achieving maximum results means building a solid platform and network infrastructure. As digital age unfolds, it's clear that the ability to communicate effectively...
- Meg Whitman presents Unlocking IT with Big Data During this Web Event you will hear Meg Whitman, President and CEO, HP discuss HAVEn - the #1 Big Data platform, as well...
- The New Way to Work Knowledge Vault This Knowledge Vault focuses on how, in today's increasingly virtual world, it's more important than ever to engage deeply with employees, suppliers, partners,... All Web Apps White Papers | Webcasts