Data exposure: Using software to redact personal data from public documents
Algorithms, manual intervention are among the options used to clean up online documents
April 13, 2006 12:00 PM ETComputerworld - The personal data of millions of U.S. residents may have been exposed by the public posting of official documents, and local governments are increasingly looking for ways to automate the process of cleaning up data being put online.
Among the solutions available is redaction software that allows government agencies to remove sensitive personal data from the online images of public records. The software, which is being used in at least two Florida counties now, works in much the same way antispam software does -- by using algorithms to analyze images for specific phrases or words.
Some vendors use multiple levels of automatic analysis, while others narrow down the number of documents likely to need redaction, then use human intervention to winnow the desired data and train the applications for improved automatic redaction.
Its a new technology, but a proven technology, said Paul Miller, president of Aptitude Solutions Inc. in Casselberry, Fla. Aptitude Solutions provides its aiRedact software to Broward and Hillsborough counties in Florida, as well as to counties in other states.
The issue of removing sensitive information -- including Social Security numbers, bank account information, drivers license data and personally identifying details -- from public documents is gaining attention in light of concerns from privacy advocates. They have argued that the number of public documents being posted online with sensitive data included could open the door for a wave of identity theft and fraud (see Data exposure: Counties across the U.S. posting sensitive info online). To meet that concern, county officials across the nation are turning increasingly to software to remove that data.
Since finding information in scanned images is more complex than simply locating instances of unique words in a text file, the redaction of information cant be done using traditional methods such as word-pattern analysis, according to Aptitude Solutions.
AiRedact automatically indexes and redacts images using algorithms that look for targeted numbers or words or seeking out related words in context -- adjacent words like account number or Social Security number. Once keywords are found, the software automatically redacts the information, Miller said. The software can also remove personal information by indicating a certain area on a scanned form for automatic redaction -- as long as the forms have a standard layout with information in fixed locations.
As the application looks for candidates for redaction from among millions of document images, several thousand pages are culled and analyzed individually by a person who can verify that the information should be redacted. As the pool of documents is reviewed, the software automatically adjusts to redact the remaining records based on the choices made manually, Miller said.
Privacy
Additional Resources



White Papers & Webcasts
Forrester Consulting - Optimizing Users and Applications in a Mobile World
Learn how to successfully deploy a WAN optimization solution that is specifically tuned for a mobile environment!
Data Protection and Disaster Recovery with iSCSI and VMware
Get this on demand webcast now
Faster, Cheaper and Easier to Maintain
Can you afford not to upgrade your servers to today's advanced, energy-efficient technologies?
The State of PCI DSS Compliance at Organizations Today
Download this resource today!
Effectively Implementing Datacenter Automation
Effectively select and deploy the best datacenter automation solution today!
IDC Research Report: The Business Value of Consolidating on Energy-Efficient Servers
Download this Resource Now!
Aligning IT to Business: The Rising Importance of Application Delivery Networks
Application Delivery Networking (ADN) will play a vital role in helping enterprises incorporate strategic technologies to achieve business initiatives.
HP Technology Guide for Scalable Business Solutions
Download This Resource Now!
