Data exposure: Using software to redact personal data from public documents
Algorithms, manual intervention are among the options used to clean up online documents
April 13, 2006 12:00 PM ETComputerworld - The personal data of millions of U.S. residents may have been exposed by the public posting of official documents, and local governments are increasingly looking for ways to automate the process of cleaning up data being put online.
Among the solutions available is redaction software that allows government agencies to remove sensitive personal data from the online images of public records. The software, which is being used in at least two Florida counties now, works in much the same way antispam software does -- by using algorithms to analyze images for specific phrases or words.
Some vendors use multiple levels of automatic analysis, while others narrow down the number of documents likely to need redaction, then use human intervention to winnow the desired data and train the applications for improved automatic redaction.
Its a new technology, but a proven technology, said Paul Miller, president of Aptitude Solutions Inc. in Casselberry, Fla. Aptitude Solutions provides its aiRedact software to Broward and Hillsborough counties in Florida, as well as to counties in other states.
The issue of removing sensitive information -- including Social Security numbers, bank account information, drivers license data and personally identifying details -- from public documents is gaining attention in light of concerns from privacy advocates. They have argued that the number of public documents being posted online with sensitive data included could open the door for a wave of identity theft and fraud (see Data exposure: Counties across the U.S. posting sensitive info online). To meet that concern, county officials across the nation are turning increasingly to software to remove that data.
Since finding information in scanned images is more complex than simply locating instances of unique words in a text file, the redaction of information cant be done using traditional methods such as word-pattern analysis, according to Aptitude Solutions.
AiRedact automatically indexes and redacts images using algorithms that look for targeted numbers or words or seeking out related words in context -- adjacent words like account number or Social Security number. Once keywords are found, the software automatically redacts the information, Miller said. The software can also remove personal information by indicating a certain area on a scanned form for automatic redaction -- as long as the forms have a standard layout with information in fixed locations.
As the application looks for candidates for redaction from among millions of document images, several thousand pages are culled and analyzed individually by a person who can verify that the information should be redacted. As the pool of documents is reviewed, the software automatically adjusts to redact the remaining records based on the choices made manually, Miller said.
Privacy
Additional Resources



White Papers & Webcasts
Oracle Accelerate - Not Just Smart but Timely
Download Now!
Data Protection and Disaster Recovery with iSCSI and VMware
Get this on demand webcast now
Why BI is Ripe - Now! - For Businesses of Any Size
Download Now!
Data in Action: Making the Planet Smarter
Register Now
Rapid Implementation: The New Age of ERP
Download Now!
The Workday User Experience Video
Watch Workday's Creative Director, Scott Lietzke, discuss the business-centered design philosophy at Workday.
Business Process Framework Demo
Learn about Configurable Business Processes and Calculated Fields. Watch Now!

