Last year, we looked at 22 data analysis tools. This year, we add 8 more to the mix.
Reporters wrangle all sorts of data, from analyzing property tax valuations to mapping fatal accidents -- and, here at Computerworld, for stories about IT salaries and H-1B visas. In fact, tools used by data-crunching journalists are generally useful for a wide range of other, non-journalistic tasks -- and that includes software that's been specifically designed for newsroom use. And, given the generally thrifty culture of your average newsroom, these tools often have the added appeal of little or no cost.
I came back from last year's National Institute for Computer-Assisted Reporting (NICAR) conference with 22 free tools for data visualization and analysis -- most of which are still popular and worth a look. At this year's conference, I learned about other free (or at least inexpensive) tools for data analysis and presentation.
Like that previous group of 22 tools, these range from easy enough for a beginner (i.e., anyone who can do rudimentary spreadsheet data entry) to expert (requiring hands-on coding). Here are eight of the best:
What it does: This utility suite available from Christopher Groskopf's GitHub account has a host of Unix-like command-line tools for importing, analyzing and reformatting comma-separated data files.
What's cool: Sure, you could pull your file into Excel to examine it, but CSVKit makes it quick and easy to preview, slice and summarize.
For example, you can see all your column headers in a list -- which is handy for super-wide, many-column files -- and then just pull data from a few of those columns. In addition to inputting CSV files, it can import several fixed-width file formats -- for example, there are libraries available for the specific fixed-width formats used by the Census Bureau and Federal Elections Commission.
Two simple commands will generate a data structure that can, in turn, be used by several SQL database formats (Mr. Data Converter handles only MySQL). The SQL code will create a table, inferring the proper data type for each field as well as the insert commands for adding data to the table.
The Unix-like interface will be familiar to anyone who has worked on a *nix system, and makes it easy to save multiple frequently used commands in a batch file.
Drawbacks: Working on a command line means learning new text commands (not to mention the likely risk of typing errors), which might not be worthwhile unless you work with CSV files fairly often. Also, be advised that this tool suite is written in Python, so Windows users will need that installed on their system as well.
Skill level: Expert
Runs on: Any Windows, Mac or Linux system with Python installed.
Related tools: Google Refine is a desktop application that can do some rudimentary file analysis as well as its core task of data cleaning; and The R Project for Statistical Computing can do more powerful statistical analysis on CSV and other files.
Apple device sales
|Quarter ending||Unit sales (millions)||Device|
What's cool: In addition to sortable tables, results can be searched in real time (results are narrowed further with each search-entry keystroke).
Drawbacks: Search capability is fairly basic and cannot be narrowed by column or by using wildcard or Boolean searches.
Skill level: Expert
Learn more: Numerous examples on the DataTables site show many ways to use this plug-in.
Microsoft's Windows 10 got off to a roaring start in its first few days.
Many Windows users are looking forward to the imminent release of Microsoft's new operating system. But...
Yes, you can get the Windows 10 final RTM build, right now for download, even before the release date....
Sponsored by Informatica
Sponsored by Intel
Sponsored by Intel
Windows Vista, the perception-plagued operating system Microsoft debuted in early 2007, now powers just...
Ikea's new line of furniture is following an industry trend toward embedding wireless charging into...
Cloud pioneers Nordstrom and Oscar Insurance say IT shops can be faster, more agile and more...
We review three approaches to using containers as an alternative to virtual machines.