Last year, we looked at 22 data analysis tools. This year, we add 8 more to the mix.
Reporters wrangle all sorts of data, from analyzing property tax valuations to mapping fatal accidents -- and, here at Computerworld, for stories about IT salaries and H-1B visas. In fact, tools used by data-crunching journalists are generally useful for a wide range of other, non-journalistic tasks -- and that includes software that's been specifically designed for newsroom use. And, given the generally thrifty culture of your average newsroom, these tools often have the added appeal of little or no cost.
I came back from last year's National Institute for Computer-Assisted Reporting (NICAR) conference with 22 free tools for data visualization and analysis -- most of which are still popular and worth a look. At this year's conference, I learned about other free (or at least inexpensive) tools for data analysis and presentation.
Like that previous group of 22 tools, these range from easy enough for a beginner (i.e., anyone who can do rudimentary spreadsheet data entry) to expert (requiring hands-on coding). Here are eight of the best:
What it does: This utility suite available from Christopher Groskopf's GitHub account has a host of Unix-like command-line tools for importing, analyzing and reformatting comma-separated data files.
What's cool: Sure, you could pull your file into Excel to examine it, but CSVKit makes it quick and easy to preview, slice and summarize.
For example, you can see all your column headers in a list -- which is handy for super-wide, many-column files -- and then just pull data from a few of those columns. In addition to inputting CSV files, it can import several fixed-width file formats -- for example, there are libraries available for the specific fixed-width formats used by the Census Bureau and Federal Elections Commission.
Two simple commands will generate a data structure that can, in turn, be used by several SQL database formats (Mr. Data Converter handles only MySQL). The SQL code will create a table, inferring the proper data type for each field as well as the insert commands for adding data to the table.
The Unix-like interface will be familiar to anyone who has worked on a *nix system, and makes it easy to save multiple frequently used commands in a batch file.
Drawbacks: Working on a command line means learning new text commands (not to mention the likely risk of typing errors), which might not be worthwhile unless you work with CSV files fairly often. Also, be advised that this tool suite is written in Python, so Windows users will need that installed on their system as well.
Skill level: Expert
Runs on: Any Windows, Mac or Linux system with Python installed.
Related tools: Google Refine is a desktop application that can do some rudimentary file analysis as well as its core task of data cleaning; and The R Project for Statistical Computing can do more powerful statistical analysis on CSV and other files.
Apple device sales
|Quarter ending||Unit sales (millions)||Device|
What's cool: In addition to sortable tables, results can be searched in real time (results are narrowed further with each search-entry keystroke).
Drawbacks: Search capability is fairly basic and cannot be narrowed by column or by using wildcard or Boolean searches.
Skill level: Expert
Learn more: Numerous examples on the DataTables site show many ways to use this plug-in.
Interview with Alberto Escarlate, CEO of Filechat, at Techcrunch Disrupt.
Apple reported a blockbuster quarter with record revenue, profit and iPhone sales.
This quick animation shows asteroid 2004 BL86's path towards earth, which will pass by on Jan. 26, the...
Sponsored by Informatica
Sponsored by Intel
Sponsored by Intel
At GoogleX, failure isn't just a good thing. It's something their engineers strive for, the head of...
Of the hundreds of TED talks available online, many are geared toward helping people view life in a new...
IBM has introduced 20 new predictive analytics solutions across 12 industries, all tailored for...
The number of software developers in the workforce is up from last year, but jobs in enterprise IT may...