Evan Schuman: Killer robots? What could go wrong? Oh, yeah ...
The UN wants to talk about killer robots as 'conventional weapons.' Someone needs to learn the IT facts of life: If something can go wrong, it will.
Computerworld - Has anyone at the United Nations ever used Windows? This question occurred to me after reading an article with the headline "'Killer robots' to be debated at UN."
This was the kind of news item that makes you double-check the URL to make sure it's not from a satirical site like The Onion. But no; it was from a real news organization, the BBC. According to the report, "Killer robots will be debated during an informal meeting of experts at the United Nations in Geneva" later this year.
The report defines a killer robot as "a fully autonomous weapon that can select and engage targets without any human intervention." The BBC adds that "the meeting will be held during the UN Convention on Certain Conventional Weapons." It's probably best to not ask when the UN decided that killer robots are now "conventional weapons."
I find this frightening -- and Windows has a lot to do with that. Well, the real reason is that I'm familiar with the IT facts of life. Websites operate perfectly fine for months and months and then, without anyone touching one line of HTML code, they suddenly glitch. Windows desktop units, years after blue screens of death were supposed to be extinct, freeze without any apparent cause. Mobile apps are developed and rolled out with egregious security holes.
And now we're talking about autonomous killing machines? Talk about your killer mobile apps! These could come with missiles and automatic weapons. The idea is that these devices would sharply reduce casualties, at least from the side that launched them. The problem is doing that while making the fatal IT assumption that computer programs never fail, fail-safes are always reliable and nothing will be overlooked. Sound like any IT operations you've ever seen on Earth?
Here are some more annoying bits of reality: cyberthieves, hostile governments and terrorists. Bad guys have been known to break into sites and then take over (scripts are far easier to trick than even government workers), with freedom to access -- or destroy -- unlimited data.
The technology hurdle that has to be cleared before we, as a society, even consider killer robots is this: strict quintuple-verified authentication. The robot's program must have a foolproof means -- with as many layers of backups and fail-safes as possible -- of verifying any orders it is given. Autonomy will have to be limited at least to the extent that the robots will respond to self-destruct or shutdown commands. But if the robots are truly autonomous -- well, just stream I, Robot or The Matrix if you're unfamiliar with the sorts of nightmare scenarios sci-fi has already shown us. And when it comes to killer robots, I think a nightmare is inevitable.
More by Evan Schuman
- Evan Schuman: What if you can't trust your inbox?
- Evan Schuman: Supreme Court on obvious patents: Common sense isn't so horrible
- Evan Schuman: Do you know the people you're following on Twitter? Neither does Twitter, apparently
- Evan Schuman: Is Google forgetting that interactivity pays its bills?
- Evan Schuman: Killer robots? What could go wrong? Oh, yeah ...
- Evan Schuman: One law to rule all data breaches -- but let's make it a real law
- Evan Schuman: Snapchat's reputation is vanishing (unlike its images)
- Evan Schuman: Snapchat's latest feature shows why IT must tame marketing's inner monster
- Evan Schuman: With Heartbleed, IT leaders are missing the point
- Evan Schuman: Social media endangers corporate secrets
- Enable secure remote access to 3D data without sacrificing visual perfomance Design and manufacturing companies must adapt quickly to the demands of an increasingly global and competitive economy. To speed time to market for...
- The Truth About Virtual Computing for CAD If you're a user of graphics-intensive software such as 3D modeling, simulation and analysis, and visualization, you might be skeptical about moving to...
- Simplifying Product Design In A Complex World Product design engineering has moved far beyond the confines of ever-more powerful workstations. Companies can't afford to restrict projects to using only local...
- A Reference Architecture for the Internet of Things The aim of this is to provide Architects and Developers of IoT projects with an effective starting point that covers the major requirements...
- What should I look for in a Next Generation Firewall? SANS Provides Guidance With so many vendors claiming to have a Next Generation Firewall (NGFW), it can be difficult to tell what makes each one different....
- Why Are Customers Really Deploying an NGFW? It seems every IT Security expert is talking about the NGFW, but what are people really doing? This webcast covers 5 real-world customer... All Hardware White Papers | Webcasts
Our new weekly Consumerization of IT newsletter covers a wide range of trends including BYOD, smartphones, tablets, MDM, cloud, social and what it all means for IT. Subscribe now and stay up to date!