Scientists warn of impending robot wars
"Unlike nuclear weapons, [autonomous weapons] require no costly or hard-to-obtain raw materials, so they will become ubiquitous and cheap for all significant military powers to mass-produce," states the letter. "It will only be a matter of time until they appear on the black market and in the hands of terrorists, dictators wishing to better control their populace, warlords wishing to perpetrate ethnic cleansing, etc. Autonomous weapons are ideal for tasks such as assassinations, destabilizing nations, subduing populations and selectively killing a particular ethnic group."
The letter ends by warning that the development of autonomous weapons could tarnish the field of artificial intelligence and create a "major public backlash" that would impede potentially beneficial AI research. The authors conclude that this "should be prevented by a ban on offensive autonomous weapons beyond meaningful human control" and are urging the UN to take action.
The FLI is not the only organization campaigning in this area, but semi-autonomous weapon systems are already proliferating, with the US Air Force predicting that "by 2030 machine capabilities will have increased to the point that humans will have become the weakest component in a wide array of systems." Critics and proponents alike have also noted that it can be difficult to draw the line when it comes to what is and what isn't an autonomous weapons system.
Other signatories to FLI's open letter include Apple co-founder Steve Wozniak, Skype co-founder Jaan Talinn, and Demis Hassabis, the CEO of DeepMind, a British artificial intelligence company acquired by Google last year. The FLI has previously published open letters on similar topics, including one in January this year calling on researchers to focus on the "societal benefits" of AI.
James Vincent