The U.S. military killed al-Qaeda propagandist Anwar al-Awlaki in a drone strike in the deserts of Yemen. While much of the American public discourse has focused on the dilemma of whether al-Awlaki's U.S. citizenship should have entitled him to due process of law before the assassination, there is another ethical debate that needs to be raised: Where are drone attacks leading the future conduct of war?
There is general consensus behind the effectiveness of drones as weapons of war -- they are cheap, accurate and avoid having to put boots on the ground. But the U.S. government is attempting to further increase automation in warfare by pursuing the creation of lethal autonomous robots (LARS). This pursuit of full artificial intelligence and autonomy for weapons is thus leading some researchers and academics to ask whether it is possible to make such automated robots act ethically. Even Canada's Department of National Defence has claimed that it is interested in acquiring such technology, assuming the "right balance" can be struck between enhanced robotic autonomy, potential costs and issues of legality and morality.
Much attention is starting to be paid to the question of whether computer programmers, software designers and engineers can build a fully autonomous robot; one that is artificially intelligent and can make moral judgments, as well as act in accordance with the rules of war without a human being's directives. These digital pioneers believe that they will be able to do so by successfully programming grand moral theories alongside the laws of armed conflict and rules of engagement.
Unfortunately, this seems at best hubristic and at worst dangerous. It is hubristic to think humans can program machines to act ethically when we cannot program ourselves to do so consistently and it would be dangerous to unleash weapons that cannot, ultimately, be controlled.
The consensus among roboticists seems to be that the most desired programming tactic for future LARS is to take mixture of "top-down" and "bottom-up" programming. Top-down programming, crudely, consists of designing a set of algorithms that match commands, for instance, "never harm non-combatants." Contrarily, bottom-up software design allows artificial agents to learn through experience. The robot works through a set of rewards, seeks patterns, and thus learns.
Both approaches, roboticists agree, have their limitations. One limitation for top-down programming is that software designers would have to foresee every possible situation and code an algorithm accordingly. Another is that such rigid systems might encounter conflicting commands and leave the machine without a clear directive. Bottom-up approaches also have their worries. Mainly, it is that, just like human beings, robots can "go bad." If an artificial agent learns that a particular behaviour can pay off, then it might continue to act in this way, even if the action violated laws of war, morality or simply common sense. It is impossible to predict how an artificial intelligence would perceive the world we leave in, especially so in a combat situation.
The solution, the experts feel, is a hybrid of both techniques: The machines will be allowed to learn, but they will also have programmed commands to forbid them from certain actions.
A recent report compiled for the U.S. Office of Naval Research argues that this hybrid approach should take on the contours of virtue ethics, where ethics in any given situation are defined as dependent upon the morality of the active individual. LARS should be programmed to have "moral character," and in particular the "ideal character traits of a warfighter." This raises ethical issues for the human programmers as well -- would a human-designed robot, with moral agency, be a slave if programmed to only act within a narrow range of options?
Human beings are attempting to codify the set of ideal characteristics, virtues, moral commands, moral dispositions and even the capacity of judgment into a set of algorithms to then impart to a machine. However, for thousands of years, humanity has not only questioned what morality requires, but also correspondingly attempted to create good people, without much success.
In the worst case, the push to create fully autonomous lethal robots and to impart these weapons with artificial morality flirts with an unknown danger. Aside from the Hollywood-type fears, profitably shown in television programs such as Battlestar Galactica or films such as Terminator, that these deadly robots will threaten the human race with annihilation, there is a serious worry designing ethical, and effective, software programs for these robots will prove impossible.
Free will involves, even at its most basic level, more than one option available for the agent, be they human or robotic. If governments truly want to place machines in human soldiers' stead on the battlefield, then there is no guarantee that LARS will indeed act ethically, despite assurances that the laws of war will be enshrined as commands.
The ethical debate about morality, law, and war is a concern of jurists, ethicists and the public at large. Anwar al-Awlaki is just the beginning.
This piece was co-authored with Heather Roff. It first appeared in the Full Comment section of The National Post.
Heather Roff is an assistant professor at the University of Waterloo. Bessma Momani is a senior fellow at The Centre for International Governance Innovation and an associate professor at the University of Waterloo.
Nehad Ismail: The Future is Grim for Al-Qaeda
Al Qaeda drone attacks on US? Soon it won't be so far-fetched.
Man accused of plotting drone attacks on Pentagon, Capitol
The killing of Anwar al-Aulaqi: The White House's drone attack policy
What, prithee, is the "morality" of blowing someone up, by any means whatever?
In order to act ethically/or unethically an agent (robotic or human) must have achieved self consciousness and it doesn't seem that artificial self consciousness is on the table- at least for the purposes of the article, granted that all of these terms are rather fuzzy and imprecise. It appears that what we're talking about is exploring ways to extend the human military reach prosthetically and the ethical burden still lies with the human agent no matter how many operational decisions it chooses to delegate to its robotic surrogate/prosthetic.
Once a machine becomes an ethical agent in its own rite we're talking about a fundamentally different situation where the machine becomes just as human as we are in very important ways.
USES THEM IN AMERICA.
ON DISSENTING AMERICANS
be afraid, very afraid
Good arrticle!
To more material matters, the US military, as a policy, requires that a human be in the loop of any lethal system. There is no talk of reversing that policy for the forseeable future. That does not mean AI scientists, robotic experts and cognitive psychologists are not studying the problems associated with AI. It is at such an infant stage that the military isn't even considering it at the operatinal level.
The number of crew onboard a warplane is irrelevant. The crew in the Nevada trailer have just as much responsibility for their actions as the pilot of a manned aircraft - in fact rather more, as they are not in fear of their lives.
Submarines - damned unsporting, what?
Observation balloons - work of the devil.
etc etc...
Drones aren't robots but human controlled pilotless planes. Many militaries use, or trying to deploy and use them for surveillance and operations. Using bombs to target individuals who are not in a war zone is a different discussion and killing/executing a US citizen without due process, is yet another.
al-awlaki, a US citizen, induced others to kill his fellow Americans. We were lucky the underpants bombers was an incompetent, but he tried to blow up the plane!
al-awlaki had declared war on his own country, and was not about to cease and desist.
The US targeted him in self-defense.
I would have revoked his citizenship first though.
Will US revoke the right of American citizenship to foreigners born here? See --
http://www.csmonitor.com/World/Global-Issues/2010/0602/Will-US-revoke-the-right-of-American-citizenship-to-foreigners-born-here
Pilotless drones are NOT "autonomous robots". They are weapons just like fighter planes, controlled by human beings -- the only difference being that the control is exercised from a safe distance, rather than the human beig having to reside within the weapon itself. Killing Awlaki might present moral dillemas (at least for some). But it makes no difference whether he was killed using a pilotless drone, a fighter plane, a cruise missile...
Why INVENT dillemas?
Whether the person that releases the weapon is holding it, sitting in a cockpit twenty feet away from it or in a trailer 8,000 miles away makes absolutely no difference to the legality of the action they take in defense of their comrades and state.
=======
Agreed!
As the [computer] saying goes:
"Garbage In... Garbage Out!"
If you have "flawed" humans programming these future automatons, their "flawed" reasoning is
going to seep into the programming (accidentally? sub-consciously?).
+++
This is a concept common in the Sci-Fi realm!
: )