Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Bessma Momani

GET UPDATES FROM Bessma Momani

The Morality of Drone Attacks

Posted: 10/11/11 09:42 AM ET

The U.S. military killed al-Qaeda propagandist Anwar al-Awlaki in a drone strike in the deserts of Yemen. While much of the American public discourse has focused on the dilemma of whether al-Awlaki's U.S. citizenship should have entitled him to due process of law before the assassination, there is another ethical debate that needs to be raised: Where are drone attacks leading the future conduct of war?

There is general consensus behind the effectiveness of drones as weapons of war -- they are cheap, accurate and avoid having to put boots on the ground. But the U.S. government is attempting to further increase automation in warfare by pursuing the creation of lethal autonomous robots (LARS). This pursuit of full artificial intelligence and autonomy for weapons is thus leading some researchers and academics to ask whether it is possible to make such automated robots act ethically. Even Canada's Department of National Defence has claimed that it is interested in acquiring such technology, assuming the "right balance" can be struck between enhanced robotic autonomy, potential costs and issues of legality and morality.

Much attention is starting to be paid to the question of whether computer programmers, software designers and engineers can build a fully autonomous robot; one that is artificially intelligent and can make moral judgments, as well as act in accordance with the rules of war without a human being's directives. These digital pioneers believe that they will be able to do so by successfully programming grand moral theories alongside the laws of armed conflict and rules of engagement.

Unfortunately, this seems at best hubristic and at worst dangerous. It is hubristic to think humans can program machines to act ethically when we cannot program ourselves to do so consistently and it would be dangerous to unleash weapons that cannot, ultimately, be controlled.

The consensus among roboticists seems to be that the most desired programming tactic for future LARS is to take mixture of "top-down" and "bottom-up" programming. Top-down programming, crudely, consists of designing a set of algorithms that match commands, for instance, "never harm non-combatants." Contrarily, bottom-up software design allows artificial agents to learn through experience. The robot works through a set of rewards, seeks patterns, and thus learns.

Both approaches, roboticists agree, have their limitations. One limitation for top-down programming is that software designers would have to foresee every possible situation and code an algorithm accordingly. Another is that such rigid systems might encounter conflicting commands and leave the machine without a clear directive. Bottom-up approaches also have their worries. Mainly, it is that, just like human beings, robots can "go bad." If an artificial agent learns that a particular behaviour can pay off, then it might continue to act in this way, even if the action violated laws of war, morality or simply common sense. It is impossible to predict how an artificial intelligence would perceive the world we leave in, especially so in a combat situation.

The solution, the experts feel, is a hybrid of both techniques: The machines will be allowed to learn, but they will also have programmed commands to forbid them from certain actions.

A recent report compiled for the U.S. Office of Naval Research argues that this hybrid approach should take on the contours of virtue ethics, where ethics in any given situation are defined as dependent upon the morality of the active individual. LARS should be programmed to have "moral character," and in particular the "ideal character traits of a warfighter." This raises ethical issues for the human programmers as well -- would a human-designed robot, with moral agency, be a slave if programmed to only act within a narrow range of options?

Human beings are attempting to codify the set of ideal characteristics, virtues, moral commands, moral dispositions and even the capacity of judgment into a set of algorithms to then impart to a machine. However, for thousands of years, humanity has not only questioned what morality requires, but also correspondingly attempted to create good people, without much success.

In the worst case, the push to create fully autonomous lethal robots and to impart these weapons with artificial morality flirts with an unknown danger. Aside from the Hollywood-type fears, profitably shown in television programs such as Battlestar Galactica or films such as Terminator, that these deadly robots will threaten the human race with annihilation, there is a serious worry designing ethical, and effective, software programs for these robots will prove impossible.

Free will involves, even at its most basic level, more than one option available for the agent, be they human or robotic. If governments truly want to place machines in human soldiers' stead on the battlefield, then there is no guarantee that LARS will indeed act ethically, despite assurances that the laws of war will be enshrined as commands.

The ethical debate about morality, law, and war is a concern of jurists, ethicists and the public at large. Anwar al-Awlaki is just the beginning.

This piece was co-authored with Heather Roff. It first appeared in the Full Comment section of The National Post.

Heather Roff is an assistant professor at the University of Waterloo. Bessma Momani is a senior fellow at The Centre for International Governance Innovation and an associate professor at the University of Waterloo.

 
The U.S. military killed al-Qaeda propagandist Anwar al-Awlaki in a drone strike in the deserts of Yemen. While much of the American public discourse has focused on the dilemma of whether al-Awlaki's ...
The U.S. military killed al-Qaeda propagandist Anwar al-Awlaki in a drone strike in the deserts of Yemen. While much of the American public discourse has focused on the dilemma of whether al-Awlaki's ...
 
 
  • Comments
  • 26
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
11:03 AM on 10/14/2011
War isn't all about morals.. if you people haven't learned from the past. For example world war 2. People obviously don't follow the rules of war... I guess she wants us to go in there on our own risking lives instead of flying in a plane with remote control from Colorado and taking him out in seconds.
This user has chosen to opt out of the Badges program
08:32 AM on 10/14/2011
(Blink...)

What, prithee, is the "morality" of blowing someone up, by any means whatever?
photo
HUFFPOST SUPER USER
chrysostomos
Zizek built my hotrod,
01:33 PM on 10/13/2011
Does a robot's ability to act autonomously within a given situation (ie. theater of war) necessarily mean that it's actions rise to the level of the ethical act?
In order to act ethically/or unethically an agent (robotic or human) must have achieved self consciousness and it doesn't seem that artificial self consciousness is on the table- at least for the purposes of the article, granted that all of these terms are rather fuzzy and imprecise. It appears that what we're talking about is exploring ways to extend the human military reach prosthetically and the ethical burden still lies with the human agent no matter how many operational decisions it chooses to delegate to its robotic surrogate/prosthetic.
Once a machine becomes an ethical agent in its own rite we're talking about a fundamentally different situation where the machine becomes just as human as we are in very important ways.
photo
HUFFPOST SUPER USER
vietveter
To the FAR LEFT
11:56 AM on 10/13/2011
IT WON'T BE LONG BEFORE THE 1%

USES THEM IN AMERICA.

ON DISSENTING AMERICANS

be afraid, very afraid



Good arrticle!
photo
ycplum
Against Stupidity, the Gods themselves try in Vain
03:59 PM on 10/12/2011
Robots with an autonomous morality function will be consistent and predictable. Human won't. We will knowling rationalize immoral acts.

To more material matters, the US military, as a policy, requires that a human be in the loop of any lethal system. There is no talk of reversing that policy for the forseeable future. That does not mean AI scientists, robotic experts and cognitive psychologists are not studying the problems associated with AI. It is at such an infant stage that the military isn't even considering it at the operatinal level.
HUFFPOST SUPER USER
Gui Montag
Former Palestinian Supporter
10:35 AM on 10/12/2011
It saves soldiers' lives. I'm in favor of it.
ThinkCreeps
Seriously, it's time.
10:25 AM on 10/12/2011
There is no prospect of allowing machines to act independently. Even if drones were autonomous, they are simply an unoccupied extension to the existing chain of command. The decision to use lethal force still rests on a person's shoulders. Whether they are ever held responsible is an open question.

The number of crew onboard a warplane is irrelevant. The crew in the Nevada trailer have just as much responsibility for their actions as the pilot of a manned aircraft - in fact rather more, as they are not in fear of their lives.
photo
HUFFPOST SUPER USER
koos458
The Weather is Aways Nicer in Coos Bay
02:14 AM on 10/12/2011
I am sure someone agonized over the morality of using firearms instead of swords. I fail to see much, if any, moral difference between being shot dead by a soldier and being blown to smithereens by a robot. The question is whether we should be killing people at all, not how we do it. If we're going to indulge in killing, then we should use the method that places our soldiers in the least amount of danger.
This user has chosen to opt out of the Badges program
08:17 AM on 10/12/2011
Even war has laws. Protecting innocent civilians is a higher moral duty. If you want to spare soldiers, avoid war.
photo
morosemoose
Irritating the universe, one person at a time
11:46 AM on 10/12/2011
Protecting innocent civilians has alwas been a good talking point, but never put into practice. Ask the citizens of Dresden, London or Hiroshima in WWII. Or the citizens of Israel or Palestine today. And who is innocent. Is someone who designs and builds bombs innocent? Is someone who grows food to feed the soldiers who are killing people innocent? How about those who donate to charities to further the war effort? War is by definition immoral, but it is what humans have most excelled at for all of recorded history. I don't know if machines are more or less likely than humans to commit another My Lai. I would suspect less likely, but no one will know until they actually build them.
ThinkCreeps
Seriously, it's time.
10:26 AM on 10/12/2011
You're right.

Submarines - damned unsporting, what?
Observation balloons - work of the devil.
etc etc...
11:05 PM on 10/11/2011
Man, don't these guys read science fiction? Creating human-killing robots ALWAYS ends badly.
03:32 PM on 10/11/2011
He could have as easily been killed by a piloted plane, flying from some unknown location with the same effectiveness.

Drones aren't robots but human controlled pilotless planes. Many militaries use, or trying to deploy and use them for surveillance and operations. Using bombs to target individuals who are not in a war zone is a different discussion and killing/executing a US citizen without due process, is yet another.
07:30 PM on 10/11/2011
You obviously have never seen "The Mysterious Dr. Satan" or similar serials from the first half of the 20th century where robots ALWAYS were remote controlled, never autonomous.
04:32 PM on 10/13/2011
Agree with Shomali here re: drones.

al-awlaki, a US citizen, induced others to kill his fellow Americans. We were lucky the underpants bombers was an incompetent, but he tried to blow up the plane!

al-awlaki had declared war on his own country, and was not about to cease and desist.
The US targeted him in self-defense.
I would have revoked his citizenship first though.
photo
HUFFPOST SUPER USER
Jock4uni
Fiscally conservative and socially progressive.
02:17 AM on 10/14/2011
Presently, U.S. citizenship of someone, who received the citizenship by birth in the U.S. though to non-U.S.-citizen parents, cannot be revoked unilaterally.

Will US revoke the right of American citizenship to foreigners born here? See --

http://www.csmonitor.com/World/Global-Issues/2010/0602/Will-US-revoke-the-right-of-American-citizenship-to-foreigners-born-here
photo
HUFFPOST SUPER USER
NTT
Fighting rants with facts
12:42 PM on 10/11/2011
While a debate on science-fiction fighting robots is certainly a good way to kill a pleasant hour or so in the companty of friends in a bar, I really do not understand the connection to the killing of Awlaki.

Pilotless drones are NOT "autonomous robots". They are weapons just like fighter planes, controlled by human beings -- the only difference being that the control is exercised from a safe distance, rather than the human beig having to reside within the weapon itself. Killing Awlaki might present moral dillemas (at least for some). But it makes no difference whether he was killed using a pilotless drone, a fighter plane, a cruise missile...

Why INVENT dillemas?
07:32 PM on 10/11/2011
These drones are still robots. They fit the definition of a robot and watch any serial from the first half of the 20th century robots always were remotely controlled by the usually villain for the purposes of dominating the country.  It's the same with other forms of fiction from back then.
ThinkCreeps
Seriously, it's time.
10:29 AM on 10/12/2011
No more so than a guided bomb unit or an inertially-navigated ballistic missile is a robot.

Whether the person that releases the weapon is holding it, sitting in a cockpit twenty feet away from it or in a trailer 8,000 miles away makes absolutely no difference to the legality of the action they take in defense of their comrades and state.
This user has chosen to opt out of the Badges program
02:01 PM on 10/12/2011
If you want to use early 20th century cinematography to decide what should and should not be legal, we'd have to ban Tesla coils because of their capacity to raise the living dead.
This user has chosen to opt out of the Badges program
photo
ThermoChemist
"Forewarned Is Forearmed"
11:57 AM on 10/11/2011
"It is hubristic to think humans can program machines to act ethically when we cannot program ourselves to do so consistently and it would be dangerous to unleash weapons that cannot, ultimately, be controlled."
=======

Agreed!

As the [computer] saying goes:
"Garbage In... Garbage Out!"

If you have "flawed" humans programming these future automatons, their "flawed" reasoning is
going to seep into the programming (accidentally? sub-consciously?).

+++

This is a concept common in the Sci-Fi realm!

: )
photo
HUFFPOST SUPER USER
Democrab
Pretty far so good
09:54 AM on 10/11/2011
Maybe wars will be waged by robot armies entirely some day. I could live with that.
bampiesdude
Thats my story and I'm stickin to it
02:50 PM on 10/11/2011
I would imagine that there are a lot of soldiers returning with missing body parts that could live with that.
07:33 PM on 10/11/2011
The robots eventually will take inhabited areas and kill large numbers of real people. So no, this idea that there will be a battlefield far from anyone where the Fate of the World will be decided with no consequences to real people is false.