Sunday, March 22, 2009

Robots and the Coming Revolution

I just finished a book, entitled ¨Wired for War¨ by P.W. Singer, that focuses on the use of robots in warfare. There has been an exponential rise in the use of robots in peaceful applications and in warfare and the author suggests that humanity is woefully behind debating the ethical ´behavior´and use of robots. Even science fiction is having trouble keeping up with the new realities humanity is seeing in the fields of nanotechnology, robotics, etc.

If human society finds enough resources to sustain itself (averts large-scale environmental tragedy and scarcity), then I think the following robotic vision is probable.

I have culled a few definitions, a few statistics, a few philosophical and legal questions arising from their use, and finally a few prescriptions from the author regarding robots. Buy the book.

Definitions:

A robot is a man-made device with three key components: ¨sensors¨that monitor the environment and detect changes in it,¨processors¨or ¨artificial intelligence¨ that decides how to respond, and ¨effectors¨ that act upon the environment in a manner that reflects the decisions, creating some sort of a change in the world around the robot. p.67

Artificial Intelligence is the ability of a machine to ´perceive something complex and make appropriate decisions.´ -Singer quoting Sebastian Thrun, Director of the Artificial Intelligence Laboratory at Standford. p. 77

Statistics and Interesting Facts:

-By 2007, more than 3 million Roomba robot vacuum cleaners had been sold.
-There are robot companions for the elderly in Japan, robot lawn mowers, and robot butlers. If you can imagine a robot filling a particular need, it probably is in development somewhere.
-Most of the video games characters you are playing against have AI. Most crowd scenes in Hollywood movies are now created with AI.
-Most of the currently funded robotic research comes from military budgets; therefore, the greatest technological advances in robotics have come in the realm of weaponized machines or machines that help humans keep from, recover from, being wounded in battle.
-There are robot planes, robot submarines, robot helicopters, robotic guns, robotic minesweepers and explosive ordinance robots. Most of these (some just prototypes)already autonomously perform better than their human counterparts. They can fly, shoot, etc. with more precision, more accuracy, with better timing, with better maneuverability, with better safety than if operated by humans. Currently, the military has a strong preference for keeping humans ´in the loop´....meaning giving the orders to shoot. However, there are autonomous weaponized machines that have acted without human intervention based on their own protocol.
-By 2008, there were 5,331 drone planes in the US military, double the amount of manned planes. p.37
-There is widespread speculation within the Air Force that there will be no need for human fighter pilots in future conflicts.
-93 percent of the bombs dropped in the 1991 Gulf War were ¨dumb¨, 70 percent of bombs dropped in the 2003 air campaign were precision smart bombs. p.61
-In 2006, the Defense Department budget required that the Pentagon show a ´preference for joint unmanned systems in acquisition programs´...including a requirement that if any manned system is presented, a certification must also be presented that an unmanned system is incapable of meeting program requirements. p.65There are plans for unmanned supply trucks, unmanned Humvees, and submarines with skeleton crews. In other words, all military spending has to show a preference for unmanned systems.
-¨In 1993, (Vernor) Vinge authored a seminal essay¨ entitled ´The Coming Technological Singularity: How to Survive in the Post-Human Era¨ where he projected that within thirty years, we will have the technological means to create superhuman intelligence. Shortly thereafter, the human era will end. p. 103. Think Terminator.
-Roboticists and Science Fiction writers refer to Singularity...which for robotics and strong AI is the exact time in which machines become self aware and therefore start to perform in ways outside of their programmed ´nature´. At that point uncertainty will prevail. Since the ¨intelligence¨ of machines is rising at an exponential rate and often that intelligence is adaptive, many scientists in the field predict that in less than 30 years time a machine becomes self-aware.
-Many military strategists believe that in the future there will be some combination of human and robot interaction at all levels of combat (observation, planning, actual combat in the future). Under development at DARPA is ¨Pete¨ which is an electronic assistant for commanders. Pete would work with commanders to formulate military responses. Under the military´s decision making framework of the OODA loop, Pete might perform as much as 90 percent of the Observe (gathering data), 70 percent of the Orient (making sense of data), 30 percent of the Decide, and 50 percent of the Action. p.359
-The following protocol is an example of how a robot might be programmed to act without needing human intervention: Is the target a weapon confirmed to be used by the enemy¿ Identification confirmed. Is the target located in an authorized free-fire zone¿ Location confirmed. Are there any civilians within a ____ meter radius¿ No civilians detected. Are there any friendly units within a ____ meter radius¿ No friendlies detected. Weapon release authorized. No human command authority required. p.401. There are also suggestions that a proportional response to the threat be programmed into the weaponized machine.
-It isn´t just the US military who is interested in this technology, but most other governments, some paramilitary groups, and even non-profits. A lot of these robots can be purchased at trade shows.
-The International Red Cross has a division that inspects weapons so they do not violate the Laws Of Armed Conflict (LOAC). Each nation is supposed to have its weapons inspected before they are used in combat. No nation has ever subjected its weaponized robots to these inspections.
-The city of Los Angeles is planning to fly drones over high crime neighborhoods, so these applications transcend military operations and extend to all sorts of privacy issues.

Interesting Philosophical and Legal Questions:

1) If a weaponized drone is being flown over Iraq or Afghanistan by a US operator living there (since most drones are being flown from the Southwest USA), can an Iraqi or Afghani legally target that combatant on US soil¿
2) If a drone was flown by a non-military operator (which has happened frequently, not just by firms like Blackwater, but also by design companies like Northrop Grumman), can that operator be prosecuted if they acted inappropriately¿ Would that operator be prosecuted in civilian or military courts¿
3) If a non-military combatant (drone operator) were captured, what would his/her status be legally to the enemy¿ If the US has claimed that it is fighting largely enemy combatants (not state soldiers), outside the protections of the Geneva Convention, does not Iraq and Afghanistan have the same legal standing to ´hold´or ´torture´ any US paramilitary contractor and/or military contract firm¿
4) If a computer scientist were to code a weaponized machine that is used properly but malfunctions causing civilian or friendly deaths, should the computer scientist be prosecuted¿
5) If a commander uses the weaponized machine outside of the scope of its design which causes civilian or friendly deaths, should the commander be prosecuted¿
6) Can proportionality be programmed into a weaponized machine so that if under threat from a child with an AK-47, that the weaponized robot does not bomb the whole village¿
7) What are the legal rights of a robot and specifically a robot in warfare¿ For instance, the US currently considers it self-defense when a pilot is targeted by radar and has the right to fire first to prevent its own destruction. The US also considers the same rights for its drones...that an unmanned drone has the right to fire if first targeted by radar. What other legal ´protections´ should be provided for robots¿
8) What ¨laws¨ should be programmed into robots¿ Should robots be confined to respond only defensively or are some offensive capabilities allowed¿
9) What is the new definition of war¿ In the past, war was defined when at least two parties fought both parties were susceptible to physical harm. Already, some Iraqi and Afghani fighters consider the US cowardly for fighting with machines and fighting from afar, and US soldiers consider it cowardly that fighters would shield themselves with women and children. If one or both sides cannot personally come to physical harm, what is the new word that defines this conflict¿

Authors Prescriptions:

1) Yes, an Iraqi or Afghani can legally target a US combatant on US soil.
2) Yes, that US combatant, even though non military, should be able to be prosecuted if they acted inappropriately. Therefore, it is extremely important that these roles be taken out of the hand of private military contractors or design firms.
3) Yes, if a non-military combatant (drone operator) were captured, Iraq or Afghanistan, if going by the same rules as the US, would classify these people as enemy combatants that fall outside of the protections of the Geneva Convention.
4) Yes, if a computer scientist were to code a weaponized machine that is used properly but malfunctions causing civilian or friendly deaths, that computer scientist should be prosecuted.
5) Yes, if a commander uses the weaponized machine outside of the scope of its design which causes civilian or friendly deaths, the commander be prosecuted.
8) The ¨laws¨ programmed into robots should be the same for every country. These ¨laws¨ should be agreed upon by the international community.

No comments: