Robotic Systems Blog Blog

Robotic Systems Blog

The Robotic Systems Blog is the place for conversation and discussion about industrial robots, programming and controls, sensors & tooling, and robotic safety. Here, you'll find everything from application ideas, to news and industry trends, to hot topics and cutting edge innovations.

Previous in Blog: Is Automation the Way to Rebuild?   Next in Blog: Stand Back, or Jump?
Close
Close
Close
Page 2 of 2: « First < Prev 1 2 Last »
Rating: Comments: Nested

Can Morals Be Programmed?

Posted July 16, 2009 7:35 AM

The changing face of warfare has created remote-controlled vehicles that soldiers can fire from a 'safe' distance. The next step is automated vehicles that fire weapons on their own, but that requires the automation respects rules of war. Do you think automated vehicles can apply the rules of war at least as well as, or perhaps better than, their human counterparts?

The preceding article is a "sneak peek" from Robotics Systems, a newsletter from GlobalSpec. To stay up-to-date and informed on industry trends, products, and technologies, subscribe to Robotics Systems today.

Reply

Interested in this topic? By joining CR4 you can "subscribe" to
this discussion and receive notification when new comments are added.

Good Answers:

These comments received enough positive votes to make them "good answers".

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
Commentator

Join Date: May 2009
Posts: 75
Good Answers: 2
#104
In reply to #103
Find in discussion

Re: Can Morals Be Programmed?

08/01/2009 12:59 AM

I like the direction this thread is going. I don't think it is easy to delineate a rigorous palate of morals to code into a robot. A trivial claim might be "The greater moral action is the one that brings the least harm to the most people." The trolley problem for example suggests a distinction between switching the trolley to strike one instead of 4 is more easily contemplated than pushing one to his death to save the 4. It also indicates that pushing one to save 4 is more easily contemplated than carving up one living organ donor to save 4. I think the hard part is getting the robot to comprehend what formulates the basis of such codes when we can't come to terms about them ourselves. If the greater number were an absolute then why do we find the later notion so repugnant? I always find myself asking "What would a borg do?" And as alway I come to the inescapable conclusion that morality is contextual. We're we borg, hurting another would be as avoided as hurting yourself. Indeed the distinction is rather mute. Is it not the contextual scenario that man finds himself not as borg (for instance) that finds us in the types of moral dilemmas we contemplate?

Reply Score 1 for Good Answer
Active Contributor

Join Date: Mar 2009
Posts: 16
#105
In reply to #103
Find in discussion

Re: Can Morals Be Programmed?

08/03/2009 4:43 PM

I would suggest that we start by giving the machine a set of simpler tools like "Love", "Hate", "Guilt", "Remorse", "Empathy", etc. The system will needs these tools when it gets to the point of defining morals. Since humans can't define these terms accept on an individual basis (If That), my guess is that each machine will end up with a different but correct result. Could be an interesting experiment but not something that I would want to bet my life on!

Just My Thoughts

Reply Score 1 for Good Answer
Commentator

Join Date: May 2009
Posts: 75
Good Answers: 2
#107
In reply to #105

Re: Can Morals Be Programmed?

08/04/2009 10:49 PM

i give you a GA for "Could be an interesting experiment but not something that I would want to bet my life on!"

but i also think you are right about the emotional response criteria being needed.

Reply
Guru
Engineering Fields - Electromechanical Engineering - Technical Services Manager Canada - Member - Army brat Popular Science - Cosmology - What is Time and what is Energy? Technical Fields - Architecture - Draftsperson Hobbies - RC Aircraft - New Member

Join Date: Sep 2006
Location: Clive, Alberta, Canada
Posts: 5916
Good Answers: 204
#108
In reply to #105

Re: Can Morals Be Programmed?

08/04/2009 11:14 PM

While I said that Morals can and will be programmed... I'm going to venture out and say that you will not be able to program love any more than you can give the machine life. If it appears to be love, it is simply passing the Turing test by encoding the responses humans expect, and will not be genuine... because there is no spirit from which to have these responses spring forth from. This will be a much harder challenge than mere morals.

Chris

Reply
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15600
Good Answers: 981
#109
In reply to #108

Re: Can Morals Be Programmed?

08/05/2009 12:00 AM

You give me the opportunity to close a loop here. One of the unexpected consequences of programming the moral code of the three laws of robotics is that independent of external programing a robot truly experiences love. Read Asimov's short story "Bicentennial Man" from the "I Robot" collection of short stories. They did make this into a movie of the same name, starring Robin Williams. While details were artistically added and omitted for the more visual media of a movie, the fundamental story was reasonably preserved in the movie.

__________________
"Don't disturb my circles." translation of Archimedes last words
Reply
2
Guru
Engineering Fields - Systems Engineering - New Member Popular Science - Weaponology - New Member

Join Date: Jun 2006
Location: Borrego Springs
Posts: 2636
Good Answers: 62
#110
In reply to #105

Re: Can Morals Be Programmed?

08/05/2009 10:20 PM

"Love", "Hate", "Guilt", "Remorse", "Empathy", etc.

Since we defined this as a killing machine, I would think that would be extremely counter-productive.

__________________
"If you want to get somewhere else, you must run at least twice as fast as that!"
Reply Good Answer (Score 2)
Guru
Popular Science - Evolution - New Member Popular Science - Weaponology - New Member

Join Date: May 2006
Location: The 'Space Coast', USA
Posts: 11119
Good Answers: 918
#111
In reply to #110

Re: Can Morals Be Programmed?

08/05/2009 11:40 PM

Well, everyone has wondered way off-track. Not that doing so id bad, but the original question centered about "Do you think automated vehicles can apply the rules of war...?"

My take is that this has little or nothing to do about emotion, but can a machine interpret the rules and boundaries of war. These rules and limits are tangible things and therefore pretty straight forward to instill into a machine with today's technology.

That is quite a different thing than applying moral adjudication to life.

Reply
Guru
Engineering Fields - Electromechanical Engineering - Technical Services Manager Canada - Member - Army brat Popular Science - Cosmology - What is Time and what is Energy? Technical Fields - Architecture - Draftsperson Hobbies - RC Aircraft - New Member

Join Date: Sep 2006
Location: Clive, Alberta, Canada
Posts: 5916
Good Answers: 204
#112
In reply to #110

Re: Can Morals Be Programmed?

08/05/2009 11:43 PM

Ah, to kill or not to kill, that is the question!

GA.

Reply
Guru
Hobbies - CNC - New Member Popular Science - Biology - New Member Hobbies - Musician - New Member

Join Date: Dec 2008
Location: Canada
Posts: 3523
Good Answers: 146
#113
In reply to #102
Find in discussion

Re: Can Morals Be Programmed?

08/22/2009 6:46 PM

The democracy of the Greeks is not equivalent to our present democratic systems. In many ways, the political system itself was better than ours, in so far as it was a better system for representative democracy. No professional politicians! Need I say more. However, the representation was exclusive to male citizens, and was not in line with present ethical and human rights standards.

The ethics of the ancient Greek democracies set them apart from the present questions. Women, and slaves, had no right to citizenship and played no part in the "democracy". The ancient greek ethic would have been OK with the idea of using a woman or a slave as a "human shield" - the practice you decried, Anonymous Hero, and used to distinguish our own warring and killing from that of the Taliban and such.

Our founding mothers fought for women to obtain the vote and to be recognized as persons under the law. This is a very recent step in our cultural evolution not a hundred years old. You have leaned on this legacy of our mothers to justify the war, and others have done so as well in the public eye. The exploitation of women and children as "shields" and "weapons" is repugnant to the majority of persons in this day and age, because we respect the same 'universal' code of human rights. The greeks and their version of 'democracy' did not.

__________________
incus opella
Reply
Guru
Popular Science - Evolution - New Member Popular Science - Weaponology - New Member

Join Date: May 2006
Location: The 'Space Coast', USA
Posts: 11119
Good Answers: 918
#86
In reply to #83
Find in discussion

Re: Can Morals Be Programmed?

07/29/2009 2:47 PM

Thanks, but the question was what is a moral killing machine, not what morals a killing machine has.

Now, what is moral? That is truly subjective and depends on what the group or society decides it is. That was my point about the SS Troupes. They are not my set of scruples, but that is me (and probably/hopefully most of us).

What is moral? What would you like it to be? Your choice, at least for you.

As for the IF THEN statements, it all depends on what level of abstractions you want to operate at. Software is getting better and better at operating at higher and higher levels of abstraction, too. Not long ago a computer could not challenge a master Go player (Wei Chi), but that has changed. Go is far more complex from a strategy point of view than chess. Chess can be won by brute force, but harder (not impossible) to apply brute force to Go.

However, many computer programs operate based on a best statistical analysis basis, so it isn't just yes/no decisions at a primal level. You can make weighted decisions and that is one of the algorithms autonomous missiles use in the game of predator/prey where spoofing and anti-spoofing are constantly in motion.

Reply
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15600
Good Answers: 981
#88
In reply to #86

Re: Can Morals Be Programmed?

07/29/2009 3:31 PM

I do realize that this tangent on this tread was the question "What is a moral killing machine?" My second rebuttal point was intended directly toward that question. I have no idea which of humanity's moral codes the questioner is applying to this question. If he's applying the moral code that the killing of any life is wrong except for the purpose of producing food. Then the fight against pestilence and disease can be considered an amoral act and a butchery slaughter house would be considered a moral killing machine. If morality should instead only concern acts against people then Michael Vick should not have been charged with a crime let alone imprisoned. But because this amorphous code of morality cannot be perfectly codified by people to stand the test of time, doesn't mean that a machine could not get somebody's moral reference to work from.

I have to finish this now, the moral code of my Windows XP operating platform need to be updated.

__________________
"Don't disturb my circles." translation of Archimedes last words
Reply
Active Contributor

Join Date: Mar 2009
Posts: 16
#90
In reply to #88

Re: Can Morals Be Programmed?

07/29/2009 3:53 PM

Apologize for the tangent. My whole point in asking the question was that I do not believe that a machine can be programmed to know what morals are no matter how you may define them. A machine executes code. Humans may impart their incomplete definition to the code but the machine will never "UNDERSTAND". (At least in my lifetime)

Just my Thoughts!

Reply
Anonymous Poster
#106

Re: Can Morals Be Programmed?

08/04/2009 1:32 PM

All,

Please consider this - the article says, "the automation respects the rules of war." It does not say anything about programming morals into a computer or robot. Rules have a "1" or a "0". Therefore, rules can be programmed.

A CR4 Guest

Reply
Reply to Blog Entry Page 2 of 2: « First < Prev 1 2 Last »

Good Answers:

These comments received enough positive votes to make them "good answers".

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
Copy to Clipboard

Users who posted comments:

ahuha (6); Anonymous Hero (19); Anonymous Poster (1); artsmith (5); Blink (3); chrisg288 (17); edignan (3); HoleInTheSnow (7); Janissaries (1); Kilowatt0 (1); ky (4); often_perplexed (6); ozzb (1); redfred (12); RVZ717 (13); scotchdrnkr (2); stevem (1); Tobugrynbak (1); Transcendian (3); ZenZeddmore (7)

Previous in Blog: Is Automation the Way to Rebuild?   Next in Blog: Stand Back, or Jump?

Advertisement