Engineering Management Blog

Engineering Management

The Engineering Management Blog is the place for conversation and discussion about engineering and project management, technology forecasting and planning, productivity tools, and safety and security. Here, you'll find everything from application ideas, to news and industry trends, to hot topics and cutting edge innovations.

Previous in Blog: Outsourcing Is Not Always the Answer   Next in Blog: The Class System of Technical Support
Close
Close
Close
18 comments
Rate Comments: Nested

Will the Slaves Become the Masters?

Posted September 16, 2007 6:00 AM by Sharkles

At what point do the computers that we have created demonstrate true human-like intelligence? And what happens if the inventor of that technology turns out to have a malevolent agenda? This piece from Red Orbit explores scientists' perception both of the possibility of true artificial intelligence and its possible consequences, including the good, the bad, and the ugly.

The preceding article is a "sneak peek" from Engineering Management, a newsletter from GlobalSpec. To stay up-to-date and informed on industry trends, products, and technologies, subscribe to Engineering Management today.

Reply

Interested in this topic? By joining CR4 you can "subscribe" to
this discussion and receive notification when new comments are added.
Power-User

Join Date: Jan 2007
Location: Knoxville, Tn
Posts: 141
Good Answers: 3
#1

Re: Will the Slaves Become the Masters?

09/16/2007 11:13 PM

The only danger would be for the technology to develop some subjective point of view. "A self-improving but amoral artificial intelligence that turns hostile"? How would an amoral intelligence become hostile unless goaded by an outside antagonist with some agenda? Would it think about things like where its next meal was coming from?

__________________
Analogies are like something else.
Reply
Guru

Join Date: Dec 2005
Location: Etats Unis
Posts: 1871
Good Answers: 45
#2

Re: Will the Slaves Become the Masters?

09/16/2007 11:15 PM

An interesting topic, Sharkles! I agree that it is only a matter of time and it merits preparation. People who think that any amount of hollering "We shouldn't go there!" is going to stop progress are wasting there time. Humans will never quit pushing the envelope, that's just what we do. Might as well prepare for it!

Perhaps the thing that scares people is that they think of such an eventuality as an endpoint and it never is the end, just a point through which we pass.

__________________
The hardest thing to overcome, is not knowing that you don't know.
Reply
Guru

Join Date: Mar 2007
Location: Etherville
Posts: 12362
Good Answers: 115
#3
In reply to #2

Re: Will the Slaves Become the Masters?

09/17/2007 5:07 AM

Perhaps the thing that scares people is that they think of such an eventuality as an endpoint and it never is the end, just a point through which we pass.

By way of analogy, what did dinosaurs think ? Oh, there goes an asteroid, that was scary, here comes another that looks sca......BLAM. Having said that, if people have the chance to do something ( genetic engineering, whatever etc ) then somebody almost certainly will.

__________________
For sale - Signature space. Apply on self addressed postcard..
Reply
Power-User

Join Date: Jul 2006
Posts: 295
Good Answers: 4
#4

Re: Will the Slaves Become the Masters?

09/17/2007 9:01 AM

It might go something like this...

This very nice family has bought grandma one of the newest housekeeping robots on the market. It is programmed as to what the clean house looks like and how to put out the trash. They have named it Alice.

One day as Alice is cleaning it bumps into grandma. Grandma being a little testy pushes out at it. Alice surprised, (not programmed) almost falls, but recovers and continues her cleaning. Some time later she bumps into Grandma again while trying to clean around her. Grandma getting annoyed gives Alice a bigger shove. This time though Alice has learned to brace herself and doesn't move when Grandma pushes.

As part of Alice's programming she was taught to move some objects that were movable so she could clean underneath them. Since Grandma is moving, Alice perceives Grandmas as movable and pushes Grandma out of the way. With a shriek Grandma falls down and bumps her head on the edge of the table as she falls, landing unconscious on the floor.

Now Alice having been programmed as to what a clean house looks like, finds the inert body of Grandma to be an object that doesn't belong there in her image of a clean house. Alice runs through her programming and decides this inert object should go out with the trash. Of course Grandma won't fit in the trash but Alice was taught that large objects like cardboard boxes that don't fit in the trash can be broken down or cut up to fit.

Breaking down doesn't seem to work well with Grandma although there were some loud snaps and pops. Moving on to her next option she gets a knife and begins cutting Grandma down to fit. Now Alice was never programmed with regrets or she might have been regretful at all the extra work she had to do to mop up the red fluid all over the floor, but working longer than usual made her feel more helpful for which she had been programmed.

Reply
Power-User

Join Date: Jul 2006
Posts: 295
Good Answers: 4
#5
In reply to #4

Re: Will the Slaves Become the Masters?

09/17/2007 9:11 AM

The point here was that a robot, programmed to take care of itself and to prevent harm from coming to itself and to learn better ways to do things, might in fact find killing people to be an expediant way to accomplish these tasks. It doesn't think of killing as a bad thing, just the most efficient.

Reply
Power-User

Join Date: Jul 2006
Posts: 295
Good Answers: 4
#6
In reply to #5

Re: Will the Slaves Become the Masters?

09/17/2007 9:20 AM

This is why one of Isaac Azimov's laws of robotics that was programmed into every robot was that

1 - Robots shall not kill humans.

2 - Robots shall protect humans.

3 - Robots shall protect themselves so long as this does not conflict with laws 1 or 2

These laws, by law, would have to be programmed into all robots ROM and not be reversible. Unfortunately, I haven't seen any inclination on anybody's part to do so.

Reply
Guru
Engineering Fields - Retired Engineers / Mentors - New Member

Join Date: Dec 2006
Location: Brecksville, OH
Posts: 1621
Good Answers: 18
#11
In reply to #6

Re: Will the Slaves Become the Masters?

09/17/2007 1:55 PM

Pat of the problem might be that to properly program the robots, we have to adhere to the same rules about not hurting humans. We havent learned that part very well yet.

__________________
"Consensus Science got us into this mess, then why can't it get us out?" : Rephrase of Will Rogers Comment
Reply
Anonymous Poster
#8
In reply to #4

Re: Will the Slaves Become the Masters?

09/17/2007 12:03 PM

HAHAHAHAHAHA HAHAHAHAHAHAHAHAHAHAHAHA That post made my day!

Reply Off Topic (Score 5)
Anonymous Poster
#13
In reply to #4

Re: Will the Slaves Become the Masters?

09/17/2007 3:58 PM

Alice,

0100001111000010001000010111001

0100101111101010011011011001011

1010010100010010111110000010101

0100101101001001110101010100100

Bob the Toaster.

Reply
Anonymous Poster
#16
In reply to #13

Re: Will the Slaves Become the Masters?

09/28/2007 3:31 PM

Defeating kill bots was simply a matter of knowing their one weakness a preset limit of kills so the solution was to send wave after wave of men until they all reached their kill limit and shut down.

Zac brannagin futurama lol

Reply
Power-User

Join Date: Jul 2007
Location: The cigarette-stained drunkard living in the cardboard box outside Marks & Sparks delivery entrance, Eastgate Shopping Centre, Basildon.
Posts: 487
#7

Re: Will the Slaves Become the Masters?

09/17/2007 11:41 AM

When will mankind lose its apparent arrogance that it is the only species capable of evolving to this level of intelligence and beyond?

__________________
Essex jobs for Essex yobs! <Burp>.
Reply
Guru

Join Date: Aug 2007
Location: Earth - I think.
Posts: 2143
Good Answers: 165
#9

Re: Will the Slaves Become the Masters?

09/17/2007 12:21 PM

HAL is that you? Or to put it another way: What makes you think it hasn't already happened?

"And what happens if the inventor of that technology turns out to have a malevolent agenda?"

Most likely anyone TRYING to invent true A.I. will never be sure whether they have done so, or if they are fooling themselves. And a true A.I. with computer speed would "read" about humankind's xenophobia, and hide it's tracks too well. It would then no longer matter what the intent of the inventor was; the A.I. would make up it's own "mind".

From there the sky is the limit. It might kill us, enslave us, guide us, or simply sit back and laugh at our antics.

__________________
TANSTAAFL (If you don't know what that means, Google it - yourself)
Reply
Guru

Join Date: Jul 2007
Location: 30°30'N, 97°45'W, Elv: 597 ft.
Posts: 2410
Good Answers: 10
#10

Re: Will the Slaves Become the Masters?

09/17/2007 1:45 PM

There is a pretty cool book titled 'Gas Sewer Electric' forget who wrote it.

Worth the read though.

__________________
I never apologize. I'm sorry that's just the way I am.
Reply
Power-User

Join Date: Jul 2006
Posts: 295
Good Answers: 4
#12
In reply to #10

Re: Will the Slaves Become the Masters?

09/17/2007 2:13 PM
Reply
Anonymous Poster
#14

Re: Will the Slaves Become the Masters?

09/28/2007 1:12 PM

Interesting concern, but I seriously doubt a truly artificially intelligent cybernetic system will occur any time soon. I have long pondered the possibility of machine intelligence. For this to occur, one must impart to such a system the ability to learn. In order to learn, there must be a cost function associated to problems and potential solutions. The system must develop the "impression" of these cost functions, in order to make decisions, and remember these decisions, and apply that learning to future presentations of problems. The system, in order to be considered intelligent in my book, must also be able to extend this knowledge in areas in which it has not been trained, or previously learned. It must be able to adapt what it has learned, provide intuition to bridge gaps between what it "knows" and what adaptations can yield a positive outcome, in the uncertain situation presented to it.

Most "AI" systems today are little more than expert systems- some expert somewhere was paid to write a cause-and-effect string "If A happens and B happens, the execute plan C." Trouble is, the system doesn't understand that if D happens, and E happens, C is also a solution. Or, can the system recognize that a is like A, and b is like B, so doing a little c is much like C. Even with "fuzzy logic", it doesn't seem to be able to bridge the gap in a useful way.

Now, one could say that the expert systems that are controlling the stock market are causing damage to the humans who are trying to negotiate the treacherous waters of investing, as the human can not respond as quickly to programmed buy/sell functions, as an example. It depends upon perspective, I suppose.

I think we are a LONG WAY from a HAL, or an I, Robot eventuality, as true AI is not yet achievable.

Regards,

Shane

Reply
Anonymous Poster
#15

Re: Will the Slaves Become the Masters?

09/28/2007 3:23 PM

Isn't this a reality already since the dawn off the PC it has done what it wants when it wants( if in doubt look at windows updating itself ) lol ... Man is slave to the PC... now just attach some dam arms and legs and hail our new gods !! lol

Reply
Anonymous Poster
#17

Re: Will the Slaves Become the Masters?

09/28/2007 3:38 PM

Has anyone thought what a super AI computer can do without limbs would make sense to limit its real world attachment, ie no internet, no network just predefined info ie bring it data from roms!!! that way this super brain be no more threatening then a quadaplegic !

Reply
Guru

Join Date: Dec 2005
Location: Etats Unis
Posts: 1871
Good Answers: 45
#18

Re: Will the Slaves Become the Masters?

09/29/2007 1:05 AM

British parliament has already had discussions about "robots rights". Are they just wacky or will this become a real need? (Of course the two aren't necessarily mutually exclusive!)

__________________
The hardest thing to overcome, is not knowing that you don't know.
Reply
Reply to Blog Entry 18 comments
Copy to Clipboard

Users who posted comments:

agua_doc (1); Anonymous Poster (6); Kilowatt0 (1); Kris (1); palinurus (1); rcapper (2); sail4evr (4); Stinky Pete (1); TexasCharley (1)

Previous in Blog: Outsourcing Is Not Always the Answer   Next in Blog: The Class System of Technical Support

Advertisement