Engineering News Blog

Engineering News

Latest news of interest to engineers. Sourced from GlobalSpec's Engineering News

Previous in Blog: Restricting Calories May Not Extend Lifespan For Everyone   Next in Blog: Emperor Penguins Face Extinction
Close
Close
Close
11 comments
Rate Comments: Nested

Can a Google Algorithm Identify The Best Scientific Research?

Posted January 27, 2009 8:57 AM

From Scientific American:

How can one quantify the importance of a given scientific paper? One simple and frequently utilized measure is the number of times that paper is cited in subsequent publications. But critics note that counting citations favors disciplines such as biology, where papers tend to be cited more, over fields such as mathematics, where citations are less frequent. In addition, a citation from a relatively marginal paper counts just the same as a citation from a leading researcher publishing in a marquee journal.

Read the whole article

Reply

Interested in this topic? By joining CR4 you can "subscribe" to
this discussion and receive notification when new comments are added.

Good Answers:

These comments received enough positive votes to make them "good answers".

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
2
Guru
Engineering Fields - Systems Engineering - New Member Popular Science - Weaponology - New Member

Join Date: Jun 2006
Location: Borrego Springs
Posts: 2636
Good Answers: 62
#1

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/27/2009 3:34 PM

On a higher level than the single paper; counts of article subjects are frequently used to determine significance of a subject. Whereas what it really tells you is how much funding has been steered to that subject. But since this measure is frequently used to determine where to steer more funding, it is frequently self-fulfilling.

The entire process of trying to monitor the meta data of scientific publishing is seriously flawed. All it actually shows is the predilictions of a very few editors.

__________________
"If you want to get somewhere else, you must run at least twice as fast as that!"
Reply Good Answer (Score 2)
Power-User
United States - Member - NE, USA Hobbies - Target Shooting - New Member Engineering Fields - Aerospace Engineering - Engineering Fields - Electromechanical Engineering - New Member

Join Date: Jul 2007
Location: USA
Posts: 199
Good Answers: 6
#2
In reply to #1

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/27/2009 4:11 PM

Re: Can a Google Algorithm Identify The Best Scientific Research?

So... I'm thinking I'm hearing (reading) a "NO"...

Reply Off Topic (Score 5)
Guru

Join Date: Oct 2007
Posts: 734
Good Answers: 70
#3

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/27/2009 11:33 PM

It will be fairly easy to develop an algorithm that does a lousy job, such as one that counts citations. Even a system for evaluating the track record of all of the various scientific publications across all the scientific disciplines, to establish that some citations are more equal than others, the results still might not be much more reliable than a coin toss. Built in predispositions and prevailing attitudes can sometimes obscure the 'Best Scientific Research' for several years. Google would still need a time machine, and a good bs filter.

Reply Off Topic (Score 5)
Anonymous Poster
#4

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/28/2009 3:59 PM

It's always going to be (more than?) a bit hit and miss, but
maybe there are additional features that can be used for articles that are read on-line:

Average "time spent reading" paper (ignore very low times?)
References given in paper that are followed up
Weight citations according to the ratings of the paper from which the citation was made? Maybe the first two could be cross-correlated against the individual readers habits?

Reply
Guru
United States - US - Statue of Liberty - New Member Hobbies - Fishing - New Member

Join Date: Nov 2007
Location: Gone to Alabama with my banjo on my knee...
Posts: 5595
Good Answers: 20
#5

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/28/2009 5:03 PM

All I can say is...

__________________
Veni, vidi, video - I came, I saw, I got it on film.
Reply Score 1 for Good Answer
Anonymous Poster
#6
In reply to #5

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/28/2009 5:38 PM

Would that be "Brilliance Score"?

Reply Off Topic (Score 5)
Guru
United States - US - Statue of Liberty - New Member Hobbies - Fishing - New Member

Join Date: Nov 2007
Location: Gone to Alabama with my banjo on my knee...
Posts: 5595
Good Answers: 20
#7
In reply to #6

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/28/2009 5:49 PM

Believe what you choose...

__________________
Veni, vidi, video - I came, I saw, I got it on film.
Reply Off Topic (Score 4)
Anonymous Poster
#8
In reply to #7

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/29/2009 5:48 AM

Surely that remark is back on topic?

Reply Off Topic (Score 5)
Guru
United States - US - Statue of Liberty - New Member Hobbies - Fishing - New Member

Join Date: Nov 2007
Location: Gone to Alabama with my banjo on my knee...
Posts: 5595
Good Answers: 20
#9
In reply to #8

Re: Can a Google Algorithm Identify The Best Scientific Research?

01/29/2009 8:19 AM

Probably so, but it's too late to change now - besides, I don't want to exceed my on-topic quota...

__________________
Veni, vidi, video - I came, I saw, I got it on film.
Reply Off Topic (Score 5)
Commentator

Join Date: Aug 2006
Location: Columbus, Ohio United States of America
Posts: 71
Good Answers: 1
#10

Re: Can a Google Algorithm Identify The Best Scientific Research?

02/01/2009 6:38 PM

No, a google algorithm can't identify the best scientific research. Even if a system of review was done on each article (such as movies in the International Movie Database), good articles will only be relevant to a select few. However, with this in mind, this system SHOULD be set up just to get people in the right direction. It must be understood (i.e. disclaimer) that the system isn't divine and is there to speed up the process of finding relevant articles which is a major weakness in all fields of study.

All I'm saying is you have this system, type in best article for whatever, it picks up some silly article that isn't the best (but probably okay), you scan the article for citations and good ideas/conclusions that could then be reinserted into the search engine in brackets or whatever, and the whole getting warmer approach. It won't be a one step algorithm but it sounds like it will require less steps.

__________________
I hope this is a good one!!!....... nope.....
Reply Score 1 for Good Answer
Guru

Join Date: Oct 2007
Posts: 734
Good Answers: 70
#11
In reply to #10

Re: Can a Google Algorithm Identify The Best Scientific Research?

02/02/2009 6:08 PM

You are probably right. This idea as originally presented is half baked at best, but if it could be put into operation there is a good chance that the need for improvements would become apparent, and there would be a structure in place to test the mods.

Reply
Reply to Blog Entry 11 comments

Good Answers:

These comments received enough positive votes to make them "good answers".

"Almost" Good Answers:

Check out these comments that don't yet have enough votes to be "official" good answers and, if you agree with them, vote them!
Copy to Clipboard

Users who posted comments:

Anonymous Poster (3); edignan (1); EnviroMan (3); JCase (1); johnfotl (2); Wild Idea (1)

Previous in Blog: Restricting Calories May Not Extend Lifespan For Everyone   Next in Blog: Emperor Penguins Face Extinction

Advertisement