Engineering...Beyond the Classroom Blog

Engineering...Beyond the Classroom

The Engineering...Beyond the Classroom Blog focuses on engineering issues that are important to students and faculty regarding educational. Converse about educational or research technologies, tools of the student or teacher trade, curriculum and coursework, or myriad other topics that turn bright students into brilliant engineers.

Previous in Blog: Where Are the Women Professors?   Next in Blog: A Failing Grade for Online Assessment? (Part 2)
Close
Close
Close
17 comments
Rate Comments: Nested

A Failing Grade for Online Assessment? (Part 1)

Posted August 12, 2009 6:00 AM by TechoutReach

While the popularity of teacher rating websites is predictable, are such sites actually worth paying attention to? If not, what efforts from teachers, students, and parents are required to overcome questionable credibility in order to create a viable alternative?

Searching for Authentic Assessment

I'm still a young public school teacher - not simply by age so much as by experience. I know this not by the fact that I'm only just nearing tenure, but from the telltale signs I still feel each day, many of which remind me of my first few student teaching experiences. For instance, I still wear a tie on important dates (parent/teacher meetings), I still keep fairly organized notes and plans (inability to always think on my toes), and I actually still get to school about thirty minutes earlier than I need to (my colleagues know I'm a fool for this).

I don't have enough space in this blog for what Holden Caulfield (bonus credit if you can nail this allusion, pre-click) would call "all that David Copperfield kind of crap" (Dickens's Copperfield, not the smoke and mirrors one), so I should tell you that the reason you need to know this exposition is so I can justify the recent habitual refreshing of my browser on RateMyTeacher.com. I'm hoping for some genuine feedback, but I might be looking in the wrong place.
Who's Watching the Watchmen?

The aggravation that some teachers feel over sites like the one mentioned above was first expressed to me during a seminar-style class while I was working toward my Masters in Education a couple of years ago. While some current teachers began to grumble about a negative comment or two under their profiles, one of my peers was telling us how she was on the site and that we should find her to give her a good rating. Cheating? Well, yes. However, this site's loop hole is obvious, and it's mostly due to its anonymity.
If you're not familiar with RateMyTeacher.com, peruse it for a moment and maybe take a look at a former teacher of yours. The site works based on four levels of evaluation (Clarity, Helpfulness, and the murkily subjective Easiness and Popularity), which are averaged for each teacher. Easiness and Popularity are not factored into the overall score, as the site's owners wisely note that such factors are not necessarily going to reflect a good score.

Chances are the comments listed will mirror your memories of that educator, but my question is who's actually posting these comments? We don't know if these are students, former students, or friends of ours who would like to see a brighter emoticon next to our names. What about disgruntled (former) colleagues with a grudge?

Despite the fact that teachers like myself (those not bothered by the fact that anyone can rant or rave about our characteristics publicly) exist, there are a number of teachers and schools that have flat out banned sites like RateMyTeacher.com on their district's networks in order to deter students from posting negative and hurtful comments. While I don't agree with this, I also have to wonder what it will take for sites like this to actually earn a level of credibility that's worth of our time.

Part 2 of this two-part series will run tomorrow and will discuss the importance of genuine feedback over anonymity.

Special thanks to ShakespeareTheEngineer for letting me pick his brain on this one.

References:
PBS Teachers: https://www.pbs.org/teachers/learning.now/2006/08/educatorranking_websitesthe_st.html

Reply

Interested in this topic? By joining CR4 you can "subscribe" to
this discussion and receive notification when new comments are added.

Good Answers:

These comments received enough positive votes to make them "good answers".
Guru
United States - Member - Lifelong New Yorker Popular Science - Biology - Animal Science Technical Fields - Technical Writing - Technical Writer

Join Date: Mar 2008
Location: NY
Posts: 2313
Good Answers: 59
#1

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 8:42 AM

I'll admit I used a college professor rating site (as well as word of mouth recommendations) when choosing my undergraduate course schedule. Unclear teachers who were unwilling to help students were not worth my tuition dollars or time.

While an angry student (or two or three) can bring down a teacher's ratings out of spite, a truly good teacher's ratings should be a good reflection of his or her style.

Style can be what it comes down to - people have different learning styles. Getting a heads-up can help avoid a disastrous clash of learning and teaching styles that turn into a rocky semester and an unhappy grade.

Now that I'm a graduate student in a small program with a handful of professors, I don't have the option of basing my schedule on a rating system - one professor teaches each course so there are no choices!

Reply
Commentator
Hobbies - Musician - New Member Technical Fields - Education - New Member

Join Date: Jul 2009
Location: Albany, NY
Posts: 59
Good Answers: 3
#2
In reply to #1

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 8:58 AM

"While an angry student (or two or three) can bring down a teacher's ratings out of spite, a truly good teacher's ratings should be a good reflection of his or her style."

I couldn't agree with you more on that. I think it's great to have sites like this, as long as we don't take it all too seriously. Look at the chili pepper factor for RateMyProfessors. While that's probably accurate, it's not something the site's owners can point to when critics cry foul.

Good luck with your studies. The graduate level of any field can be seem like night and day compared to earning your undergraduate degree!

__________________
TechoutReach
Reply
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#13
In reply to #2

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:39 AM

I would also say that you can't lump RateMyTeachers.com and RateMyProfessors.com together. How you evaluate educators at the collegiate level comes from a perspective that is so much more expanded than most high school perspectives.

The addition of insight, maturity, and experience that comes from being at college would add much validity to this site and let's face it, the "do know work and blow off school" students at the high school level don't have professors because they don't go to college.

Although, that you can rate a professors "hotness" sure does do a good job taking away from that credibility.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply
2
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#3
In reply to #1

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 9:06 AM

The part that makes me throw my hands up with this is that I have gotten great ratings from kids that I have never taught. Since I am funny and talk with them during my lunch monitoring duty, they just give me fives across the board.

That is an area where this site falls short. There is no way of making sure that those doing the rating have actually had a given teacher for any given class.

They should also add a section (which I think they have on RateMyProfessor.com, which has students list which class that they had. For me, I teach a GREAT variety of classes, and my approach changes based on clientele and content, so knowing which classes faired well and which ones needed work would be more helpful than "This teacher sux!".

There is no understanding of what is lacking so the opportunity for improvement is limited. That being said, it is why I have kids write reflections at the end of the course, so I can get real feedback and improve.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply Good Answer (Score 2)
Commentator
Hobbies - Musician - New Member Technical Fields - Education - New Member

Join Date: Jul 2009
Location: Albany, NY
Posts: 59
Good Answers: 3
#4
In reply to #3

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 9:20 AM

"The part that makes me throw my hands up with this is that I have gotten great ratings from kids that I have never taught."

Excellent point! What actually sparked my interest in writing a commentary on these sites was that I recently read five or six posts under my name that were really favorable. They made me laugh and I was actually kind of flattered by some of them (except for the one that claimed I "play favorites" ). Well, the next time I checked I noticed, for whatever reason, they were all taken down. I assume they were all from the same ISP and maybe students were using school computers so the site's owners thought it was some kind of abuse/spam, but it struck me as odd. Well, at least we know someone's monitoring it.

__________________
TechoutReach
Reply
Guru
United States - Member - New Member Engineering Fields - Electrical Engineering - New Member

Join Date: Jul 2008
Posts: 1149
Good Answers: 36
#7
In reply to #3

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:00 AM

I guess the real question there is: Are students smart enough to weed through the junk? Sometimes I question the judgment call, but it is their fault if they only choose classes based upon easiness and get a rude awakening. Most of the time, word of mouth combined with these scores makes it easier to make better informed decisions on which teachers/professors are good.

You need to weed out the outliers. The ones with 5's across the board but no constructive comments should be disregarded or removed. Same for 1's across the board with no explanation. Perhaps better monitoring and stricter guidelines for posting would help. Of course, making stricter rules on what is accepted may deter some. But I figure that the students who would provide constructive comments will still post and the ones that were just going to post "So-and-so sucks!!!!!!!!!" will be detered (with that many exclamation points).

Would it help if the straight 5's and 1's ratings were removed if they had no constructive comments? I would think so.

Reply
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#9
In reply to #7

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:06 AM

Stricter moderation might be the key. I think you are onto something, here.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply
Guru
United States - Member - New Member Engineering Fields - Electrical Engineering - New Member

Join Date: Jul 2008
Posts: 1149
Good Answers: 36
#5

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 10:36 AM

I think that this can be very useful for teachers. Yes, you are going to get those students who won't like you no matter what you do, but it doesn't mean that their criticism can't improve you. Just like teachers provide constructive criticism on lab reports and essays, maybe this is just a way for students to provide their teachers constructive criticism without getting in trouble for it.

While students may not intend to provide such insight into how a teachers class is run, it doesn't mean that teachers can't use the information to their advantage to improve. Hopefully, making minor adjustments to the way classes are run will conclude with higher marks on RateMyProfessor.com (or in this case RateMyTeacher.com).

Sometimes negative comments are hard to swallow, but they may be necessary to improving.

Reply
Commentator
Hobbies - Musician - New Member Technical Fields - Education - New Member

Join Date: Jul 2009
Location: Albany, NY
Posts: 59
Good Answers: 3
#6
In reply to #5

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 10:43 AM

Absolutely! You're actually outlining my main idea for the follow up to this blog that'll run tomorrow. In addition to this, if students feel a sense of gratification when venting about a teacher in a public forum, I say go for it. It's better than graffiti on the bathroom walls.

__________________
TechoutReach
Reply Off Topic (Score 5)
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#8
In reply to #5

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:05 AM

It doesn't mean that their criticism can't improve you.

You are assuming, of course, they leave a comment that gives you even a vague idea of what their gripe is. Many negative posts give no feedback at all. Here are some real comments from teachers who received low ratings (all 1's or a mix of 1's and 2's):

  • "She must like memorize the year books. She knows everyones name, the first time she has them. Its so stupid."
  • "he's...psychotic, needs therapy and a bath"
  • "dumbest teacher in the school... we actually made her cry"
  • "he doesn't like campbells soup. he's a forgein exchange student from tennasie!!!"
  • "has some not so nice features"
  • "No wonder she's not married..."

Now look at some from the flip side where ratings were all or mostly 5's:

  • "AWSOME"
  • "mr.h is the bomb"
  • "The best teacher I have ever had and probably ever will have."
  • "I love her. She is awesome. I have her for Child Studies and she is soo awesome."

These comments are so vague that it is hard to build on them and become better. Some are also just downright hurtful and mean spirited. If you don't know what you are doing poorly or what you are doing well, what do you throw out and what do you keep?

There is also a feature at the bottom that lets students know what other teachers are similar except it just randomly cycles through all the other teachers so if you click refresh enough, each teacher will eventually display every other teacher in the district. It is a total sham.

There is do doubt that feedback can make anyone better at what they do. But until this site gets some level of credible substance, it is largely a waste of time.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply
Guru

Join Date: Jul 2007
Location: Tech Valley, NY
Posts: 3546
Good Answers: 15
#10
In reply to #8

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:27 AM

"She must like memorize the year books. She knows everyones name, the first time she has them. Its so stupid."

Wow, being prepared and actually knowing students' names is a bad thing? Jeesh, I loved when teachers learned names quickly. With the amount of kids going through school these days, it can't be easy to remember them all - but I always thought it was nice when they knew me... it made me feel like they were more interested in helping me do well.

And as for memorizing the books, I'd imagine that after teaching The Scarlet Letter or something enough times, it just happens. This too only helps students as the teachers (in my experience, at least) point out things they might've missed in their reading. But then again, when I was in HS, most of my classmates never did the reading anyway. I guess this is why talking about the books in detail is so bothersome and "so stupid".

I mean, I was by no means nice to all my teachers. Luckily, if this was around at the time, I was unaware. I had a couple teachers that I constantly butted heads with. Not surprisingly, those teachers were all in disciplines that I had no interest in. While I'm not trying to generalize, I do not think that taking frustration of a subject out on the teacher is uncommon.

I'm embarrassed to admit that I gave one teacher a particularly hard time in school. Was she mean to me or put me down? No. She just happened to be a science teacher. Later I was working at a grocery store that she shopped at. One day I apologized to her and the next time she saw my mother she even commented on how much it had meant to her. If I had access to a site like this when I was younger, as I'm sure I would've posted some things that I would now regret.

What I'm trying to get at is this - sites like RateMyTeacher can be useful - like SavvyExacta mentioned. But in HS it's easy to berate and trash a teacher soley because your young, possibly frustrated, or just mean.

__________________
Sharkles
Reply
Guru
United States - Member - New Member Engineering Fields - Electrical Engineering - New Member

Join Date: Jul 2008
Posts: 1149
Good Answers: 36
#11
In reply to #8

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:27 AM

I don't think that the site has little credible substance. I think it has quite a bit and a lot more potential. But stricter moderation may be the key to making sure that these comments/ratings don't appear in the first place. It isn't about sparing the feelings of the teachers (no offense intended), it is about providing constructive reasoning behind the rating (which "No wonder she isn't married..." isn't providing). Some just sound like people that have a problem with the teacher/professor and others are blinded by reality (hopefully the "AWSOME" comment wasn't for an English teacher...).

Perhaps if the site focused on preventing unconstructive comments (which aren't helpful to teachers or students, whether they are positively or negatively oriented) from appearing on the site, the site would have more credibility. If that only leaves one or two constructive comments, then so be it. At least you didn't have to pick through garbage to get there.

Reply
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#12
In reply to #11

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:32 AM

If by sparing feelings you mean by providing honest, critical comments, I agree.

You can't expect teachers to go to a site where comments like some of the ones I listed persist. Being told it is no surprise you aren't married is mean spirited. Until RateMyTeachers.com gets serious about their product, it might remain a great place to vent about teachers you like or gush about teachers you loved, but a vehicle to improve education, it is not.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply
Guru
United States - Member - New Member Engineering Fields - Electrical Engineering - New Member

Join Date: Jul 2008
Posts: 1149
Good Answers: 36
#14
In reply to #12

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 11:44 AM

I have used RateMyProfessor a couple of times to choose professors and I think they have a better set-up. You have the option of listing classes you had with them. Sometimes you get "wishy-washy" comments, but other times, you get well thought out constructive comments on their site.

Perhaps high schoolers are just too juvenille to provide feedback that is constructive. If this is the case, I say just scrap the idea.

Reply
Guru
Technical Fields - Education - Seasoned Vet in the Classroom United States - Member -

Join Date: Jul 2008
Location: Troy, NY
Posts: 760
Good Answers: 19
#15
In reply to #14

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 1:04 PM

I find that they take the time to be thoughtful and constructive in the written form. I also spend a lot of time explaining how being critical won't affect a grade if their criticism are substantiated with examples so I can actually learn from them.

It is the anonymous, on-line forum that has shown itself to be of little use.

I think you said it best earlier, Jaxy, when you said that it needed tighter moderation to be worthwhile.

__________________
StE - "For 'tis the sport to have the enginer/Hoist with his own petard" -Hamlet Act III, scene 4, 202–209
Reply
2
Guru
Engineering Fields - Electrical Engineering - Been there, done that. Engineering Fields - Control Engineering - New Member

Join Date: Dec 2008
Location: Long Island NY
Posts: 15601
Good Answers: 981
#16

Re: A Failing Grade for Online Assessment? (Part 1)

08/12/2009 4:04 PM

I do not teach nor do I have children, but my father and father in-law did teach long before social networks. So despite my established isolation from the field, I have some perspective on this. I notice that none of the students when grading the teacher are asked what their grades are for the class. I think that this would give an interesting perspective.

My case that eventually gets in point:

As a returning adult student I recently went back to college for an Engineering degree. One of my elective classes was on VHDL programming. Work and the engineering computer lab schedule at the time granted me but one hour a week of preparation time. From day one, my lab partner constantly held me up with him not grasping some of what I thought were basic principles in circuit design. So instead of maximizing my one hour of time to learn yet another arcane syntax, I was teaching my partner circuitry basics. The first bi-weekly exam I failed. My second exam was a D+. My lab partner claimed to be doing well in class. I mentioned to the Engineer in charge of the laboratory part of the curriculum that I was likely to drop out of this class. He insisted that I reconsider but also warned me that the professor was about to ramp up the material complexity. Paradoxically he said this would probably help me since I already worked in the field. He also mentioned that the department had noticed my partner holding me back. So, my partner was told to fend for himself. I was granted special hours to work alone on the computers. The complexity of the material grew to my liking as I worked like a mule. To my knowledge I was one of the few who successfully completed the final project. This became my proudest A- grade.

Several semesters later, I met my former lab partner and asked if he took any other classes with that professor. He told me that he avoided this professor for the low but passing grade he got was not worth all the work he had to do for it. Myself, I took another elective with this professor and one taught by the lab Engineer while this professor was on sabbatical. For while they made me do a lot of work, they were both fair and had a lot to teach me.

Now I'm certain that my former lab partner would grade this professor quite differently than I would. If we had to also post the letter grade we got for the class, our assessments would be more transparent, I think.

__________________
"Don't disturb my circles." translation of Archimedes last words
Reply Good Answer (Score 2)
Guru
Engineering Fields - Retired Engineers / Mentors - New Member

Join Date: Dec 2006
Location: Brecksville, OH
Posts: 1621
Good Answers: 18
#17

Re: A Failing Grade for Online Assessment? (Part 1)

08/15/2009 2:41 PM

Never had the opportunity to do on-line teacher ratings; they didnt come into vogue until I was nearly finished my degrees. Also. my engineering and science classes were small by todays standards generally allowing better student to professor contact. Usually, unless a teacher is lecturing to a very large class where students don't know one another (and don't talk together) or where the underclassmen don't fraternize with the upperclassmen, word of a teachers abilities and other issues will normally get around quickly and students will not take the class from that professor and will select other professors teaching the same material. This of course shows up in the professors profiles on ability to retain students.

One thing I did not observe in university settings is department heads or other tenured professors sitting in on each others classes on a spot basis; thereby allowing the opportunity to give constructive criticism if appropriate. Typically, in primary and secondary school settings, a teacher will be evealuated fairly frequently by the schools principal or vice-principal.

In my experience there are great teachers and there are ho-hum teachers. If a professor is truly interested in their students success in school, they will go to extraordinary efforts to guarantee the student understands the course material. Case in point: In undergrad school, our engineering class had it's first course in Thermodynamics. It was taught by a professor who was heavy into the mathematical side of the subject, but none of the students had the proper mathematical background for the level of math involved. Students asked no questions and the prof was astonished that everyone failed the first major exam. After discussing the issue with several other students, I elected myself spokesman and approached the professor and indicated no one had a clue about what he was talking about. Two other professors sharing the same office space guffawed (under their breath) and one professor (who was very student success oriented) then spoke up and said he understood were the problem was and that if I got the other students together 3 days/week at lunchtime he would tutor us and guarantee we understood the material. This was done and everyone got up to speed. BTW, the 2nd professor said he had an ulterior motive in that he taught the 2nd term of the Thermodynamics course so he would have to deal with the students abilities sooner or later. We need more committed teachers like him.

__________________
"Consensus Science got us into this mess, then why can't it get us out?" : Rephrase of Will Rogers Comment
Reply
Reply to Blog Entry 17 comments

Good Answers:

These comments received enough positive votes to make them "good answers".
Copy to Clipboard

Users who posted comments:

agua_doc (1); Jaxy (4); redfred (1); SavvyExacta (1); ShakespeareTheEngineer (6); Sharkles (1); TechoutReach (3)

Previous in Blog: Where Are the Women Professors?   Next in Blog: A Failing Grade for Online Assessment? (Part 2)
You might be interested in: News Sites, Conveyor Chain, Leaf Chain

Advertisement