RateMyProfessors.com
RateMyProfessors.com (RMP) is a review site, founded in May 1999 by John Swapceinski, a software engineer from Menlo Park, California, which allows anyone to assign ratings to professors and campuses of American, Canadian, and United Kingdom institutions.[1] The site was originally launched as TeacherRatings.com and converted to RateMyProfessors in 2001. RMP was acquired in 2005 by Patrick Nagle and William DeSantis.[2] Nagle and DeSantis later resold RMP in 2007 to Viacom's MTVU, MTV's College channel.[3] Viacom owned and operated RateMyProfessors.com for a decade. Cheddar announced its acquisition of RMP from Viacom in 2018.[4] RMP is the largest online destination for professor ratings. The site includes 8,000+ schools, 1.7 million professors, and over 19 million ratings.[1]
Type of site | Review site |
|---|---|
| Available in | English |
| Owner | Cheddar |
| URL | www |
| Launched | May 1999 |
Ratings and reviews
Users may post a rating and review of any professor that is already listed on the site. Furthermore, users may create a listing for any individual not already listed. To be posted, a rater must rate the course and/or professor on a 1-5 scale in the following categories: "overall quality" and "level of difficulty". The rater may also share if he or she would take the professor again, if the class was taken for credit, if attendance was mandatory, if the textbook was used, and what grade he or she received in the course; additionally, the rater may include comments of up to 350 characters in length. Since the website does not require users to create an account, non-students or even professors themselves can post ratings. Raters may also select up to 3 tags (from a list of 20) that describe the professor.[5][6]
According to the website's help page, "a professor’s Overall Quality rating should reflect how well a professor teaches the course material, and how helpful he/she is both inside and outside of the classroom".[7] The professor's Overall Quality rating determines whether his/her name is accompanied by a smiley face (meaning "Good Quality"), a frowny face ("Poor Quality"), or an in-between, expressionless face ("Average Quality").[5]
Correlation with in-class student evaluations
RateMyProfessors.com versus formal in-class student evaluations
Using data for 426 instructors at the University of Maine, [researchers] examined the relationship between RMP indices and formal in-class student evaluations of teaching (SET). This study found that the two primary RMP indices correlated significantly with their respective SET items. First, RMP "overall quality" showed a correlation of r = .68 with SET item "Overall, how would you rate the instructor?" Second, RMP "ease" showed a correlation of r = .44 with SET item "How did the work load for this course compare to that of others of equal credit?" Further, RMP "overall quality" (r = .57) and RMP "ease" (r = .51) were each correlated with its corresponding SET factor derived from a principal components analysis of all 29 SET items. The researchers concluded "While these RMP/SET correlations should give pause to those who are inclined to dismiss RMP indices as meaningless, the amount of variance left unexplained in SET criteria limits the utility of RMP."[8] Formal in-class evaluations can only be completed by students who are registered in the course, whereas on RMP, anyone can post ratings, whether or not they have taken the course.
Criticism
Stanford Law School and Reputation Protection
Two Stanford law professors argue that a legal framework for protecting online platform reputation should be responsive to the changing set of practices ushered in by the Internet and capable of resolving conflicts in a fair and satisfactory way. In light of recent failed lawsuits against online content providers, the professors advocate for "a new regime requiring such platforms to formulate an appropriate information policy providing transparency rules, including disclosing how aggregate evaluations are made and providing for a right to respond, to achieve a new body of communication “netiquette” for social evaluation in the online era."[9]
No guarantee of authenticity of users' student-status
As RMP does not require users to create accounts or log in before posting, there is no guarantee that the reviews are actually posted by students who have taken the course. Professors who research controversial political subjects, particularly female professors and professors of color, often face harassment on RMP, when people who dislike their political opinions or scholarship can post abusive reviews by pretending to be students. For example, the RMP page of Rutgers University professor Audrey Truschke, a historian of Islamic India, is routinely used by Hindu supremacists to post demeaning and degrading reviews calling for her dismissal by Rutgers.[10][non-primary source needed]
Positive correlation between ease of class and rating of professor
Research on in-class evaluations shows that professor ratings increase when students rate the course as easy.[11] The same relationship has been shown for RMP. In an article in the journal Assessment and Evaluation in Higher Education, Clayson investigated what RMP actually rates and concluded that "students will give higher evaluations to instructors they judge as being easy. There is also a suggestion in these findings that, if students like an instructor (for whatever reason), then the easiness of the class becomes relatively irrelevant.".[12] Clayson concluded that "the majority of the evidence indicates that [ratemyprofessors.com] is biassed by a halo effect, and creates what most accurately could be called a 'likeability' scale." Other analyses of RMP class ratings have come to similar conclusions,[13][14][15] and some have concluded that professor attractiveness is also positively correlated with evaluation scores on RMP.[16] Felton et al. evaluated RMP ratings and found that "the hotter and easier professors are, the more likely they’ll get rated as a good teacher."[17]
Evaluation bias issues
A frequent criticism of RMP is that there is little reason to think that the ratings accurately reflect the quality of the professors rated.[18][19] Another criticism is that ratings have been shown to reflect gender bias toward the professors evaluated.[20] Furthermore, at RMP, "easiness", "clarity", and "helpfulness" are the only components taken into consideration and are not considered well-designed evaluations.[21][22] Edward Nuhfer argues that both Pickaprof.com and RMP "are transparently obvious in their advocacy that describes a 'good teacher' as an easy grader. Additionally, presenter Phil Abrami ... rated RMP as 'The worst evaluation I've seen' during a panel discussion on student evaluations at the 2005 annual AERA meeting."[23]
Multiple ratings per person
Single individuals are able to make multiple separate ratings of a single professor on RMP.[24] RMP admits[25] that while it does not allow such multiple ratings from any one IP address, it has no control over raters who use several different computers, or those that "spoof" IP addresses. Also, there is no way of knowing that those who rate a professor's course have actually taken the course in question, making it possible for professors to rate themselves and each other.[26]
Rating relevancy
Critics stated that a number of the ratings focus on qualities they see as irrelevant to teaching, such as physical appearance.[27] In late June 2018, several academics criticized the website's "hotness" score for contributing to sexism in academia. On 28 June, RateMyProfessors responded that while the feature was intended to "reflect a dynamic/exciting teaching style," it was often misused; the hotness rating was removed immediately.[28]
RateMyProfessors lets the student identify the course that they took with the professor and combines the ratings for all courses taught by the professor instead of providing separate ratings averages for each course taught.
Permanent vs adjunct faculty
Adjunct faculty are not always readily identifiable or verifiable, as such professors may work at multiple universities, change universities frequently, or maintain employment outside an academic setting.[citation needed]
Data breach
On January 11, 2016, RMP notified its users via email (and with a small notification link on its website) that a decommissioned version of RMP's website suffered a data breach affecting email addresses, passwords, and registration dates.[29] According to the California Department of Justice website, the security breach occurred six weeks earlier on or about November 26, 2015.[30]
Website features
Professor Notes
This section needs to be updated. (March 2016) |
After mtvU took over the website, a notes feature was added that allows professors to register with the website (using a ".edu" e-mail address) in order to reply to students' comments. Another option, called "Professors Strike Back", featured videos of professors responding to their ratings on RMP.[31] Additionally, in 2015, the site debuted a new series "Professors Read Their Ratings"[32] in which professors read and react to their RMP ratings. Students may also submit videos to RMP.[33]
Recognition
In 2008 RMP was recognized by Time Magazine as one of the 50 best websites of 2008.
In 2008, student evaluations of Professors from RMP accounted for 25% of a school's rating in Forbes annual "America's Best Colleges" listing. However, this is no longer true.[34]
In 2015, the site won two People's Choice Webby Awards after an extensive site overhaul.[35]
Competitors
The rating company has a variety of competitors. RateMyTeachers, a similar teacher rating forum was launched by Patrick Nagle in 2001.[36]
References
- ^ a b "About RateMyProfessors.com". Retrieved April 28, 2023.
- ^ Glasner, Joanna. "Prof-Ratings Site Irks Academics". Retrieved April 28, 2023 – via www.wired.com.
- ^ "MTV Networks' mtvU Agrees to Acquire RateMyProfessors.com". Retrieved April 28, 2023.
- ^ "Cheddar buys a user-generated content biz, Rate My Professors, from Viacom". October 25, 2018.
- ^ a b Rate My Professors
- ^ "Rate My Professors Help Center".
- ^ "Rate My Professors Help Center".
- ^ "RateMyProfessors.com versus formal in-class student evaluations of teaching".
- ^ Anne SY Cheung and Wolfgang Schulz, "Reputation Protection on Online Rating Sites," 21 STAN. TECH. L. REV. 310 (2018)
- ^ "Audrey Truschke at Rutgers - State University of New Jersey | Rate My Professors". www.ratemyprofessors.com. Retrieved April 28, 2023.
- ^ Mau, Ronald R., & Opengart, Rose A. (2012). Comparing Ratings: In-Class (Paper) vs. out of Class (Online) Student Evaluations. Higher Education Studies, 2(3), 55-68.
- ^ Dennis E. Clayson (2013) What does ratemyprofessors.com actually rate?, Assessment & Evaluation in Higher Education, 39:6, 678-698, DOI: 10.1080/02602938.2013.861384
- ^ Legg, Angela & H. Wilson, Janie. (2012). RateMyProfessors.com offers biased evaluations. Assessment & Evaluation in Higher Education. 37. 89-97. 10.1080/02602938.2010.507299.
- ^ "Ratings". APA. 2007. Retrieved April 28, 2023.
- ^ Castro, Daniel, and Robert Atkinson. “Why it’s time to disrupt higher education by separating learning from credentialing”. Washington: Information Technology and Innovation Foundation, 2016. Online. Internet. 16 Apr 2018. Available: http://www2.itif.org/2016-disrupting-higher-education.pdf
- ^ James Felton, Peter T. Koper, John Mitchell, and Michael Stinson. Attractiveness, easiness and other issues: student evaluations of professors on ratemyprofessors.com. Assessment & Evaluation in Higher Education, 33(1):45–61, 2008
- ^ David Epstein, "‘Hotness’ and Quality", Inside Higher Ed, 8 May 2006, accessed 10 May 2008.
- ^ Pfeiffer, Sacha (September 20, 2006). "Ratings sites flourish behind a veil of anonymity". Boston Globe Online.
- ^ Westhues, Kenneth (December 2006). "Stephen Berman: Scapegoat". UWaterloo.ca.
- ^ Huntsberry, William (February 23, 2015). "How We Talk About Our Teachers". WNYC Morning Edition.
- ^ Lang, James M. (December 1, 2003). "RateMyBuns.com". Chronicle of Higher Education.
- ^ See Fritz Machlup and T. Wilson, cited in Paul Trout, "Deconstructing an Evaluation Form", The Montana Professor, Vol. 8 No. 3, Fall 1998, accessed 7 May 2008.
- ^ Edward B. Nuhfer, 2005, "A Fractal Thinker Looks at Student Evaluations", accessed 10 May 2008.
- ^ Gabriela Montell, "The Art of the Bogus Rating", Chronicle of Higher Education, September 27, 2006 [1]
- ^ Pfeiffer, "Ratings sites flourish behind a veil of anonymity".[better source needed]
- ^ Montell, "The Art of the Bogus Rating", Chronicle of Higher Education.
- ^ Bates, Laura (February 13, 2015). "Female academics face huge sexist bias – no wonder there are so few of them". The Guardian. Retrieved June 30, 2018.
- ^ Dalbey, Alex (June 29, 2018). "Ratemyprofessors.com Ends Hotness Rating". The Daily Dot. Retrieved June 30, 2018.
- ^ "RateMyProfessors.com – Find and rate your professor or campus". www.ratemyprofessors.com. Retrieved January 12, 2016.
- ^ "Submitted Breach Notification Sample". January 12, 2016.
- ^ "Reality TV Shows, Celebrity News, Pop Culture & Music Videos". MTV. Retrieved April 28, 2023.
- ^ "Albion College Professors Read Their Ratings – Part 2".
- ^ submit videos to RMP RMP
- ^ "Top Colleges 2017: The Methodology". Forbes.
- ^ "We've Won Two People's Voice Webby Awards!".
- ^ "Rate My Professor aids in student choices".
External links
- Official website
- Attractiveness, Easiness, and Other Issues: Student Evaluations of Professors on RateMyProfessors.com
- Web-Based Student Evaluations of Professors: The Relations between Perceived Quality, Easiness, and Sexiness
- Deflem, Mathieu. 2003. “Credible Reviews are Hard to Find.” Op-ed. The Gamecock, November 17, p. 4.