Recent Headlines

Recent Comments


« Letterman Making the Most of Tiger's Tail | Main | Goodbye, Midwestern housewives; Hello, Paywall »

Metacritic False Positive Inflates Returning Shows

Metacritic, a really cool website that calculates average numeric review scores for new movies and TV shows, is a terrific resource. In terms of movies, I actually like it better than rottentomatoes, since it gives a more accurate snapshot of the critical response.

But there's a major flaw in its system when it comes to rating the quality of returning (as opposed to new) TV series.

The problem is that for critics, writing reviews of many returning series is sort of an elective. And you're generally more likely to bother reviewing a season premiere of a program that you happen to like a lot in the first place.

As a consequence, there are extremely positive Metacritic scores for the second seasons of "Sons of Ted Anarchy" (86) and "Better Off Ted" (81), along with season -- what is it now, 30? 35? -- of "Scrubs" (64). In every case, though, those scores are probably higher than they would have been if a wider cross-section of critics chose to weigh in.

In the case of "Sons of Anarchy," for example, the original score for season one was 68 based on 22 reviews, compared to a mere six reviews of season two. The numbers are nearly identical for "Better Off Ted," whose star Jay Harrington, pictured, is approximating my expression when I saw its average score. Both shows are OK, but I was frankly scratching my head when each recorded review scores that put them up near "Mad Men" territory, which is where they rank thanks to those limited samples.

This isn't meant to rain on these programs' parades (especially "Ted," whose ratings were pretty dismal), but rather to identify another instance where statistics are often less representative than they should be -- or a strange refraction of the glass makes objects in the mirror appear better than they are.

TrackBack

TrackBack URL for this entry:
http://www.typepad.com/services/trackback/6a00d8341bfc7553ef0128763beb4c970c

Listed below are links to weblogs that reference Metacritic False Positive Inflates Returning Shows :

Comments

Jason Dietz (Metacritic Features Editor)

You bring up a very interesting point. I agree that the average scores for subsequent seasons of shows may be inflated, and that's one of several reasons why we do not show "high scores" lists for television programs like we do in the film, games and music sections of Metacritic. Although it might make sense not to compute an average score for returning shows at all, I think the score does provide some value. Since, as you correctly point out, the critics who opt to review returning shows tend to be fans of the show and know it well, it is interesting to see how their opinions of the program change from season to season -- and a big drop or increase in the average "Metascore" from one season to another can serve as a warning to cancel your Season Pass, or an invitation to return to a show you had abandoned.

The comments to this entry are closed.


Share
Print Variety
Bookmark
Get Variety:
Variety
AppsVariety
DigitalNewsletters
Subscribe

About

Brian Lowry is Variety's TV critic and a media columnist.
BLTv examines the state of television, including notable high- and lowlights, in addition to a couch's-eye-view of the media and the way in which it's covered.