Game Review Statistical Wrangling
Sunday, September 14th, 2008Inspired by my stats class, I set about to find some data about video game reviews. I’m a frequent visitor to MetaCritic.com – like Rotten Tomatoes, except for lots of different media (music, movies, video games, books, et cetera). I find them to be the best source for composite video game reviews. Seeing their top twenty listing for each current major system, I got to thinking: we could use this data to really say something about how each system is doing in terms of quality games. If it’s the games that sell the system (which may be suspect when you look at the data), this should offer an indication of which system is most likely to produce long-term enjoyment.
Here’s the ranking. I rank by mean score (out of 100) for the top 20 best reviewed games. I then report the mean and then standard deviation in parentheses.
1. XBox 360 – 92.2 (2.7)
2. PS3 – 88.65 (3.6)
3. Wii – 86.2 (4.8)
For handhelds:
1. DS – 87.25 (1.9)
2. PSP – 86.86 (1.7)
The most interesting numbers are in the consoles. Not only does the Wii have the lowest average score, it also has the most deviation. A wide spread of scores means that there aren’t a lot of great games out there for the Wii. It’s completely opposite for XBox. It has the highest mean and the least deviation. There are a lot of great XBox 360 games (a lot of games for that system in general).
Some of the difference occurs due to time. XBox 360 has been out for a year longer than the Wii and PS3. In time, those systems will add better games to their lineups. But Microsoft has also done a great job of harnessing the developers it owns to produce great games exclusively for their system. While Nintendo has a great fleet of designers, and while a lot of Nintendo produced games round out the Wii top 20, they haven’t been able to produce many truly great games. Another sports game featuring Mario and friends has a hard time competing against the likes of BioShock, Gears of War, and Halo.
It’s a bit harder to judge where PS3 has faltered. Part of their problem may be losing key system-exclusive titles, like Grand Theft Auto 4. This is the highest rated game for both the XBox 360 and the PS3. Previous releases were exclusive to PlayStation, which would have given the PS3 a leg up on XBox 360. PS3 also shares at least 1 game with XBox 360, where the XBox version got a significantly higher rating than did the PS3 (The Orange Box).
For the handhelds, they’re in a virtual tie. In this case, the DS has a lot more games out. And it is also selling more units. It looks like the DS is the dominant handheld system, even if it has no better games than PSP.
I’d like to see someone run more numbers. How do great titles and their release dates change overall sales? Are Wii sales showing any signs of slipping? How do game sales (of real games, not Wii Play), correspond to system sales? My numbers are interesting, but they don’t offer much in the way of predictions. If people were buying just on quality of games, XBox 360 should be winning the sales war handily; that is certainly not happening right now.
Anyway, stats can be fun!