Historically speaking, have you ever noticed that on some games, the reviewer consensus is much higher than the player consensus? And other times, the reviewer consensus is much lower than the player consensus. What do you think causes this?
I had my reply written up, and then I realized I needed some clarification. How are you defining a reviewer versus a user? Most reviewers, though not all, are also users for one thing. Are you talking professional reviews? Reviews on amazon. When you say player consensus, how are you getting that consensus, a couple guys on a board saying this game is great or something else? Thanks.
I would suspect that he's talking in very general terms about a lot of different things. I know of a couple games that were given good reviews on websites and then did something to alienate their fan following, but other than that I don't usually pay attention to what the majority of gamers think about a given game, however that opinion is revealed (by polls, forums, chatting with my real-world friends, and whatnot).
Reviewers tend to take a more cursory look at games- and often aren't huge fans of the genre.
Players tend to have bought the game, and are often huge fans of the genre, and don't have other deadlines to worry about, so they can see more of the game in depth. Someone I know reviews games for a commercial game mag, and she often has 3-5 games to work one at once- and some of them require legitimate time investments, while others are shovelware. It's hard to go in depth as a commercial reviewer, unless you're at a specialist site.
Pro reviewers are great for casual fans. User reviews are more useful for fans of the genre.
That said, I don't trust pro reviews of games with large budgets due to payola concerns.
Plus, there's the fact that the most vocal players of a lot of games are hard-core fans of the series, and will thus both notice and care about things like continuity and contiguousness that reviewers who aren't painfully familiar with the storyline wouldn't pick up on.
I personally don't pay much attention to either.
Well they both have advantages and disadvantages. You've got fanatics that will give anything attached to their favorite series or publisher or developer a ten, and you've got pro. reviewers knocking down games for reasons the fans actually like the series.
I will certainly say between the two, I've managed to save my money and not wind up with a game like Spore.
I can speak from some experience on that.
It takes a lot of time to review most games properly, especially strategy games. Unfortunately, that's time that your average gaming journalist doesn't have given the sheer quantity of garbage games you have to give fair play to before trying to find new and interesting ways of describing them as 'derivative crap' while trying to avoid working 50-80+ hours a week.
This game complicates matters due to Stardock rewriting core mechanics as they go. That's going to leave the critic with a dilemma. Do you review it for what it is now or for what you think it's ultimately going to become? My solution would have been to score it as it is now and if it was less than I expected it to be in the future to promise to return to it in a couple months.
I've never understood why nobody does follow-up reviews. I think it's perfectly reasonable to allow for first impressions being a lot less accurate than the ultimate experience you have with something that you could end up doing for 100s of hours. The first 10 hours of Oblivion were pretty damn spectacular as I recall. Now all I see is a pretty but hopelessly busted RPG with absolutely no replay value whatsoever.
I suppose it does pay off then.
The reason I don't pay much attention though is my opinion generally seems to conflict with most reviewers/gamers in any case - though I suppose they are useful for learning more about games but in general those arbitrary numbers at the end of a review mean nothing to me.
I'd be happier if the number system were either removed entirely or something else took its place. I value 1 star and "max" star reviews for details and specific issues mentioned, not the score.
It's no different than movie reviews really. Some of thest best selling, crowd pleasing movies don't sit real well with critics, and vice versa.
There's a few issues I think.
1. Some games are deceptive, and most critics don't spend very long with them. Civ 5 is a great example. The first playthrough is quite good. It's only after you get good at it that you start noticing things like how the new happiness and luxury system doesn't scale to large maps and works really badly the larger the map is. Or that puppet states which sound great on paper are in fact a disaster and will bankrupt you if you actually use them. Or that worker automation should never be used. Or that annexed cities also suck and don't get many bonuses from social policies (the optimum way to play is to actually raze everything you can and just build a new city in the best spots). Or that the AI is TERRIBLE, doesn't know how to deal with the new combat rules, barely builds ships, and pretty well never builds airplanes.
Once you do know that, the game gets boring quickly because it's just so much easier then Civ 4. Very few critics will ever play long enough to realize that and most of them don't know the game well enough to see any of it. Tom Chick's review describes what happens almost perfectly though. Users on the other hand play a lot and study the game, so they do notice it.
2. Reviews like certain genres more then others. This is a lot like in the movies, where there's critic movies, and movies that are actually popular. In the last few years they haven't overlapped very well (to the point that they added 5 more nominees for Best Picture Oscar due to viewers turning out after years of nothing anybody had actually seen being nominated). Users on the other hand only tend to buy and review genres they like.
3. Some games just get a pass due to their name. I'm looking at Final Fantasy 14 as an example. This review talks about what is flat out dealbreaker stuff, but gives it over 80% despite that. I mean, how do you end a review with "We can’t recommend that you spend $50, and then $12.99 a month after the first 30 days, on a title that has as many flaws as FFXIV does" and give it 84% at the same time? (Final Fantasy 13 got equally easy treatment for what if it were called "New Franchise RPG 1" would have been absolutely demolished for being the worlds prettiest hallway simulator.) 14 is a buggy, flawed, broken mess with some of the worst controls a PC game has ever seen. This is amateur stuff that was bad when it was called FF 11, and in a MMO landscape post WoW is simply unacceptable trash. The users are getting it right and the reviewers are out to lunch, because a Final Fantasy game really can't be rated that badly.
4. When the users hate the DRM, they rate games into oblivion no matter what they think of the game itself. Reviews don't tend to do that.
cash money vs. fandom in that exact order.
I too was completely baffled at my experience playing FFXIV's beta, and the defense of the pos menu system they are using, on top of keeping all the servers in Japan making a slow menu even worse with lag plus the fact the game is clearly, clearly designed for a controller. Most of the pro. reviewers are giving the game the sound pounding it deserves. The review you've mentioned is not the first time I've seen a reviewer write something like: not fit for consumption but then give it a pretty good score. Gamespot gave it a harsh review so did Game Trailers. I enjoyed Game Trailers' review best, maybe because he speaks well, and as sad as it was to experience some of the flaws, he made me smile a few times as he pointed them out. http://www.gametrailers.com/video/review-hd-final-fantasy/705893 . I think between the two XIV is getting a mixed bag review when it should be pretty down there. Maybe they're listening to the begging of not reviewing the game at launch from SE... hmmm, where have i heard that before?
This is because devs pay for the score but usually don't bother to look at the actual review so the reviewer gets away with saying that the game isn't good without losing the advertising dollars from the devs.
Take a look at Grand Theft Auto IV. Huge budget, massive advertising campaign leading to its release and every website in creation dedicated articles every day to anything remotely connected to GTA IV. It was a critical and financial smash, with some reviewers calling it the future of video games. It has one of the highest Meta-critic scores in histroy, and sold a bucket load of copies on its openeing day. Every single aspect of the game was hailed as perfect.Fast forward till today, and see how the 'general consensus' has changed. The boring fetch quests, the annoying mobile phone, the weak sub-stories and conflicting themes and the loss of the over-the-top fun that made San Andreas one of the all time greatest games.Now, take a look at Deus Ex. Not a critical smash, not a huge financial success, minimal advertising and a modest budget. Called an 'interesting mix-up' upon its release. Critised for it's visuals, cliche plot and glitchy A.I.Fast forward till today, and now Deus Ex is widely considered the greatest game ever made, with all of it's perceived faults merely adding to its charm and wonder.Reviewers in recent times tend to have two review score systems. The first caters to any normal release; it ranges from 1-9. The second review scale caters to high profile releases, such as installments in major franchises. It ranges from 8-10.Final Fantasy XIII is widely considered the worst FF game ever made and certainly has been mocked enough for being a boring, long winded game with little to no actual gameplay. It's boring plot, cliche one-note characters and annoying voice acting combined with the total lack of exploration left fans with a bad taste in their mouths. Despite this, it received 8's and 9's on its release, and sold pretty well. In hindsight, many reviewer publications refer to the FFXIII as a terrible game, yet their review doesn't reflect this.Part of it is simple; Square Enix buys a lot of advertisements, if you piss them off they are less likely to buy adds in your magazine/website. The other part is also simple; the reviewers get caught up in the hype. Modern Warfare 2 is a prime example; some websites had coverage of the line forming to buy the game at release, interviewing people who had simply bought the game - they hadn't even opened the box to play it yet!I trust User Reviews, nothing else.
Generally speaking, reviewers will not give low ratings to established franchises and games with considerable hype. There are exceptions, but the game has to be a complete disaster for that to happen, and it'll still score quite well given its actual state. I'm sure we could argue to death the 'why' of it, but I suspect it varies on a case-by-case basis anyways and there are lots of underlying factors.
Frankly, balanced reviews are hard to come by these days, and I usually put in at least 3 hours of research before buying a new title. If I'm satisfied after viewing gameplay videos, trailers, and reading multiple opinions, I'll give it a whirl. This approach has been very successful, and since I don't buy games very frequently it's easy for me to put in that kind of research, but it's totally impractical for people who buy a new game every few weeks.
LOL. I was just about to type something similar. Civ 5's initial reviews where so positive, I am not sure if the reviewers are either retarded, where playing a completely different game, or payed off by Take 2. I would say most fans of the series where disappointed with the game.
I find it's best to ignore the scores and read the actual text of a review. The text tells you specifically what the reviewer liked and disliked which you can then use to make a judgement about the game. Scores are completely abitrary, a 7 for one person might mean the same thing as a 9 for someone else.
I find that reviewers are wrong a lot.
BTW FFXIV did not get a free pass Tridus. It got the same review scores Elemental did, despite probably having more payola. Game apparently is a complete disasterpiece.
On ag.ru (biggest russian game reviews site) it lists both reviewer's score and users average score for games, and in most cases scores are close (+/- 10). There were some cases when review and users score differed much, but usually its due to reviewer's bias to game/genre/company. However reviewers usually try to judge game by some rules, while users scores are completely arbitrary. 100/100 or 0/100 are VERY rare for reviewers, but users use these scores all the time.
So yeah, I'd say neither of these are truly objective, but I'm still cautious about anything receiving lower than 60/100 from both review and users.
Evidence?
There's no doubt that business interests can play a part on occasion, but this conspiracy that there's a wholesale arrangement between devs/publishers and game reviewers is bollocks.
It's known that in at least one case, game materials were tied to review scores for a AAA-game.
I don't think there's a wholesale conspiracy, but I do think payola is alive and well for the biggest games, and that mid-major devs such as Stardock are probably the losers in all of this.
I know of the case with gamespot and Kane & Lynch (though really, who pays attention to gamespot) and a recent example of a lad's magazine reviewer being told to give something a high score, but like you say, that's hardly wholesale.
I think people need to make peace with the fact that reviewers might just not agree with them.
Part of it is just legacy/expectations. Reviewers fall victim to this in a big, big way. If a game is from a company that is beloved for producing great games, and the game is highly anticipated, then it gets stellar reviews no matter what the case. The most recent example of this is Civ 5. It is not a bad game, don't get me wrong, it got my $50. However it is not the 10/10 that most sites gave it. Compared to Civ 4 it is lacking in some key ways. It needs some work to be as good. However it was anticipated and Firaxis is beloved so it got through the roof ratings. If you go read user reviews, and some of the less "mainstream" reviews you'll find that indeed it is a good game, with some flaws that need fixing and it gets the more 7-8/10 that it should.
Valve would be another great example of this. There seems to be nothing those guys can release that every reviewer doesn't claim to be the best thing EVAR. Again, it is a case of them wanting it to be great. Because Half Life was such a cool, genre defining game, now everything they do is rated as wonderful, no matter what. A fairly recent example would be Left 4 Dead 2. The original L4D was a fun game, but I don't think quite worthy of its universal praise. However L4D2 was really nothing but a cash in. Released a year later, almost nothing new, it was an expansion back in all but name. Not bad, but not worth $50. However it again got universal acclaim, because it was from Valve. Had it been form someone else, it probably would have been looked down upon as a ripoff.
Reviews are more useful in the case of less anticipated releases. When it is just a game that is coming out from a developer that isn't really special, they often are far more accurate. They evaluate what the game is, not what they want it to be.
However some people, Valve, Blizzard, Rockstar, etc, just don't get real reviews. Their reputation influences things and so the reviewers inflate things without realizing it. The have mentally prepared themselves for the game to be awesome, and so it is to them even if it really isn't.
It is. It would have been a bad game if it was released in 2003 (ie: before WoW). Compared to modern MMOs? It's a complete disaster. I really loved the part where if you crash while doing a timed quest (ie: all of them) you fail it. And for the ones that have a cooldown? Oh well, come back in two days.
The game is so crash prone that I actually wound up making a NEW CHARACTER in open beta (which was actually a demo, I mean they explicitly barred open beta users from submitting bug reports so it was never intended to be a 'beta') so I could attempt the starting quests again. Release fixed very little about the crashing. The control scheme is completely out to lunch and they made no effort to come up with an intelligent system for the PC (it's really aimed at the PS3). Target something, pick a spell, then... target again? WTF? You know what I'm targetting! I never did figure out how to move the world map to actually find things.
It seems largely single player focused with text messages limited to such a short length that you can barely say anything (think: twitter). Performance is bad. Did I mention the crashes?
I really have almost nothing good to say about it, because I couldn't get far enough into it to actually find out how anything past the early game is like. Hell, even their patching system is so terrible that after hours of waiting I had to go to a website and just download the last files (even some of the reviewers commented on that)... and this is on 25mbps fiber.
There are many great features available to you once you register, including:
Sign in or Create Account
