TA star ratings sytem broken - scores all too high

Discussion in 'Site Feedback and News' started by GreyDawn, Feb 6, 2012.

  1. PixelPower

    PixelPower Well-Known Member

    Jun 23, 2012
    332
    0
    0
    Honestly the reviews on this site are pure one man's opinion. Now I rarely agree with Eli on most things but this one I do. Look around in real life, does everyone like the same thing? Does everyone dress the same, love the same song,do people all play the same video game? No everyone is different and has different opinions on what they like or dislike. There are more important things in life then to harp on the review system that toucharcade has.
    Actually there should be no stars just the review of the game, that way people dont fight about stars.Thats a new idea I think toucharcade should consider.
     
  2. defred34

    defred34 Well-Known Member

    Aug 27, 2012
    1,408
    0
    0
    Earth
    #22 defred34, Oct 1, 2012
    Last edited: Oct 1, 2012
    Not sure how I missed this thread, but I'd just like to weigh in as well.

    Eli, by virtue of being THE No.1 iOS gaming site, whether you like it or not, you have to take pride in the ratings you give. You don't just dish them out like you're serving sushi or burgers at a restaurant. TA has a lot of influence in the iOS gaming sphere, and as such responsible it must be in meting out review scores. I must quote a line from Spiderman here: "With great power comes responsibility".

    I, like many others here, hope you will change your seemingly indifferent attitude towards game ratings. 5 stars, contrary to what you may want to argue, should only ever resonate with a perfect game (or at least a near-perfect game). The gameplay, graphics, controls...they all got to click together.

    While, yes, 5 star ratings will always cause controversies due to people's very own likenesses, I was alarmed that TA gave 3 games a 5 star rating within 24 hours a few days back. 3 in 24 hours....can you believe that! Yet, if you go around asking the average TA forum-er, he'd say it was a week like any other, if not poorer, in terms of quality of games.

    However, I will side with Eli on one thing - the high-end lopsided score. The Verge's mobile game review policy explains it better than I ever could: "By only reviewing games that we find interesting, that means that the vast majority of mobile game reviews we publish will be positive. For those who like scores: it'll be very, very rare to see a mobile game rate lower than 5 out of 10. " Hence, I will not fault TA for lopsided scores edging towards the high-end of the scale. Also, Eli's claim that no game which deserve lower than 2 stars deserves to be reviewed is also very true.

    Having said that, I hope TA stops giving 'average' games 4 star ratings. In a true 5 star spectrum, 3 stars should be the average. And like Ares mentions above, this is not average in terms of all the games available, but the average amongst all the decently polished games (i.e. non-garbage/trash). I respect your balls in giving games like DT and TASM 2 stars. They rightly deserve it. But because so many worse game have gotten 3.5, 4 and even 4.5 stars on TA, people always react in anger and frustration. Consistency in meting out ratings is the key here.

    And oh yeah, please save 5 stars for the game that really makes the hair on ones back stand. It isn't too late. Doing a slight revamp/rethink in the ratings distribution won't hurt a soul. Doing a predominant 3 - 4.5 scale will give 4 tiers, while the really bad ones get 2 and the mind-blowingly good one will get 5. This will, in my humble opinion, give game review scores more credence.

    PS: I apologize for the long-winded post. I just couldn't contain myself. I look at TA as the bastion of iOS gaming, so I just wish their editor/writers take more pride in the review ratings.

    PSS - New thought:
    Would it not be better to give a breakdown? I don't know how viable this is, but just break it down to gameplay, graphics, sound & controls.
     
  3. toochunky

    toochunky Well-Known Member

    Jun 26, 2011
    53
    0
    6
    I doubt TA is going to change is rating system, but one useful thing might be to change it like Michelin stars for restaurant reviews.

    Assume a base level of quality for any games reviewed, even if they get no stars, and reserve stars only for the games that are outstanding in some way.
     
  4. MidianGTX

    MidianGTX Well-Known Member

    Jun 16, 2009
    3,738
    10
    38
    I think it'd be foolish to consider a five star rating "perfect" or even "near perfect". As gamers, that's not even what we're really looking for as "the perfect game" is a far too personal opinion to be predicted by someone else. A more suitable description would be "must have", which covers a greater spectrum of games yet still gets a very specific point across to the reader.

    I don't think TA is too far off with their ratings in this respect, but one of the big issues in that area is the speed with which games age on the App Store. Games which might have been considered must haves a few months back might already seem like fairly old hat by now. The whole process is too fast for most games to even get a chance at making a lasting impression and old review scores tend to age with them, bar the few smash hits. For the ratings to really mean anything to you, you have to be right on top of the iOS scene and up to date with its current trends.
     
  5. JBRUU

    JBRUU Well-Known Member

    May 9, 2012
    6,758
    0
    36
    USA
    Exactly.
     

Share This Page