Usability testing at PikPok

Discussion in 'Public Game Developers Forum' started by PikPok, Apr 4, 2012.

  1. PikPok

    PikPok Well-Known Member

    Nov 26, 2009
    938
    1
    0
    Wellington
    Some may be interested to hear how we approach usability at PikPok to help ensure our games are as intuitive and accessible as possible. We have a brief article up on our website about it at

    http://pikpok.com/news/insidepikpok-usability/
     
  2. David Phan

    David Phan Well-Known Member

    Feb 27, 2012
    74
    0
    0
    President & Producer
    Vancouver
    Thank you for your continued sharing PikPok crew!

    Making User Interfaces (including HUDs) intuitive is serious business as demonstrated by your team's committment to have an in-house usability lab. User accessibility is as much a science as game metrics and analytics.

    DP
     
  3. Justin@PhykenMedia

    Justin@PhykenMedia Well-Known Member

    Aug 31, 2011
    63
    0
    0
    Project Manager
    This is a great article! Thanks for sharing!

    Would you be willing to share a little info on how you go about getting new testers for your games?
     
  4. PikPok

    PikPok Well-Known Member

    Nov 26, 2009
    938
    1
    0
    Wellington
    We recruit new testers in different ways. We had a small sign in a game store for a while, although when they got taken over by EB we had to remove it because of corporate policy.

    But other than that, we recruit people via Facebook, Twitter, and our community forums and build up a database over time. We currently have over 300 people on our roster I believe.
     
  5. Hercule

    Hercule Well-Known Member

    Dec 16, 2010
    240
    0
    0
    I'm a little disappointed. There is so much more to tell on playtest!
    (difficulty setting, questionnaire, how to observe etc..)
    This is a big subject, too much neglected most of the time.

    There is also an effect on the developpement team:
    - If 2 people don't agree on some point, players decided.
    And Sometime even the chief has to go back on his decision :)
    - Put in front of the dev team obvious problem (no one want to do a tutorial..).

    But if you take every data from your playtest to the letter, you could get an average game with no soul.
     
  6. Justin@PhykenMedia

    Justin@PhykenMedia Well-Known Member

    Aug 31, 2011
    63
    0
    0
    Project Manager
    Thanks for the response! Putting a small sign in a game store sounds like a really smart idea (too bad they forced you to remove it when it got taken over).


    To add to some of your points I think it is also important that all designers be able to admit when a design isn't working. I've seen designers dismiss playtesting results and try to keep a poor design in the game because they felt that they were right and the player was wrong.

    However, at the same time I do agree that some parts of the design need to stay true to it's original intent. If you compromise too much in an attempt to satisfy every playtester then you're game will start to lose it's clear, centralized vision.
     
  7. PikPok

    PikPok Well-Known Member

    Nov 26, 2009
    938
    1
    0
    Wellington
  8. PikPok

    PikPok Well-Known Member

    Nov 26, 2009
    938
    1
    0
    Wellington
    Following up on the usability article, here is a talk on "DIY Usability" by PikPok MD Mario Wynands on how studios can build usability testing into their process

    www.youtube.com/watch?v=o0MMbrYkfU4
     
  9. Blackharon

    Blackharon Well-Known Member

    Mar 15, 2010
    978
    0
    16
    Game Designer for Ludia
    Canada
    Thanks for the helpful information but I wish it went a little further and demoed an actual test.

    What kind of questions were asked, what kind of responses were given, that kind of fun stuff would be invaluable to people (like me) who's previous idea of a usability test was 'does my tutorial explain this to you?'
     
  10. PikPok

    PikPok Well-Known Member

    Nov 26, 2009
    938
    1
    0
    Wellington
    Unfortunately, we only had a 20 minute slot in which to present, so there wasn't much opportunity to show video examples (something we have done at other presentations).

    In terms of "what questions are asked" though, mostly you aren't asking direct questions at all, merely facilitating to test subject to think out loud e.g. "what do you think is happening here?", "what goal are you trying to accomplish?", or plain old "what are you thinking right now?". You need to infer whether "the tutorial" has worked through observation, not ask directly.

    As mentioned, capturing video is important as well as taking notes because there can often be a disparity between what people are saying and what they are actually doing.
     

Share This Page