The playthrough evaluation framework reliable usability evaluation for video games

White, Gareth R (2014) The playthrough evaluation framework reliable usability evaluation for video games. Doctoral thesis (PhD), University of Sussex.

PDF - Published Version
Download (2MB) | Preview


This thesis presents the playthrough evaluation framework, a novel framework for the reliable usability evaluation of first-person shooter console video games. The framework includes playthrough evaluation, a structured usability evaluation method adapted from heuristic evaluation.
Usability evaluation can help guide developers by pointing out design issues that cause users problems. However, usability evaluation methods suffer from the evaluator effect, where separate evaluations of the same data do not produce reliably consistent results. This can
result in a number of undesirable consequences affecting issues such as:
• Unreliable evaluation: Without reliable results, evaluation reports risk giving incorrect or misleading advice.
• Weak methodological validation: Typically new methods (e.g., new heuristics) are validated against user tests. However, without a reliable means to describe observations, attempts to validate novel methods against user test data will also be affected by weak reliability.
The playthrough evaluation framework addresses these points through a series of studies presenting the need for, and showing the development of the framework, including the following stages,
1. Explication of poor reliability in heuristic evaluation.
2. Development and validation of a reliable user test coding scheme.
3. Derivation of a novel usability evaluation method, playthrough evaluation.
4. Testing the method, quantifying results.
Evaluations were conducted with 22 participants, on 3 first-person shooter action console video games, using two methodologies, heuristic evaluation and the novel playthrough evaluation developed in this thesis. Both methods proved effective, with playthrough evaluation providing more detailed analysis but requiring more time to conduct.

Item Type: Thesis (Doctoral)
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: G Geography. Anthropology. Recreation > GV Recreation. Leisure > GV1199 Games and amusements > GV1221 Indoor games and amusements > GV1469.15 Computer games. Video games. Fantasy games
Depositing User: Library Cataloguing
Date Deposited: 12 Dec 2014 14:18
Last Modified: 25 Sep 2015 15:14

View download statistics for this item

📧 Request an update