Storyplay Multimodal: A Research Tool for the Multimodal Evaluation of Serious Games
Key: SG17-1
Author: Laila Shoukry, Stefan Göbel
Date: October 2017
Kind: In proceedings
Publisher: Academic Conferences and Publishing International Limited
Book title: Proceedings of the 11th European Conference on Games Based Learning
Keywords: game-based learning, serious games, evaluation, testing, mobile
Abstract: The many benefits of Serious Games have led to a growing interest in using them as educational tools. With this growing interest, researchers in the field of Serious Games have been increasingly recognizing the importance of evaluation for advancing this research field. In addition, traditional techniques used for evaluating software fall short when evaluating in-game interactions and reactions of Serious Games users, especially in dynamic settings such as using smartphones. Fortunately, these same devices make it possible to make more diverse data available to help researchers during the evaluation process. Although remote, unobtrusive playtesting is already being deployed for evaluating many mobile applications, there is still a lack of multimodal tools specifically targeting Serious Games as we will show in this paper. Thus, there is a need for supporting multimodal Serious Games evaluation in natural mo-bile settings with tailored frameworks. After providing a review over available tools and related literature, this pa-per will propose a mobile multimodal data gathering and pre-processing framework for Serious Games evaluation. It is being implemented as an extension to StoryPlay, a researcher tool for rapid prototyping of Serious Games cre-ated with the Serious Games authoring environment StoryTec. As the latter originally had no support for mobile or multimodal data, the main focus is on complementing logging with multimodal data to facilitate the linking of affec-tive and cognitive engagement to interaction and gameplay events. The goal is supporting (reducing time, effort and expenses of and enhancing the results of) observational user-based evaluation of mobile serious games. Main re-quirements for the framework arise from the literature and soft-ware review and are then translated into design de-cisions for capturing, synchronizing, reconstructing and pre-processing multimodal game session data for efficient navigation and evaluation. Although the framework is built for mobile games exported using StoryTec, the concept can be generally applied for the evaluation of mobile scene-based educational games and can serve as a basis for ad-vancing the research on Serious Games evaluation.
View Full paper (PDF) | Download Full paper (PDF)
Official URL

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, not withstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.