The final AREEF evaluation paper has been presented at MobileHCI 2016 in beautiful Florence. The full reference is as follows:
Oppermann, Leif, Lisa Blum, and Marius Shekow (2016)
“Playing on AREEF – Evaluation of an Underwater Augmented Reality Game
for Kids”. Presented at MobileHCI, pp. 330-340 Florence, Italy
The paper can be accessed via the ACM Digital Library and Researchgate.
The last stage of the AREEF project was the user evaluation, which was carried out at the end of October 2013 by Fraunhofer FIT in Darmstadt and Siegburg, Germany. The game was tested in real conditions in a swimming pool by children between 8 and 12 years old. In the evaluation the children were first instructed to the game and were then observed while playing it from inside and outside the pool by Fraunhofer FIT researchers. Each child was finally interviewed, filling a questionnaire.
The evaluation was split into a pilot and final evaluation. The pilot evaluation took place in Darmstadt, Germany on September 30th with three children. It was not only helpful in improving the experience of the game, but also to determine the feasibility of the evaluation-plan. It allowed establishing a routine in the team, since evaluating technology with children is challenging.
The final evaluation in Siegburg was intended to take place with a much higher number of participants. The call for participants was distributed by local media on October 15th (Stadt-Anzeiger Köln, Generalanzeiger Bonn), bringing forward 36 volunteers being evaluated within one week. The evaluation was also covered by the media and aired by national television (WDR Lokalzeit, October 24th). It was also covered by print media (Stadt-Anzeiger Köln, October 25th and Bild der Wissenschaft Plus, published January 8th).
In the final evaluation a comprehensive amount of data was collected, comprised of qualitative and quantitative data from the questionnaire, and quantitative data from the game log files. Feedback from children regarding the idea and the hardware & software implementation was overwhelmingly positive. Many children asked for more virtual scenery or more play-time in upcoming versions, and the majority expressed strong interest in commercialization, since they would like to rent the AREEF system in the future.
An overview of the AREEF experience and its participatory system design process was presented at the IEEE Games Innovation Conference in Vancouver, Canada. The full reference is as follows:
Oppermann, Leif, Lisa Blum, Jun-Yeong Lee, and Jung-Hyub Seo (2013)
“AREEF: Multi-player Underwater Augmented Reality Experience”. In IEEE
Games Innovation Conference (IGIC), Vancouver, Canada
The paper can also be accessed via the IEEE Xplore Digital Library.
With AREEF being the first KIAT-funded project with a European lead-organisation (Fraunhofer FIT), we have been invited twice to speak about it as a case study for successful Korean-European cooperation at the KORRIDOR Infodays in Bonn (March 1st 2011) and Barcelona (October 6th 2011).
The presentation provides an overview of the project, as well as a summary of our experience from getting the project and some lessons learned.