Abstract
Evaluation is considered one of the major cornerstones of human-computer interaction (HCI). During the last decade, several studies have discussed pros and cons of lab and field evaluations. Based on these discussions, we conduct a review to explore the past decade of mobile HCI research on field and lab evaluation, investigating responses in the literature to the "is it worth the hassle?" paper from 2004. We find that while our knowledge and experience with both lab and field studies have grown considerably, there is still no definite answer to the lab versus field question. In response we suggest that the real question is not if - but when and how - to go into the field. In response we suggest moving beyond usability evaluations, and to engage with field studies that are truly in-the-wild, and longitudinal.
Original language | English |
---|---|
Title of host publication | MobileHCI 2014 - Proceedings of the 16th ACM International Conference on Human-Computer Interaction with Mobile Devices and Services |
Publisher | Association for Computing Machinery (ACM) |
Pages | 43-52 |
Number of pages | 10 |
ISBN (Electronic) | 9781450327718 |
DOIs | |
Publication status | Published - 2014 |
Externally published | Yes |
Event | International Conference on Human-Computer Interaction with Mobile Devices and Services 2014 - Toronto, Canada Duration: 23 Sept 2014 → 26 Sept 2014 Conference number: 16th http://mobilehci.acm.org/2014/ https://dl.acm.org/doi/proceedings/10.1145/2628363 (Proceedings) |
Conference
Conference | International Conference on Human-Computer Interaction with Mobile Devices and Services 2014 |
---|---|
Abbreviated title | MobileHCI 2014 |
Country/Territory | Canada |
City | Toronto |
Period | 23/09/14 → 26/09/14 |
Internet address |
Keywords
- Evaluation
- Field
- In-situ
- In-the-wild
- Lab
- Study