Was it worth the hassle? Ten years of mobile HCI research discussions on lab and field evaluations

Jesper Kjeldskov, Mikael B. Skov

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

67 Citations (Scopus)

Abstract

Evaluation is considered one of the major cornerstones of human-computer interaction (HCI). During the last decade, several studies have discussed pros and cons of lab and field evaluations. Based on these discussions, we conduct a review to explore the past decade of mobile HCI research on field and lab evaluation, investigating responses in the literature to the "is it worth the hassle?" paper from 2004. We find that while our knowledge and experience with both lab and field studies have grown considerably, there is still no definite answer to the lab versus field question. In response we suggest that the real question is not if - but when and how - to go into the field. In response we suggest moving beyond usability evaluations, and to engage with field studies that are truly in-the-wild, and longitudinal.

Original languageEnglish
Title of host publicationMobileHCI 2014 - Proceedings of the 16th ACM International Conference on Human-Computer Interaction with Mobile Devices and Services
PublisherAssociation for Computing Machinery (ACM)
Pages43-52
Number of pages10
ISBN (Electronic)9781450327718
DOIs
Publication statusPublished - 2014
Externally publishedYes
EventInternational Conference on Human-Computer Interaction with Mobile Devices and Services 2014 - Toronto, Canada
Duration: 23 Sept 201426 Sept 2014
Conference number: 16th
http://mobilehci.acm.org/2014/
https://dl.acm.org/doi/proceedings/10.1145/2628363 (Proceedings)

Conference

ConferenceInternational Conference on Human-Computer Interaction with Mobile Devices and Services 2014
Abbreviated titleMobileHCI 2014
Country/TerritoryCanada
CityToronto
Period23/09/1426/09/14
Internet address

Keywords

  • Evaluation
  • Field
  • In-situ
  • In-the-wild
  • Lab
  • Study

Cite this