Field studies: a methodology for construction and evaluation of recommendation systems in software engineering

Ayşe Tosun Mısırlı, Ayşe Bener, Bora Çağlayan, Gül Çalıklı, Burak Turhan

Research output: Chapter in Book/Report/Conference proceedingChapter (Book)Researchpeer-review

4 Citations (Scopus)


One way to implement and evaluate the effectiveness of recommendation systems in software engineering is to conduct field studies. Field studies are important as they are the extension of laboratory experiments into real-life situations of organizations and/or society. They bring greater realism to the phenomena that are under study. However, field studies require following a rigorous research approach with many challenges attached, such as difficulties in implementing the research design, achieving sufficient control, replication, validity, and reliability. In practice, another challenge is to find organizations who are prepared to be studied. In this chapter, we provide a step-by-step process for the construction and deployment of recommendation systems in software engineering in the field. We also emphasize three main challenges (organizational, data, design) encountered during field studies, both in general and specifically with respect to software organizations.

Original languageEnglish
Title of host publicationRecommendation Systems in Software Engineering
EditorsMartin P. Robillard, Walid Maalej, Robert J. Walker, Thomas Zimmermann
Place of PublicationBerlin Germany
Number of pages27
ISBN (Electronic)9783642451355
ISBN (Print)9783642451348
Publication statusPublished - 2014
Externally publishedYes

Cite this