Evaluating the effort of composing design models

A controlled experiment

Kleinner Farias, Alessandro Garcia, Jon Whittle, Christina von Flach Garcia Chavez, Carlos Lucena

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

7 Citations (Scopus)

Abstract

The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

Original languageEnglish
Title of host publicationModel Driven Engineering Languages and Systems
Subtitle of host publication15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]
EditorsRobert B. France, Jurgen Kazmeier, Ruth Breu, Colin Atkinson
PublisherSpringer
Pages676-691
Number of pages16
ISBN (Electronic)9783642336669
ISBN (Print)9783642336652
DOIs
Publication statusPublished - 2012
Externally publishedYes
EventACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012 - Innsbruck, Austria
Duration: 30 Sep 20125 Oct 2012
Conference number: 15th

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume7590
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012
Abbreviated titleMODELS 212
CountryAustria
CityInnsbruck
Period30/09/125/10/12

Keywords

  • Effort measurement
  • Empirical studies
  • Model composition effort

Cite this

Farias, K., Garcia, A., Whittle, J., von Flach Garcia Chavez, C., & Lucena, C. (2012). Evaluating the effort of composing design models: A controlled experiment. In R. B. France, J. Kazmeier, R. Breu, & C. Atkinson (Eds.), Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings] (pp. 676-691). (Lecture Notes in Computer Science; Vol. 7590). Springer. https://doi.org/10.1007/978-3-642-33666-9_43
Farias, Kleinner ; Garcia, Alessandro ; Whittle, Jon ; von Flach Garcia Chavez, Christina ; Lucena, Carlos. / Evaluating the effort of composing design models : A controlled experiment. Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. editor / Robert B. France ; Jurgen Kazmeier ; Ruth Breu ; Colin Atkinson. Springer, 2012. pp. 676-691 (Lecture Notes in Computer Science).
@inproceedings{c8d8325bbe92424e9636f78b53d5a60d,
title = "Evaluating the effort of composing design models: A controlled experiment",
abstract = "The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.",
keywords = "Effort measurement, Empirical studies, Model composition effort",
author = "Kleinner Farias and Alessandro Garcia and Jon Whittle and {von Flach Garcia Chavez}, Christina and Carlos Lucena",
year = "2012",
doi = "10.1007/978-3-642-33666-9_43",
language = "English",
isbn = "9783642336652",
series = "Lecture Notes in Computer Science",
publisher = "Springer",
pages = "676--691",
editor = "France, {Robert B.} and Jurgen Kazmeier and Ruth Breu and Colin Atkinson",
booktitle = "Model Driven Engineering Languages and Systems",

}

Farias, K, Garcia, A, Whittle, J, von Flach Garcia Chavez, C & Lucena, C 2012, Evaluating the effort of composing design models: A controlled experiment. in RB France, J Kazmeier, R Breu & C Atkinson (eds), Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. Lecture Notes in Computer Science, vol. 7590, Springer, pp. 676-691, ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012, Innsbruck, Austria, 30/09/12. https://doi.org/10.1007/978-3-642-33666-9_43

Evaluating the effort of composing design models : A controlled experiment. / Farias, Kleinner; Garcia, Alessandro; Whittle, Jon; von Flach Garcia Chavez, Christina; Lucena, Carlos.

Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. ed. / Robert B. France; Jurgen Kazmeier; Ruth Breu; Colin Atkinson. Springer, 2012. p. 676-691 (Lecture Notes in Computer Science; Vol. 7590).

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

TY - GEN

T1 - Evaluating the effort of composing design models

T2 - A controlled experiment

AU - Farias, Kleinner

AU - Garcia, Alessandro

AU - Whittle, Jon

AU - von Flach Garcia Chavez, Christina

AU - Lucena, Carlos

PY - 2012

Y1 - 2012

N2 - The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

AB - The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

KW - Effort measurement

KW - Empirical studies

KW - Model composition effort

UR - http://www.scopus.com/inward/record.url?scp=84867644226&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-33666-9_43

DO - 10.1007/978-3-642-33666-9_43

M3 - Conference Paper

SN - 9783642336652

T3 - Lecture Notes in Computer Science

SP - 676

EP - 691

BT - Model Driven Engineering Languages and Systems

A2 - France, Robert B.

A2 - Kazmeier, Jurgen

A2 - Breu, Ruth

A2 - Atkinson, Colin

PB - Springer

ER -

Farias K, Garcia A, Whittle J, von Flach Garcia Chavez C, Lucena C. Evaluating the effort of composing design models: A controlled experiment. In France RB, Kazmeier J, Breu R, Atkinson C, editors, Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. Springer. 2012. p. 676-691. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-642-33666-9_43