Evaluating the effort of composing design models: A controlled experiment

Kleinner Farias; Alessandro Garcia; Jon Whittle; Christina von Flach Garcia Chavez; Carlos Lucena

doi:10.1007/978-3-642-33666-9_43

Evaluating the effort of composing design models: A controlled experiment

Kleinner Farias, Alessandro Garcia, Jon Whittle, Christina von Flach Garcia Chavez, Carlos Lucena

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

8 Citations (Scopus)

Abstract

The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

Original language	English
Title of host publication	Model Driven Engineering Languages and Systems
Subtitle of host publication	15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]
Editors	Robert B. France, Jurgen Kazmeier, Ruth Breu, Colin Atkinson
Publisher	Springer
Pages	676-691
Number of pages	16
ISBN (Electronic)	9783642336669
ISBN (Print)	9783642336652
DOIs	https://doi.org/10.1007/978-3-642-33666-9_43
Publication status	Published - 2012
Externally published	Yes
Event	ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012 - Innsbruck, Austria Duration: 30 Sept 2012 → 5 Oct 2012 Conference number: 15th https://dl.acm.org/doi/proceedings/10.5555/2404962 (Proceedings)

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	7590
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012
Abbreviated title	MoDELS 212
Country/Territory	Austria
City	Innsbruck
Period	30/09/12 → 5/10/12
Internet address	https://dl.acm.org/doi/proceedings/10.5555/2404962 (Proceedings)

Keywords

Effort measurement
Empirical studies
Model composition effort

Access to Document

10.1007/978-3-642-33666-9_43

Cite this

Farias, K., Garcia, A., Whittle, J., von Flach Garcia Chavez, C., & Lucena, C. (2012). Evaluating the effort of composing design models: A controlled experiment. In R. B. France, J. Kazmeier, R. Breu, & C. Atkinson (Eds.), Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings] (pp. 676-691). (Lecture Notes in Computer Science; Vol. 7590). Springer. https://doi.org/10.1007/978-3-642-33666-9_43

Farias, Kleinner ; Garcia, Alessandro ; Whittle, Jon et al. / Evaluating the effort of composing design models : A controlled experiment. Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. editor / Robert B. France ; Jurgen Kazmeier ; Ruth Breu ; Colin Atkinson. Springer, 2012. pp. 676-691 (Lecture Notes in Computer Science).

@inproceedings{c8d8325bbe92424e9636f78b53d5a60d,

title = "Evaluating the effort of composing design models: A controlled experiment",

abstract = "The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.",

keywords = "Effort measurement, Empirical studies, Model composition effort",

author = "Kleinner Farias and Alessandro Garcia and Jon Whittle and {von Flach Garcia Chavez}, Christina and Carlos Lucena",

year = "2012",

doi = "10.1007/978-3-642-33666-9_43",

language = "English",

isbn = "9783642336652",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "676--691",

editor = "France, {Robert B.} and Jurgen Kazmeier and Ruth Breu and Colin Atkinson",

booktitle = "Model Driven Engineering Languages and Systems",

note = "ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012, MoDELS 212 ; Conference date: 30-09-2012 Through 05-10-2012",

url = "https://dl.acm.org/doi/proceedings/10.5555/2404962",

}

Farias, K, Garcia, A, Whittle, J, von Flach Garcia Chavez, C & Lucena, C 2012, Evaluating the effort of composing design models: A controlled experiment. in RB France, J Kazmeier, R Breu & C Atkinson (eds), Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. Lecture Notes in Computer Science, vol. 7590, Springer, pp. 676-691, ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012, Innsbruck, Austria, 30/09/12. https://doi.org/10.1007/978-3-642-33666-9_43

Evaluating the effort of composing design models: A controlled experiment. / Farias, Kleinner; Garcia, Alessandro; Whittle, Jon et al.
Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. ed. / Robert B. France; Jurgen Kazmeier; Ruth Breu; Colin Atkinson. Springer, 2012. p. 676-691 (Lecture Notes in Computer Science; Vol. 7590).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Evaluating the effort of composing design models

T2 - ACM/IEEE International Conference on Model Driven Engineering Languages and Systems 2012

AU - Farias, Kleinner

AU - Garcia, Alessandro

AU - Whittle, Jon

AU - von Flach Garcia Chavez, Christina

AU - Lucena, Carlos

N1 - Conference code: 15th

PY - 2012

Y1 - 2012

N2 - The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

AB - The lack of empirical knowledge about the effects of model composition techniques on developers' effort is the key impairment for their widespread adoption in practice. This problem applies to both existing categories of model composition techniques, i.e. specification-based (e.g. Epsilon) and heuristic-based (e.g. IBM RSA) techniques. This paper reports on a controlled experiment that investigates the effort to: (1) apply both categories of model composition techniques, and (2) detect and resolve inconsistencies in the output composed models. The techniques are investigated in 144 evolution scenarios, where 2304 compositions of elements of class diagrams were produced. The results suggest that: (1) the employed heuristic-based techniques require less effort to produce the intended model than the chosen specification-based technique, (2) the correctness of the output composed models generated by the techniques is not significantly different, and (3) the use of manual heuristics for model composition outperforms their automated counterparts.

KW - Effort measurement

KW - Empirical studies

KW - Model composition effort

UR - http://www.scopus.com/inward/record.url?scp=84867644226&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-33666-9_43

DO - 10.1007/978-3-642-33666-9_43

M3 - Conference Paper

AN - SCOPUS:84867644226

SN - 9783642336652

T3 - Lecture Notes in Computer Science

SP - 676

EP - 691

BT - Model Driven Engineering Languages and Systems

A2 - France, Robert B.

A2 - Kazmeier, Jurgen

A2 - Breu, Ruth

A2 - Atkinson, Colin

PB - Springer

Y2 - 30 September 2012 through 5 October 2012

ER -

Farias K, Garcia A, Whittle J, von Flach Garcia Chavez C, Lucena C. Evaluating the effort of composing design models: A controlled experiment. In France RB, Kazmeier J, Breu R, Atkinson C, editors, Model Driven Engineering Languages and Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October, 2012 [proceedings]. Springer. 2012. p. 676-691. (Lecture Notes in Computer Science). doi: 10.1007/978-3-642-33666-9_43

Evaluating the effort of composing design models: A controlled experiment

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Evaluating the effort of composing design models: a controlled experiment

Cite this