- -

A process for managing interaction between experimenters to get useful similar replications

RiuNet: Institutional repository of the Polithecnic University of Valencia

Share/Send to

Cited by

Statistics

  • Estadisticas de Uso

A process for managing interaction between experimenters to get useful similar replications

Show simple item record

Files in this item

dc.contributor.author Juristo, Natalia es_ES
dc.contributor.author Vegas, Sira es_ES
dc.contributor.author Solari, Martín es_ES
dc.contributor.author Abrahao Gonzales, Silvia Mara es_ES
dc.contributor.author Ramos, Isabel
dc.date.accessioned 2013-11-13T12:56:05Z
dc.date.issued 2013-02
dc.identifier.issn 0950-5849
dc.identifier.uri http://hdl.handle.net/10251/33540
dc.description.abstract Context: A replication is the repetition of an experiment. Several efforts have been made to adopt replication as a common practice in software engineering. There are different types of replications, depending on their purpose. Similar replications keep the experimental conditions as alike as possible to the original ones. External similar replications, where the replicating experimenters are not the same people as the original experimenters, have been a stumbling block. Several attempts at combining the results of replications have resulted in failure. Software engineering does not appear to be well suited to such replications, because it works with complex experimentally immature contexts. Software engineering settings have a large number of variables, and the role that many of them play is unknown. A successful (or useful) similar replication helps to better understand the phenomenon under study by verifying results and/or identifying contextual variables that could influence (or not) the results, through the combination of experimental results. Objective: To be able to get successful similar replications, there needs to be interaction between original and replicating experimenters. In this paper, we propose an interaction process for achieving successful similar replications. Method: This process consists of: an adaptation meeting, where experimenters tailor the experiment to the new setting; querying, to settle occasional inquiries while the experiment is being run; and a combination meeting, where experimenters meet to discuss the combination of replication outcomes with previous results. To check its effectiveness, the process has been tested on three different replications of the same experiment. Results: The proposed interaction process has helped to identify new contextual variables that could potentially influence (or not) the experimental results in the three replications run. Additionally, the interaction process has helped to uncover certain problems and deviations that occurred during some of the replications that we would have not been aware of otherwise. Conclusions: There are signs that suggest that it is possible to get successful similar replications in software engineering experimentation, when there is appropriate interaction among experimenters. es_ES
dc.description.sponsorship This work has been performed under research Grant TIN2011-23216 of the Spanish Ministry of Science and Innovation. en_EN
dc.format.extent 11 es_ES
dc.language Inglés es_ES
dc.publisher Elsevier es_ES
dc.relation.ispartof Information and Software Technology es_ES
dc.rights Reserva de todos los derechos es_ES
dc.subject Empirical studies es_ES
dc.subject Experimentation es_ES
dc.subject Replication es_ES
dc.subject Combination of experiment results es_ES
dc.subject.classification LENGUAJES Y SISTEMAS INFORMATICOS es_ES
dc.title A process for managing interaction between experimenters to get useful similar replications es_ES
dc.type Artículo es_ES
dc.embargo.lift 10000-01-01
dc.embargo.terms forever es_ES
dc.identifier.doi 10.1016/j.infsof.2012.07.016
dc.relation.projectID info:eu-repo/grantAgreement/MICINN//TIN2011-23216/ES/TECNOLOGIAS PARA LA REPLICACION Y SINTESIS DE EXPERIMENTOS EN IS/ es_ES
dc.rights.accessRights Abierto es_ES
dc.contributor.affiliation Universitat Politècnica de València. Departamento de Sistemas Informáticos y Computación - Departament de Sistemes Informàtics i Computació es_ES
dc.description.bibliographicCitation Juristo, N.; Vegas, S.; Solari, M.; Abrahao Gonzales, SM.; Ramos, I. (2013). A process for managing interaction between experimenters to get useful similar replications. Information and Software Technology. 55(2):215-225. https://doi.org/10.1016/j.infsof.2012.07.016 es_ES
dc.description.accrualMethod S es_ES
dc.relation.publisherversion http://dx.doi.org/10.1016/j.infsof.2012.07.016 es_ES
dc.description.upvformatpinicio 215 es_ES
dc.description.upvformatpfin 225 es_ES
dc.type.version info:eu-repo/semantics/publishedVersion es_ES
dc.description.volume 55 es_ES
dc.description.issue 2 es_ES
dc.relation.senia 237417
dc.contributor.funder Ministerio de Ciencia e Innovación es_ES


This item appears in the following Collection(s)

Show simple item record