{rfName}
A

Indexed in

License and Use

Icono OpenAccess

Citations

49

Altmetrics

Analysis of institutional authors

Juristo, NataliaAuthorVegas, SiraCorresponding Author

Share

June 9, 2019
Publications
>
Article
Sí

A process for managing interaction between experimenters to get useful similar replications

Publicated to: INFORMATION AND SOFTWARE TECHNOLOGY. 55 (2): 215-225 - 2013-02-01 55(2), DOI: 10.1016/j.infsof.2012.07.016

Authors:

Juristo, N; Vegas, S; Solari, M; Abrahao, S; Ramos, I
[+]

Affiliations

Univ ORT Uruguay - Author
Univ Politecn Madrid - Author
Univ Politecn Valencia - Author
Univ Seville - Author
See more

Abstract

Context: A replication is the repetition of an experiment. Several efforts have been made to adopt replication as a common practice in software engineering. There are different types of replications, depending on their purpose. Similar replications keep the experimental conditions as alike as possible to the original ones. External similar replications, where the replicating experimenters are not the same people as the original experimenters, have been a stumbling block. Several attempts at combining the results of replications have resulted in failure. Software engineering does not appear to be well suited to such replications, because it works with complex experimentally immature contexts. Software engineering settings have a large number of variables, and the role that many of them play is unknown. A successful (or useful) similar replication helps to better understand the phenomenon under study by verifying results and/or identifying contextual variables that could influence (or not) the results, through the combination of experimental results. Objective: To be able to get successful similar replications, there needs to be interaction between original and replicating experimenters. In this paper, we propose an interaction process for achieving successful similar replications. Method: This process consists of: an adaptation meeting, where experimenters tailor the experiment to the new setting; querying, to settle occasional inquiries while the experiment is being run; and a combination meeting, where experimenters meet to discuss the combination of replication outcomes with previous results. To check its effectiveness, the process has been tested on three different replications of the same experiment. Results: The proposed interaction process has helped to identify new contextual variables that could potentially influence (or not) the experimental results in the three replications run. Additionally, the interaction process has helped to uncover certain problems and deviations that occurred during some of the replications that we would have not been aware of otherwise. Conclusions: There are signs that suggest that it is possible to get successful similar replications in software engineering experimentation, when there is appropriate interaction among experimenters. (C) 2012 Elsevier B.V. All rights reserved.
[+]

Keywords

Combination of experiment resultsEmpirical studiesExperimentationReplication

Quality index

Bibliometric impact. Analysis of the contribution and dissemination channel

The work has been published in the journal INFORMATION AND SOFTWARE TECHNOLOGY due to its progression and the good impact it has achieved in recent years, according to the agency Scopus (SJR), it has become a reference in its field. In the year of publication of the work, 2013, it was in position , thus managing to position itself as a Q1 (Primer Cuartil), in the category Information Systems. Notably, the journal is positioned above the 90th percentile.

Independientemente del impacto esperado determinado por el canal de difusión, es importante destacar el impacto real observado de la propia aportación.

Según las diferentes agencias de indexación, el número de citas acumuladas por esta publicación hasta la fecha 2026-04-24:

  • Google Scholar: 25
  • WoS: 10
  • Scopus: 14
[+]

Impact and social visibility

From the perspective of influence or social adoption, and based on metrics associated with mentions and interactions provided by agencies specializing in calculating the so-called "Alternative or Social Metrics," we can highlight as of 2026-04-24:

  • The use, from an academic perspective evidenced by the Altmetric agency indicator referring to aggregations made by the personal bibliographic manager Mendeley, gives us a total of: 30.
  • The use of this contribution in bookmarks, code forks, additions to favorite lists for recurrent reading, as well as general views, indicates that someone is using the publication as a basis for their current work. This may be a notable indicator of future more formal and academic citations. This claim is supported by the result of the "Capture" indicator, which yields a total of: 30 (PlumX).

With a more dissemination-oriented intent and targeting more general audiences, we can observe other more global scores such as:

  • The Total Score from Altmetric: 8.
  • The number of mentions on the social network X (formerly Twitter): 1 (Altmetric).

It is essential to present evidence supporting full alignment with institutional principles and guidelines on Open Science and the Conservation and Dissemination of Intellectual Heritage. A clear example of this is:

  • The work has been submitted to a journal whose editorial policy allows open Open Access publication.
  • Assignment of a Handle/URN as an identifier within the deposit in the Institutional Repository: https://oa.upm.es/26024/

As a result of the publication of the work in the institutional repository, statistical usage data has been obtained that reflects its impact. In terms of dissemination, we can state that, as of

  • Views: 434
  • Downloads: 254
[+]

Leadership analysis of institutional authors

This work has been carried out with international collaboration, specifically with researchers from: Uruguay.

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: First Author (JURISTO JUZGADO, NATALIA) .

the author responsible for correspondence tasks has been VEGAS HERNANDEZ, SIRA.

[+]

Awards linked to the item

This work has been performed under research Grant TIN2011-23216 of the Spanish Ministry of Science and Innovation.
[+]