{rfName}
Th

License and use

Altmetrics

Grant support

This project was partially supported by the Spanish Ministry of Science and Innovation under research grant PID2019110866RB-I00.

Analysis of institutional authors

Cardenas, RCorresponding AuthorArroba, PAuthorRisco-Martin, JlAuthor

Share

August 8, 2022
Publications
>
Article
No

The DEVStone Metric: Performance Analysis of DEVS Simulation Engines

Publicated to:Acm Transactions On Modeling And Computer Simulation. 32 (3): 21- - 2022-07-01 32(3), DOI: https://doi.org/10.1145/3543849

Authors: Cardenas, Roman; Henares, Kevin; Arroba, Patricia; Risco-Martin, Jose L; Wainer, Gabriel A

Affiliations

Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON, Canada - Author
Complutense Madrid, Dept Comp Architecture & Automat, Madrid, Spain - Author
Univ Complutense Madrid, Madrid, Spain - Author
Univ Politecn Madrid, Integrated Syst Lab, Madrid, Spain - Author

Abstract

The DEVStone benchmark allows us to evaluate the performance of discrete-event simulators based on the Discrete Event System (DEVS) formalism. It provides model sets with different characteristics, enabling the analysis of specific issues of simulation engines. However, this heterogeneity hinders the comparison of the results among studies, as the results obtained on each research work depend on the chosen subset of DEVStone models. We define the DEVStone metric based on the DEVStone synthetic benchmark and provide a mechanism for specifying objective ratings for DEVS-based simulators. This metric corresponds to the average number of times that a simulator can execute a selection of 12 DEVStone models in 1 minute. The variety of the chosen models ensures that we measure different particularities provided by DEVStone. The proposed metric allows us to compare various simulators and to assess the impact of new features on their performance. We use the DEVStone metric to compare some popular DEVS-based simulators.

Keywords

BenchmarkingDiscrete-event simulationInteroperabilityPerformance

Quality index

Bibliometric impact. Analysis of the contribution and dissemination channel

The work has been published in the journal Acm Transactions On Modeling And Computer Simulation, and although the journal is classified in the quartile Q3 (Agencia WoS (JCR)), its regional focus and specialization in Mathematics, Applied, give it significant recognition in a specific niche of scientific knowledge at an international level.

Independientemente del impacto esperado determinado por el canal de difusión, es importante destacar el impacto real observado de la propia aportación.

Según las diferentes agencias de indexación, el número de citas acumuladas por esta publicación hasta la fecha 2025-07-25:

  • WoS: 4
  • Scopus: 3

Impact and social visibility

From the perspective of influence or social adoption, and based on metrics associated with mentions and interactions provided by agencies specializing in calculating the so-called "Alternative or Social Metrics," we can highlight as of 2025-07-25:

  • The use of this contribution in bookmarks, code forks, additions to favorite lists for recurrent reading, as well as general views, indicates that someone is using the publication as a basis for their current work. This may be a notable indicator of future more formal and academic citations. This claim is supported by the result of the "Capture" indicator, which yields a total of: 4 (PlumX).

It is essential to present evidence supporting full alignment with institutional principles and guidelines on Open Science and the Conservation and Dissemination of Intellectual Heritage. A clear example of this is:

  • Assignment of a Handle/URN as an identifier within the deposit in the Institutional Repository: https://oa.upm.es/86087/

As a result of the publication of the work in the institutional repository, statistical usage data has been obtained that reflects its impact. In terms of dissemination, we can state that, as of

  • Views: 53
  • Downloads: 14

Leadership analysis of institutional authors

This work has been carried out with international collaboration, specifically with researchers from: Canada.

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: First Author (CARDENAS RODRIGUEZ, ROMAN) .

the author responsible for correspondence tasks has been CARDENAS RODRIGUEZ, ROMAN.