{rfName}
Pr

Indexed in

License and Use

Icono OpenAccess

Citations

47

Altmetrics

Analysis of institutional authors

San-Segundo, R.Corresponding AuthorMontero, J. M.AuthorCordoba, R.AuthorFerreiros, J.AuthorPardo, J. M.Author

Share

June 9, 2019
Publications
>
Article
Green

Proposing a speech to gesture translation architecture for Spanish deaf people

Publicated to: JOURNAL OF VISUAL LANGUAGES AND COMPUTING. 19 (5): 523-538 - 2008-10-01 19(5), DOI: 10.1016/j.jvlc.2007.06.002

Authors:

San-Segundo, R; Montero, J M; Macias-Guarasa, J; Cordoba, R; Ferreiros, J; Pardo, J M
[+]

Affiliations

UPM, ETSI Telecommun, Dpto Ingn Elect, Grp Tecnol Habla, Madrid 2804, Spain - Author

Abstract

This article describes an architecture for translating speech into Spanish Sign Language (SSL). The architecture proposed is made up of four modules: speech recognizer, semantic analysis, gesture sequence generation and gesture playing. For the speech recognizer and the semantic analysis modules, we use software developed by IBM and CSLR (Center for Spoken Language Research at University of Colorado), respectively. Gesture sequence generation and gesture animation are the modules on which we have focused our main effort. Gesture sequence generation uses semantic concepts (obtained from the semantic analysis) associating them with several SSL gestures. This association is carried out based on a number of generation rules. For gesture animation, we have developed an animated agent (virtual representation of a human person) and a strategy for reducing the effort in gesture animation. This strategy consists of making the system automatically generate all agent positions necessary for the gesture animation. In this process, the system uses a few main agent positions (two or three per second) and some interpolation strategies, both issues previously generated by the service developer (the person who adapts the architecture proposed in this paper to a specific domain). Related to this module, we propose a distance between agent positions and a measure of gesture complexity. This measure can be used to analyze the gesture perception versus its complexity. With the architecture proposed, we are not trying to build a domain independent translator but a system able to translate speech utterances into gesture sequences in a restricted domain: railway, flights or weather information. (C) 2007 Elsevier Ltd. All rights reserved.
[+]

Keywords

Animated agentsAnimationGesture complexityLifelike charactersSpanish sign languageSpeech to gesture translation

Quality index

Bibliometric impact. Analysis of the contribution and dissemination channel

The work has been published in the journal JOURNAL OF VISUAL LANGUAGES AND COMPUTING due to its progression and the good impact it has achieved in recent years, according to the agency Scopus (SJR), it has become a reference in its field. In the year of publication of the work, 2008, it was in position , thus managing to position itself as a Q1 (Primer Cuartil), in the category Human-Computer Interaction.

Independientemente del impacto esperado determinado por el canal de difusión, es importante destacar el impacto real observado de la propia aportación.

Según las diferentes agencias de indexación, el número de citas acumuladas por esta publicación hasta la fecha 2026-04-27:

  • WoS: 22
  • Scopus: 25
[+]

Impact and social visibility

From the perspective of influence or social adoption, and based on metrics associated with mentions and interactions provided by agencies specializing in calculating the so-called "Alternative or Social Metrics," we can highlight as of 2026-04-27:

  • The use of this contribution in bookmarks, code forks, additions to favorite lists for recurrent reading, as well as general views, indicates that someone is using the publication as a basis for their current work. This may be a notable indicator of future more formal and academic citations. This claim is supported by the result of the "Capture" indicator, which yields a total of: 50 (PlumX).

It is essential to present evidence supporting full alignment with institutional principles and guidelines on Open Science and the Conservation and Dissemination of Intellectual Heritage. A clear example of this is:

  • The work has been submitted to a journal whose editorial policy allows open Open Access publication.
  • Assignment of a Handle/URN as an identifier within the deposit in the Institutional Repository: https://oa.upm.es/2140/

As a result of the publication of the work in the institutional repository, statistical usage data has been obtained that reflects its impact. In terms of dissemination, we can state that, as of

  • Views: 617
  • Downloads: 762
[+]

Leadership analysis of institutional authors

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: First Author (SAN SEGUNDO HERNANDEZ, RUBEN) and Last Author (PARDO MUÑOZ, JOSE MANUEL).

the author responsible for correspondence tasks has been SAN SEGUNDO HERNANDEZ, RUBEN.

[+]

Awards linked to the item

This work has been supported by the following projects TINA (UPM y DGUI-CAM. ref: R05/10922), ROBINT (MEC ref. DPI2004-07908-C02) and EDECAN (MEC ref. TIN2005-08660-C04). Authors also want to thank Mark Hallett for the English revision and the anonymous reviewers who helped with their comments to improve the quality and clarity of the presentation.
[+]