Effect of data augmentation with multi-view perspectives of signers on the DGS-Fabeln-1 dataset

  • Sign languages constitute the principal form of communication for deaf communities across the globe. Nevertheless, the development of reliable Continuous Sign Language Translation (CSLT) systems is constrained by the lack of sufficient data and models able to handle spatio-temporal information. In this article, we explore the effect of adding multiview perspectives of the signer to the training set as data augmentation using the UniSign framework for the DGS-Fabeln-1 dataset. Our results reveal that increasing dataset size and using multiple camera perspectives significantly improve performance, with the best configurations achieving BLEU-4 scores of 4.20%. These results provide a competitive baseline for the DGS-Fabeln-1 dataset and guidance for further optimizations of CSLT systems.

Download full text files

Export metadata

Statistics

Number of document requests

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Fabian Renner, Daksitha Withanage DonGND, Elisabeth AndréORCiDGND, Cristina Luna JimenezORCiDGND
URN:urn:nbn:de:bvb:384-opus4-1321004
Frontdoor URLhttps://opus.bibliothek.uni-augsburg.de/opus4/132100
ISSN:2522-2686OPAC
Parent Title (English):Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, Palma, Mallorca, Spain, 11-16 May 2026
Publisher:European Language Resources Association (ELRA)
Place of publication:Paris
Editor:Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Johanna Mesch, Marc Schulder
Type:Conference Proceeding
Language:English
Year of first Publication:2026
Publishing Institution:Universität Augsburg
Release Date:2026/07/21
First Page:429
Last Page:437
DOI:https://doi.org/10.63317/2zrdptjrx3pa
Institutes:Fakultät für Angewandte Informatik
Fakultät für Angewandte Informatik / Institut für Informatik
Fakultät für Angewandte Informatik / Institut für Informatik / Lehrstuhl für Menschzentrierte Künstliche Intelligenz
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
Licence (German):CC-BY-NC 4.0: Creative Commons: Namensnennung - Nicht kommerziell

OPUS4 Logo