NOVA - a tool for eXplainable Cooperative Machine Learning

  • In this paper, we introduce a next-generation annotation tool called NOVA, which implements a workflow that interactively incorporates the `human in the loop'. In particular, NOVA offers a collaborative annotation backend where multiple annotators join their workforce. A main aspect of NOVA is the possibility of applying semi-supervised active learning where Machine Learning techniques are used already during the annotation process by giving the possibility to pre-label data automatically. Furthermore, NOVA implements recent eXplainable AI (XAI) techniques to provide users with both, a confidence value of the automatically predicted annotations, as well as visual explanation. This way, annotators get to understand whether they can trust their ML models, or more annotated data is necessary.

Download full text files

Export metadata


Number of document requests

Additional Services

Share in Twitter Search Google Scholar
Author:Alexander HeimerlGND, Tobias BaurORCiDGND, Florian LingenfelserGND, Johannes Wagner, Elisabeth AndréORCiDGND
Frontdoor URL
Parent Title (English):2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), 3-6 September 2019, Cambridge, UK
Place of publication:Piscataway, NJ
Type:Conference Proceeding
Year of first Publication:2019
Publishing Institution:Universität Augsburg
Release Date:2020/09/07
First Page:109
Last Page:115
Institutes:Fakultät für Angewandte Informatik
Fakultät für Angewandte Informatik / Institut für Informatik
Fakultät für Angewandte Informatik / Institut für Informatik / Lehrstuhl für Menschzentrierte Künstliche Intelligenz
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
Licence (German):Deutsches Urheberrecht