Show me how you use your mouse and I tell you how you feel? Sensing affect with the computer mouse

  • Computer mouse tracking is a simple and cost-efficient way to gather continuous behavioral data. As theory suggests a relationship between affect and sensorimotor processes, the computer mouse might be usable for affect sensing. However, the processes underlying a connection between mouse usage and affect are complex, hitherto empirical evidence is ambiguous, and the research area lacks longitudinal studies. The present work brings forward a longitudinal field study in which 179 participants hourly self-reported their affect while their mouse usage was tracked both during their self-directed, contextless as well as task-bound computer use over the course of 14 days, resulting in a dataset comprising 10,760 instances of data collection. Extensive statistical analysis using null hypothesis significance testing and machine learning reveal weak and sporadic relationships between mouse usage and longitudinal self-reported affect at best. The results of this study challenge the immediate useComputer mouse tracking is a simple and cost-efficient way to gather continuous behavioral data. As theory suggests a relationship between affect and sensorimotor processes, the computer mouse might be usable for affect sensing. However, the processes underlying a connection between mouse usage and affect are complex, hitherto empirical evidence is ambiguous, and the research area lacks longitudinal studies. The present work brings forward a longitudinal field study in which 179 participants hourly self-reported their affect while their mouse usage was tracked both during their self-directed, contextless as well as task-bound computer use over the course of 14 days, resulting in a dataset comprising 10,760 instances of data collection. Extensive statistical analysis using null hypothesis significance testing and machine learning reveal weak and sporadic relationships between mouse usage and longitudinal self-reported affect at best. The results of this study challenge the immediate use of computer mouse tracking for longitudinal affect sensing and point to a necessity for more research.show moreshow less

Download full text files

Export metadata

Statistics

Number of document requests

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Paul Freihaut, Anja S. GöritzORCiDGND
Frontdoor URLhttps://opus.bibliothek.uni-augsburg.de/opus4/112431
ISSN:1949-3045OPAC
ISSN:2371-9850OPAC
Parent Title (English):IEEE Transactions on Affective Computing
Publisher:Institute of Electrical and Electronics Engineers (IEEE)
Place of publication:New York, NY
Type:Article
Language:English
Year of first Publication:2024
Publishing Institution:Universität Augsburg
Release Date:2024/04/05
Tag:Human-Computer Interaction; Software
DOI:https://doi.org/10.1109/taffc.2024.3357733
Institutes:Philosophisch-Sozialwissenschaftliche Fakultät
Philosophisch-Sozialwissenschaftliche Fakultät / Institut für Sportwissenschaft
Philosophisch-Sozialwissenschaftliche Fakultät / Institut für Sportwissenschaft / Lehrstuhl für Behavioral Health Technology
Dewey Decimal Classification:1 Philosophie und Psychologie / 15 Psychologie / 150 Psychologie
Latest Publications (not yet published in print):Aktuelle Publikationen (noch nicht gedruckt erschienen)
Licence (German):CC-BY 4.0: Creative Commons: Namensnennung (mit Print on Demand)