Robot cooking — transferring observations into a planning language: an automated approach in the field of cooking
- The recognition of human activities from video sequences and their transformation into a machine-readable form is a challenging task, which is the subject of many studies. The goal of this project is to develop an automated method for analyzing, identifying and processing motion capture data into a planning language. This is performed in a cooking scenario by recording the pose of the acting hand. First, predefined side actions are detected in the dataset using classification. The remaining frames are then clustered into main actions. Using this information, the known initial positions and virtual object tracking, a machine-readable planning domain definition language (PDDL) is generated.
Author: | Markus Schmitz, Florian Menz, Ruben Grunau, Nils MandischerORCiDGND, Mathias Hüsing, Burkhard Corves |
---|---|
URN: | urn:nbn:de:bvb:384-opus4-1178676 |
Frontdoor URL | https://opus.bibliothek.uni-augsburg.de/opus4/117867 |
ISSN: | 2673-4117OPAC |
Parent Title (English): | eng |
Publisher: | MDPI |
Type: | Article |
Language: | English |
Year of first Publication: | 2023 |
Publishing Institution: | Universität Augsburg |
Release Date: | 2025/01/07 |
Volume: | 4 |
Issue: | 4 |
First Page: | 2514 |
Last Page: | 2524 |
DOI: | https://doi.org/10.3390/eng4040143 |
Institutes: | Fakultät für Angewandte Informatik |
Fakultät für Angewandte Informatik / Institut für Informatik | |
Fakultät für Angewandte Informatik / Institut für Informatik / Lehrstuhl für Ingenieurinformatik mit Schwerpunkt Mechatronik | |
Dewey Decimal Classification: | 6 Technik, Medizin, angewandte Wissenschaften / 60 Technik / 600 Technik, Technologie |
Licence (German): | ![]() |