TY - CONF A1 - Uz-Zaman, Md Mahmud A1 - Schaffer, Stefan A1 - Scheffler, Tatjana A2 - Paschke, Adrian A2 - Rehm, Georg A2 - Al Qundus, Jamal A2 - Neudecker, Clemens A2 - Pintscher, Lydia T1 - Factoid and open-ended question answering with BERT in the museum domain T2 - Qurator 2021 - Conference on Digital Curation Technologies: proceedings of the Conference on Digital Curation Technologies (Qurator 2021), Berlin, Germany, February 8th to 12th, 2021 N2 - Most question answering tasks are oriented towards open do- main factoid questions. In comparison, much less work has studied both factoid and open ended questions in closed domains. We have chosen a current state-of-art BERT model for our question answering exper- iment, and investigate the effectiveness of the BERT model for both factoid and open-ended questions in the museum domain, in a realistic setting. We conducted a web based experiment where we collected 285 questions relating to museum pictures. We manually determined the an- swers from the description texts of the pictures and classified them into answerable/un-answerable and factoid/open-ended. We passed the ques- tions through a BERT model and evaluated their performance with our created dataset. Matching our expectations, BERT performed better for factoid questions, while it was only able to answer 36% of the open-ended questions. Further analysis showed that questions that can be answered from a single sentence or two are easier for the BERT model. We have also found that the individual picture and description text have some implications for the performance of the BERT model. Finally, we pro- pose how to overcome the current limitations of out of the box question answering solutions in realistic settings and point out important factors for designing the context for getting a better question answering model using BERT. Y1 - 2024 UR - https://opus.bibliothek.uni-augsburg.de/opus4/frontdoor/index/index/docId/111720 UR - https://nbn-resolving.org/urn:nbn:de:bvb:384-opus4-1117201 UR - https://nbn-resolving.org/urn:nbn:de:0074-2836-1 SP - 1 EP - 15 PB - CEUR-WS CY - Aachen ER -