Teaching information retrieval with a shared task across universities: first steps and findings

  • Many universities offer information retrieval (IR) courses with different specializations as part of their computer science or information science programs. Student involvement and collaboration in these courses can increase engagement in the course and improve learning outcomes. We report on our first steps towards creating synergies between information retrieval courses at four German universities by conducting a shared task assignment with a document collection combining the IR and ACL anthologies, which we enrich with relevance judgments. We prepared two versions of this collection. First, a minimal test collection with 100 documents for which students can manually obtain results from intermediate results. Second, a more extensive test collection of 126 958 documents is used in a shared task setup, where students create topics, relevance judgments, and retrieval systems. The shared task setup therefore covers a broad spectrum of applied IR research. Our collaborative teachingMany universities offer information retrieval (IR) courses with different specializations as part of their computer science or information science programs. Student involvement and collaboration in these courses can increase engagement in the course and improve learning outcomes. We report on our first steps towards creating synergies between information retrieval courses at four German universities by conducting a shared task assignment with a document collection combining the IR and ACL anthologies, which we enrich with relevance judgments. We prepared two versions of this collection. First, a minimal test collection with 100 documents for which students can manually obtain results from intermediate results. Second, a more extensive test collection of 126 958 documents is used in a shared task setup, where students create topics, relevance judgments, and retrieval systems. The shared task setup therefore covers a broad spectrum of applied IR research. Our collaborative teaching initiative can help students learn from their peers locally and across universities. The cross-university setup means that institutes and degree programs with different academic backgrounds are involved, which leads to a broad spectrum of perspectives in the construction of topics and also in system development.show moreshow less

Download full text files

Export metadata

Statistics

Number of document requests

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Maik Fröbe, Christopher Akiki, Timo Breuer, Thomas Eckart, Annemarie FriedrichORCiDGND, Lukas Gienapp, Jan Heinrich Merker, Martin Potthast, Harrisen Scells, Philipp Schaer, Benno Stein
URN:urn:nbn:de:bvb:384-opus4-1264874
Frontdoor URLhttps://opus.bibliothek.uni-augsburg.de/opus4/126487
URL:https://www.informatik.uni-wuerzburg.de/fileadmin/1003-lwda24/LWDA_Paper/IR_LWDA_CRC_168.pdf
Parent Title (English):LWDA 2024: Lernen, Wissen, Daten, Analysen, 23–25 September 2024, Würzburg, Germany
Publisher:Julius-Maximilians-Universität Würzburg
Place of publication:Würzburg
Type:Conference Proceeding
Language:English
Date of Publication (online):2025/11/25
Year of first Publication:2024
Publishing Institution:Universität Augsburg
Release Date:2025/11/26
Institutes:Fakultät für Angewandte Informatik
Fakultät für Angewandte Informatik / Institut für Informatik
Fakultät für Angewandte Informatik / Institut für Informatik / Lehrstuhl für Computerlinguistik
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
Licence (German):CC-BY 4.0: Creative Commons: Namensnennung