In this workshop lab, we would like to bring together information retrieval researchers interested in the online evaluation of academic search systems. The goal is to foster knowledge on improving the search for academic resources like literature - ranging from short bibliographic records to full-text papers - and research data, as well as the interlinking between these resources. The employed online evaluation approach in this workshop allows the direct connection to existing academic search systems from the Life Sciences and the Social Sciences.

The motivation behind this lab is to

• bring together interested researchers
• advertise the online evaluation campaign idea, and
• develop ideas, best practices, and guidelines for a full online evaluation campaign at CLEF 2021.

The LiLAS Workshop takes place online as part of the 11th Conference and Labs of the Evaluation Forum - CLEF 2020. The motto of the conference is "Information Access Evaluation meets Multilinguality, Multimodality, and Visualization". Since 2010, the CLEF events have made an important contribution to the systematic evaluation of information systems, especially by experimentally working on common tasks. Different aspects of information retrieval systems are tested in various labs and workshops.

Information summary:

• What: Workshop „Living Labs for Academic Search – LiLAS“ 
• When: September 22 to 24, 2020
• Where: as an online workshop in conjunction with the Conference and Labs of the Evaluation Forum – CLEF 2020
• Organisation: ZB MED – Information Centre for Life Sciences, GESIS – Leibniz Institute for the Social Sciences and TH Köln 
• Registration: until April 26, 2020

Learn more:
about Workshop LiLAS
about CLEF 2020
about important dates
to Call for contributions
to Registration