Earlier this year, we published a post about our paper and tool Checky, the Paper-Submission Checklist-Generator for Authors, Reviewers and LLMs, after its acceptance at ECIR 2025. Now, I’m excited to share my experience presenting the work as a demonstration paper at the conference – where I showcased Checky live, discussed its potential with researchers, and soaked in the vibrant IR community.
The ECIR (European Conference on Information Retrieval) is a premier CORE A-ranked venue for cutting-edge research in search, recommendation, and knowledge management. This year marked the 47th edition, held in the picturesque Tuscan city of Lucca – a fitting backdrop for inspiring discussions, with its Renaissance walls, cobblestone streets, and rolling vineyards just beyond the conference halls. The event brought together academics and industry practitioners for keynotes, workshops, and lively poster sessions. The demonstration track was especially dynamic, as attendees interacted directly with tools like Checky, making it an ideal platform for our hands-on work.
As a demonstration paper, we emphasized Checky’s practical utility. At my poster station, I guided attendees through real-time checklist generation, discussed the role of checklists in improving rigor (e.g., for literature reviews or peer reviews), and fielded questions about broader adoption challenges. The live format sparked lively debates – particularly around using checklists to standardize reviewing processes, a topic that divided researchers between efficiency gains and concerns about over-formalization.
Presenting Checky at ECIR 2025 was particularly rewarding as it represented the culmination of a truly collaborative effort. This work brought together six authors across four institutions (University of Siegen, University of Göttingen, University of Klagenfurt, and University of Gothenburg). The conference allowed me to showcase not just a helpful tool but what can be achieved through interdisciplinary cooperation in our field.
Try Checky yourself: Explore the tool here
Read the paper: Link to ECIR proceedings
Many thanks to Prof. Jöran Beel for orchestrating the Checky project, Moritz Baumgart for implementing and maintaining Checky, and my co-authors, Prof. Bela Gipp, Prof. Dietmar Jannach, Prof. Alan Said, and Tobias Vente. Also, my sincere thanks to the ECIR organizers for the excellent demonstration track and to all attendees who stopped by to discuss Checky and checklists in general.
0 Comments