View on GitHub

CLEF 2024 SimpleText

SimpleText is a track organised as a part of CLEF 2024 conference, initiated by CLEF initiative.

SimpleText@CLEF-2024 Program

Home	Call for papers	Important dates	Tasks	Tools
Program	Publications	Organizers	Contact	CLEF-2023

SimpleText Track sessions takes place in Room 2 (IMAG Auditorium) except for the plenary CLEF conference sessions in Room 1 (MaCI Amphitheatre).

Zoom link for track sessions: Virtual CLEF Room 2.
If you registered for CLEF (online), the conference will provide the links for plenary sessions.

Monday 9th September

Conference Session 1 NLU and Document Analysis (Room 1)

10:00 - 10:20 Andrianos Michail, Pascal Severin Andermatt and Tobias Fankhauser, Scientific Text Simplification Using Multi-Prompt Minimum Bayes Risk Decoding (SimpleText Best of Labs in CLEF 2023), in: Proceedings of CLEF’24, LNCS Volume 14958 + 14959, Springer, 2024 (Paper, Slides).

Lab Overviews 1 (Room 1)

11:10 - 12:40 Lab Overviews [Room 1]: LifeCLEF, Touché, eRisk, BioASQ, SimpleText
L. Ermakova, E. SanJuan, S. Huet, H. Azarbonyad, G. M. Di Nunzio, F. Vezzani, J. D’Souza, J. Kamps, Overview of the CLEF 2024 SimpleText track: Improving access to scientific texts for everyone, in: Proceedings of CLEF’24, LNCS Volume 14958 + 14959, Springer, 2024 (Paper, Slides).

SimpleText Session 1 (Room 2)

14:00 - 15:30 CLEF 2024 SimpleText Task Overviews:
Eric Sanjuan, Stéphane Huet, Jaap Kamps, Liana Ermakova Overview of the CLEF 2024 SimpleText Task 1: Retrieve Passages to Include in a Simplified Summary, 3115-3128 (Paper, Slides).
Giorgio Maria Di Nunzio, Federica Vezzani, Vanessa Bonato, Hosein Azarbonyad, Jaap Kamps, Liana Ermakova Overview of the CLEF 2024 SimpleText Task 2: Identify and Explain Difficult Concepts, 3129-3146 (Paper, Slides).
Liana Ermakova, Valentin Laimé, Helen McCombie, Jaap Kamps Overview of the CLEF 2024 SimpleText Task 3: Simplify Scientific Text, 3147-3162 (Paper, Slides).
📶 Jennifer D’Souza, Salomon Kabongo, Hamed Babaei Giglou, Yue Zhang Overview of the CLEF 2024 SimpleText Task 4: SOTA? Tracking the State-of-the-Art in Scholarly Publications, 3163-3173 (Paper, Slides).

SimpleText Session 2 (Room 2)

16:30 - 18:00 CLEF 2024 Participant presentations (10+5 minutes).
Jan Bakker, Göksenin Yüksel, Jaap Kamps University of Amsterdam at the CLEF 2024 SimpleText Track, 3182-3194 (Paper, Slides).
Artemis Capari, Hosein Azarbonyad, Zubair Afzal, Georgios Tsatsaronis Enhancing Scientific Document Simplification through Adaptive Retrieval and Generative Models, 3206-3229 (Paper, Slides).
Giorgio Maria Di Nunzio, Elena Gallina, Federica Vezzani UNIPD@SimpleText2024: A Semi-Manual Approach on Prompting ChatGPT for Extracting Terms and Write Terminological Definitions, 3230-3237 (Paper).
Benjamin Vendeville, Liana Ermakova, Pierre De Loor UBO NLP Report on the SimpleText track at CLEF 2024, 3317-3340 (Paper, Slides).
📶 Salomon Kabongo, Jennifer D’Souza, Sören Auer Exploring the Latest LLMs for Leaderboard Extraction, 3246-3260 (Paper).
Andrianos Michail, Pascal Severin Andermatt, Tobias Fankhauser UZH Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts, 3284-3287 (Paper, Slides).

Tuesday 10th September

SimpleText Session 3 (Room 2)

11:10 - 12:00 📶 Invited talk by Brian Ondov (NIH/Yale) “The Plain Language Adaptation of Biomedical Abstracts (PLABA) Track at TREC 2024” (Slides):

Abstract: The goal of the new TREC 2024 PLABA track is to improve health literacy by adapting biomedical abstracts for the general public using plain language. The track is coordinated by Brian Ondov (Yale), Dina Demner-Fushman (NIH), and Hoa Dang (NIST). Details of the track are on the Track Web Page.

12:00-12:40 CLEF 2024 Participant presentations (10+5 minutes).
📶 Syed Muhammad Ali, Hammad Sajid, Owais Aijaz, Owais Waheed, Faisal Alvi, Abdul Samad Team Sharingans at SimpleText: Fine-tuned LLM based approach to Scientific Text Simplification, 3174-3181 (Paper).
📶 Nicholas Largey, Reihaneh Maarefdoust, Shea Durgin, Behrooz Mansouri AIIR Lab Systems for CLEF 2024 SimpleText: Large Language Models for Text Simplification, 3261-3273 (Paper).

SimpleText Session 4 (Room 2)

16:40 - 17:25 CLEF 2024 Participant presentations (10+5 minutes).
Moritz Staudinger, Alaa El-Ebshihy, Annisa Maulida Ningtyas, Florina Piroi, Allan Hanbury AMATU@Simpletext2024: Are LLMs Any Good for Scientific Leaderboard Extraction?, 3300-3316 (Paper, Slides).
📶 Rowan Mann, Tomislav Mikulandric CLEF 2024 SimpleText Tasks 1-3: Use of Llama-2 for Text Simplification, 3274-3283 (Paper, Slides).
📶 Jenny Ortiz-Zambrano, César Espin-Riofrio, Arturo Montejo-Ráez SINAI Participation in SimpleText Task 2 at CLEF 2024: Zero-shot Prompting on GPT-4-Turbo for Lexical Complexity Prediction, 3288-3299 (Paper, Slides).
17:25 - 17:40 (Time for additional talks, depending on demand, from JOKER and SimpleText tracks.)
17:40 - 18:10 SimpleText (and JOKER) 2025 planning session:
- We want to hear from you!
- What was great about 2024, and what could we improve for you?
- Any ideas or volunteers are welcome!
- SimpleText roadmap (Slides):
  - New data/tasks/setup in 2025?
    - New corpus of document/paragraph/sentence aligned Cochrane abstracts and plain English summaries (Slides).
    - Interest in source attribution? Spotting potential “hallicination” for generative output. Joined task with other tracks?
    - Active interest to revisit a particular 2024 task?
  - ???

Wednesday 11th September

Conference Session 3 (Room 1): Datasets

10:00-10:20 Artemis Capari, Hosein Azarbonyad, Georgios Tsatsaronis, Jaap Kamps, Zubair Afzal and Judson Dunham, KAPR: A dataset for Evaluation of Ranking Models for a Knowledge Acquisition Passage Retrieval Task (Conference paper related to SimpleText Task 1), in: Proceedings of CLEF’24, LNCS Volume 14958 + 14959, Springer, 2024 (Paper, Slides). CLEF 2024 Best Long Paper Award.

Thursday 12th September

Conference Session 4 (Room 1): In-Context Evaluation and Retrieval

10:00-10:20 Annisa Maulida Ningtyas, Alaa El-Ebshihy, Florina Piroi and Allan Hanbury, Improving Laypeople Familiarity with Medical Terms by Informal Medical Entity Linking (Conference paper related to SimpleText Task 2), in: Proceedings of CLEF’24, LNCS Volume 14958 + 14959, Springer, 2024 (Paper).

Closing and Introduction of CLEF 2025 (Room 1)

17:00 - 18:00 Closing and plans for 2025 (including slides on the CLEF 2025 SimpleText track)

All CLEF 2024 SimpleText track papers

Including authors unable to present in-person or online:

SimpleText Lab: Improving Access to Scientific Texts for Everyone

Eric Sanjuan, Stéphane Huet, Jaap Kamps, Liana Ermakova Overview of the CLEF 2024 SimpleText Task 1: Retrieve Passages to Include in a Simplified Summary, 3115-3128 (Paper).
Giorgio Maria Di Nunzio, Federica Vezzani, Vanessa Bonato, Hosein Azarbonyad, Jaap Kamps, Liana Ermakova Overview of the CLEF 2024 SimpleText Task 2: Identify and Explain Difficult Concepts, 3129-3146 (Paper).
Liana Ermakova, Valentin Laimé, Helen McCombie, Jaap Kamps Overview of the CLEF 2024 SimpleText Task 3: Simplify Scientific Text, 3147-3162 (Paper).
Jennifer D’Souza, Salomon Kabongo, Hamed Babaei Giglou, Yue Zhang Overview of the CLEF 2024 SimpleText Task 4: SOTA? Tracking the State-of-the-Art in Scholarly Publications, 3163-3173 (Paper).
Syed Muhammad Ali, Hammad Sajid, Owais Aijaz, Owais Waheed, Faisal Alvi, Abdul Samad Team Sharingans at SimpleText: Fine-tuned LLM based approach to Scientific Text Simplification, 3174-3181 (Paper).
Jan Bakker, Göksenin Yüksel, Jaap Kamps University of Amsterdam at the CLEF 2024 SimpleText Track, 3182-3194 (Paper).
Antonia Bartulović, Dóra Paula Váradi University of Split and University of Malta (Team AB&DPV) at the CLEF 2024 SimpleText Track: Scientific Text Made Simpler Through the Use of Artificial Intelligence, 3195-3205 (Paper).
Artemis Capari, Hosein Azarbonyad, Zubair Afzal, Georgios Tsatsaronis Enhancing Scientific Document Simplification through Adaptive Retrieval and Generative Models, 3206-3229 (Paper).
Giorgio Maria Di Nunzio, Elena Gallina, Federica Vezzani UNIPD@SimpleText2024: A Semi-Manual Approach on Prompting ChatGPT for Extracting Terms and Write Terminological Definitions, 3230-3237 (Paper).
Regina Elagina, Petra Vučić AI Contributions to Simplifying Scientific Discourse in SimpleText 2024, 3238-3245 (Paper).
Salomon Kabongo, Jennifer D’Souza, Sören Auer Exploring the Latest LLMs for Leaderboard Extraction, 3246-3260 (Paper).
Nicholas Largey, Reihaneh Maarefdoust, Shea Durgin, Behrooz Mansouri AIIR Lab Systems for CLEF 2024 SimpleText: Large Language Models for Text Simplification, 3261-3273 (Paper).
Rowan Mann, Tomislav Mikulandric CLEF 2024 SimpleText Tasks 1-3: Use of Llama-2 for Text Simplification, 3274-3283 (Paper).
Andrianos Michail, Pascal Severin Andermatt, Tobias Fankhauser UZH Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts, 3284-3287 (Paper).
Jenny Ortiz-Zambrano, César Espin-Riofrio, Arturo Montejo-Ráez SINAI Participation in SimpleText Task 2 at CLEF 2024: Zero-shot Prompting on GPT-4-Turbo for Lexical Complexity Prediction, 3288-3299 (Paper).
Moritz Staudinger, Alaa El-Ebshihy, Annisa Maulida Ningtyas, Florina Piroi, Allan Hanbury AMATU@Simpletext2024: Are LLMs Any Good for Scientific Leaderboard Extraction?, 3300-3316 (Paper).
Benjamin Vendeville, Liana Ermakova, Pierre De Loor UBO NLP Report on the SimpleText track at CLEF 2024, 3317-3340 (Paper).