SimpleText@CLEF-2023 Program

Home	Important dates	Tasks	Tools
Program	Publications	Organisers	Contact	CLEF-2022

---

• CLEF registration
• CLEF program
• CLEF LNCS Proceedings
• CLEF Working Notes

---

Monday 18th September

SimpleText Sessions takes place in ROOM 4 except for the lab overviews.

CONFERENCE Session 1 Natural Language Understanding & Text Generation (ROOM 1)

• 10:10 - 10:30 Simplify Text Generation with Prompt Engineering, Shih-Hung Wu and Hong-Yi Huang (SimpleText Best of Labs in CLEF 2022, Paper).

Lab Overviews (ROOM 1)

• 11:20 - 12:00 Lab overviews: PAN, BioASQ, eRisk, SimpleText, LifeCLEF.

• Ermakova, L., SanJuan, E., Huet, S., Azarbonyad, H., Augereau, O., Kamps, J. (2023). Overview of the CLEF 2023 SimpleText Lab: Automatic Simplification of Scientific Texts. Proceeding of CLEF’23, LNCS, Springer (Paper, Slides).

SimpleText Session 1 (ROOM 4)

• 16:10 - 17:10 Invited talk by Federica Vezzani (University of Padua) “Easy peasy term squeeze”: A terminological perspective on text simplification” (Slides):

Abstract: Terminology is a recent discipline whose objectives are the representation, organization, and sharing of specialized knowledge as well as fostering clear and unambiguous communication among different users. In this talk, we show how the adoption of a two-dimensional terminological approach can favor term difficulty spotting in specialized texts. We first introduce the problem of the evaluation of different degrees of term difficulty. Then, we present international initiatives for text simplification according to plain language and controlled natural languages. Finally, we showcase how a standard management of multilingual terminological data can support the development of automatic systems for text simplification.

Bio: Federica Vezzani is assistant professor at the Department of Linguistic and Literary Studies of the University of Padua. Her main research interests are terminology, specialized translation, technical communication. In particular, she focuses on the management of multilingual terminology, and she developed the FAIR terminology paradigm for the organization of findable, accessible, interoperable, and reusable terminological data. Since 2022 she is an expert member of ISO TC/37 “Language and Terminology”, and participates in different national and international working groups for the development of controlled natural languages for text simplification.

• 17:10 - 17:40 CLEF 2023 SimpleText Task Overviews (Slides):

  • Éric Sanjuan, Stéphane Huet, Jaap Kamps, Liana Ermakova Overview of the CLEF 2023 SimpleText Task 1: Passage Selection for a Simplified Summary (Paper).

  • Liana Ermakova, Hosein Azarbonyad, Sarah Bertin, Olivier Augereau Overview of the CLEF 2023 SimpleText Task 2: Difficult Concept Identification and Explanation (Paper).

  • Liana Ermakova, Sarah Bertin, Helen McCombie, Jaap Kamps Overview of the CLEF 2023 SimpleText Task 3: Simplification of Scientific Texts (Paper).

Tuesday 19th September

SimpleText Session 2 (ROOM 4)

• 09:30 - 11:00 Participant presentations (13+5 minutes).

• Artemis Capari, Hosein Azarbonyad, Georgios Tsatsaronis, Zubair Afzal Elsevier at SimpleText: Passage Retrieval by Fine-tuning GPL on Scientific Documents (Paper).

• Jenny Ortiz-Zambrano, César Espin-Riofrio, Arturo Montejo-Ráez SINAI Participation in SimpleText Task 2 at CLEF 2023: GPT-3 in Lexical Complexity Prediction for General Audience (Paper).

• Roos Hutter, Jop Sutmuller, Mary Adib, David Rau, Jaap Kamps University of Amsterdam at the CLEF 2023 SimpleText Track (Paper, Slides).

• Óscar E. Mendoza, Gabriella Pasi Domain Context-centered Retrieval for the Content Selection task in the Simplification of Scientific Literature (Paper).

• Shih-Hung Wu, Hong-Yi Huang A Prompt Engineering Approach to Scientific Text Simplification: CYUT at SimpleText2023 Task (Paper).

SimpleText Session 3 (ROOM 4)

• 14:00 - 15:00 Participant presentations (10+2 min).

• Björn Engelmann, Fabian Haak, Christin Katharina Kreutz, Narjes Nikzad Khasmakhi, Philipp Schaer Text Simplification of Scientific Texts for Non-Expert Readers (Paper).

• Pascal Severin Andermatt, Tobias Fankhauser UZH_Pandas at SimpleText@CLEF-2023: Alpaca LoRA 7B and LENS Model Selection for Scientific Literature Simplification (Paper).

• Dennis R. Davari, Antonela Prnjak, Kristina Schmitt CLEF2023 SimpleText Task 2, 3: Identification and Simplification of Difficult Terms (Paper).

• Behrooz Mansouri, Shea Durgin, Sj Franklin, Sean Fletcher, Ricardo Campos AIIR and LIAAD Labs Systems for CLEF 2023 SimpleText (Paper).

• Victor Manuel Palma Preciado, Carolina Palma Preciado, Grigori Sidorov NLPalma @ CLEF 2023 SimpleText: BLOOMZ and BERT for Complexity and Simplification Task (Paper).

• 15:00 - 15:30 Round table and SimpleText 2024 discussion:

  • We want to hear from you!
  • What was great about 2023, and what could we improve for you?
  • Any ideas or volunteers are welcome!
  • SimpleText roadmap (Slides Task 1-3, Slides Task 4):
    • Complete the current setup in 2024, new data/tasks/setup in 2025 (e.g. moving to ArXiv?)
    • Focus on relevance and text complexity, credibility, topic profiles in Task 1.
    • Focus on explaining and contextualizing complex concepts in Task 2.
    • Focus on sentence-level and paragraph-level text simplification in Task 3.
    • Add a new filtering/routing Task 4 tracking the state-of-the-art in AI topics in 2024.

Thursday 21th September

Closing and Introduction of CLEF 2024 (Room 1)

• 16:30 - 17:00 Closing and plans for 2024 (including slides on the CLEF 2024 SimpleText track)

All CLEF 2023 SimpleText track papers

Including authors unable to present in-person or online:

• Éric Sanjuan, Stéphane Huet, Jaap Kamps, Liana Ermakova Overview of the CLEF 2023 SimpleText Task 1: Passage Selection for a Simplified Summary (Paper).

• Liana Ermakova, Hosein Azarbonyad, Sarah Bertin, Olivier Augereau Overview of the CLEF 2023 SimpleText Task 2: Difficult Concept Identification and Explanation (Paper).

• Liana Ermakova, Sarah Bertin, Helen McCombie, Jaap Kamps Overview of the CLEF 2023 SimpleText Task 3: Simplification of Scientific Texts (Paper).

• Pascal Severin Andermatt, Tobias Fankhauser UZH_Pandas at SimpleText@CLEF-2023: Alpaca LoRA 7B and LENS Model Selection for Scientific Literature Simplification (Paper).

• Aftab Anjum, Nikolaus Lieberum Automatic Simplification of Scientific Texts using Pre-trained Language Models: A Comparative Study at CLEF Symposium 2023 (Paper).

• Sílvia Araújo, Micaela Aguiar Comparing ChatGPT’s and Human Evaluation of Scientific Texts’ Translations from English to Portuguese Using Popular Automated Translators (Paper).

• Sarah Bertin Scientific Simplification, the Limits of ChatGPT (Paper).

• Artemis Capari, Hosein Azarbonyad, Georgios Tsatsaronis, Zubair Afzal Elsevier at SimpleText: Passage Retrieval by Fine-tuning GPL on Scientific Documents (Paper).

• Petra Dadić, Olga Popova CLEF 2023 SimpletText Tasks 2 and 3: Enhancing Language Comprehension: Addressing Difficult Concepts and Simplifying Scientific Texts Using GPT, BLOOM, KeyBert, Simple T5 and More (Paper).

• Dennis R. Davari, Antonela Prnjak, Kristina Schmitt CLEF2023 SimpleText Task 2, 3: Identification and Simplification of Difficult Terms (Paper).

• Quentin Dubreuil UBO Team @ CLEF SimpleText 2023 Track for Task 2 and 3 - Using IA models to simplify Scientific Texts (Paper).

• Óscar E. Mendoza, Gabriella Pasi Domain Context-centered Retrieval for the Content Selection task in the Simplification of Scientific Literature (Paper).

• Björn Engelmann, Fabian Haak, Christin Katharina Kreutz, Narjes Nikzad Khasmakhi, Philipp Schaer Text Simplification of Scientific Texts for Non-Expert Readers (Paper).

• Running Hou, Xinyi Qin An Evaluation of MUSS and T5 Models in Scientific Sentence Simplification: A Comparative Study (Paper).

• Roos Hutter, Jop Sutmuller, Mary Adib, David Rau, Jaap Kamps University of Amsterdam at the CLEF 2023 SimpleText Track (Paper).

• Behrooz Mansouri, Shea Durgin, Sj Franklin, Sean Fletcher, Ricardo Campos AIIR and LIAAD Labs Systems for CLEF 2023 SimpleText (Paper).

• Felix Ohnesorge, Mari Ángeles Gutiérrez, Julia Plichta CLEF 2023: Scientific Text Simplification and General Audience (Paper).

• Jenny Ortiz-Zambrano, César Espin-Riofrio, Arturo Montejo-Ráez SINAI Participation in SimpleText Task 2 at CLEF 2023: GPT-3 in Lexical Complexity Prediction for General Audience (Paper).

• Victor Manuel Palma Preciado, Carolina Palma Preciado, Grigori Sidorov NLPalma @ CLEF 2023 SimpleText: BLOOMZ and BERT for Complexity and Simplification Task (Paper).

• Darko Vujica, Iva Čatipović, Julia Komorowska CLEF2023 SimpleText (Paper).

• Shih-Hung Wu, Hong-Yi Huang A Prompt Engineering Approach to Scientific Text Simplification: CYUT at SimpleText2023 Task (Paper).