Banner Banner

Overview of the 9th Social Media Mining for Health Applications (#SMM4H) Shared Tasks at ACL 2024– Large Language Models and Generalizability for Social Media NLP

Dongfang Xu
Guillermo Lopez-Garcia
Lisa Raithel
Roland Roller
Philippe Thomas
Eiji Aramaki
Shoko Wakamiya
Shuntaro Yada
Pierre Zweigenbaum
Karen O’Connor
Sophia Hernandez
Sai Tharuni Samineni
Yao Ge
Swati Rajwal
Sudeshna Das
Abeed Sarker
Ari Klein
Ana Lucia Schmidt
Vishakha Sharma
Raul Rodriguez-Esteban
Juan M. Banda
Ivan Flores Amaro
Davy Weissenbacher
Graciela Gonzalez-Hernandez

August 15, 2024

For the past nine years, the Social Media Mining for Health Applications (#SMM4H) shared tasks have promoted community-driven development and evaluation of advanced natural language processing systems to detect, extract, and normalize health-related information in publicly available user-generated content. This year, #SMM4H included seven shared tasks in English, Japanese, German, French, and Spanish from Twitter, Reddit, and health forums. A total of 84 teams from 22 countries registered for #SMM4H, and 45 teams participated in at least one task. This represents a growth of 180% and 160% in registration and participation, respectively, compared to the last iteration. This paper provides an overview of the tasks and participating systems. The data sets remain available upon request, and new systems can be evaluated through the post-evaluation phase on CodaLab.


BIFOLD AUTHORS