Details
| Original language | English |
|---|---|
| Title of host publication | ICMR ´23 |
| Subtitle of host publication | Proceedings of the 2023 ACM International Conference on Multimedia Retrieval |
| Pages | 581-585 |
| Number of pages | 5 |
| ISBN (electronic) | 9798400701788 |
| Publication status | Published - 12 Jun 2023 |
| Event | 2023 ACM International Conference on Multimedia Retrieval, ICMR 2023 - Thessaloniki, Greece Duration: 12 Jun 2023 → 15 Jun 2023 |
Abstract
The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller size or with a limited set of specific topics. As a consequence, these models lack generalization capabilities and are not applicable to real-world data. In this paper, we propose three models that adopt and fine-tune state-of-the-art multimodal transformers for multimodal fake news detection. We conduct an in-depth analysis by manipulating the input data aimed to explore models performance in realistic use cases on social media. Our study across multiple models demonstrates that these systems suffer significant performance drops against manipulated data. To reduce the bias and improve model generalization, we suggest training data augmentation to conduct more meaningful experiments for fake news detection on social media. The proposed data augmentation techniques enable models to generalize better and yield improved state-of-the-art results.
Keywords
- Multimodal fake news detection, news analytics, social media
ASJC Scopus subject areas
- Computer Science(all)
- Human-Computer Interaction
- Computer Science(all)
- Software
- Computer Science(all)
- Computer Graphics and Computer-Aided Design
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
ICMR ´23 : Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. 2023. p. 581-585.
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Improving Generalization for Multimodal Fake News Detection
AU - Tahmasebi, Sahar
AU - Hakimov, Sherzod
AU - Ewerth, Ralph
AU - Müller-Budack, Eric
N1 - Funding Information: This work was funded by European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement no. 812997 (CLEOPATRA ITN), and by the German Federal Ministry of Education and Research (BMBF, FakeNarratives project, no. 16KIS1517).
PY - 2023/6/12
Y1 - 2023/6/12
N2 - The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller size or with a limited set of specific topics. As a consequence, these models lack generalization capabilities and are not applicable to real-world data. In this paper, we propose three models that adopt and fine-tune state-of-the-art multimodal transformers for multimodal fake news detection. We conduct an in-depth analysis by manipulating the input data aimed to explore models performance in realistic use cases on social media. Our study across multiple models demonstrates that these systems suffer significant performance drops against manipulated data. To reduce the bias and improve model generalization, we suggest training data augmentation to conduct more meaningful experiments for fake news detection on social media. The proposed data augmentation techniques enable models to generalize better and yield improved state-of-the-art results.
AB - The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller size or with a limited set of specific topics. As a consequence, these models lack generalization capabilities and are not applicable to real-world data. In this paper, we propose three models that adopt and fine-tune state-of-the-art multimodal transformers for multimodal fake news detection. We conduct an in-depth analysis by manipulating the input data aimed to explore models performance in realistic use cases on social media. Our study across multiple models demonstrates that these systems suffer significant performance drops against manipulated data. To reduce the bias and improve model generalization, we suggest training data augmentation to conduct more meaningful experiments for fake news detection on social media. The proposed data augmentation techniques enable models to generalize better and yield improved state-of-the-art results.
KW - Multimodal fake news detection
KW - news analytics
KW - social media
UR - http://www.scopus.com/inward/record.url?scp=85163636675&partnerID=8YFLogxK
U2 - 10.48550/arXiv.2305.18599
DO - 10.48550/arXiv.2305.18599
M3 - Conference contribution
AN - SCOPUS:85163636675
SP - 581
EP - 585
BT - ICMR ´23
T2 - 2023 ACM International Conference on Multimedia Retrieval, ICMR 2023
Y2 - 12 June 2023 through 15 June 2023
ER -