Abstract
With the fast pace of reporting around the globe from various sources, event extraction has increasingly become an important task in NLP. The use of pre-trained language models (PTMs) has become popular to provide contextual representation for downstream tasks. This work aims to pre-train language models that enhance event extraction accuracy. To this end, we propose an Event-Based Knowledge (EBK) masking approach to mask the most significant terms in the event detection task. These significant terms are based on an external knowledge source that is curated for the purpose of event detection for the Arabic language. The proposed approach improves the classification accuracy of all the 9 event types. The experimental results demonstrate the effectiveness of the proposed masking approach and encourage further exploration.
| Original language | English |
|---|---|
| Title of host publication | WANLP 2022 - 7th Arabic Natural Language Processing - Proceedings of the Workshop |
| Publisher | Association for Computational Linguistics (ACL) |
| Pages | 273-286 |
| Number of pages | 14 |
| ISBN (Electronic) | 9781959429272 |
| State | Published - 2022 |
| Event | 7th Arabic Natural Language Processing Workshop, WANLP 2022 held with EMNLP 2022 - Abu Dhabi, United Arab Emirates Duration: 8 Dec 2022 → … |
Publication series
| Name | WANLP 2022 - 7th Arabic Natural Language Processing - Proceedings of the Workshop |
|---|
Conference
| Conference | 7th Arabic Natural Language Processing Workshop, WANLP 2022 held with EMNLP 2022 |
|---|---|
| Country/Territory | United Arab Emirates |
| City | Abu Dhabi |
| Period | 8/12/22 → … |
Bibliographical note
Publisher Copyright:© 2022 Association for Computational Linguistics.
ASJC Scopus subject areas
- Language and Linguistics
- Computational Theory and Mathematics
- Software
- Linguistics and Language