AraFinNLP 2024: The First Arabic Financial NLP Shared Task

Sanad Malaysha; Mo El-Haj; Saad Ezzini; Mohammed Khalilia; Mustafa Jarrar; Sultan Almujaiwel; Ismail Berrada; Houda Bouamor

AraFinNLP 2024: The First Arabic Financial NLP Shared Task

Sanad Malaysha
, Mo El-Haj
, Saad Ezzini
, Mohammed Khalilia
, Mustafa Jarrar
, Sultan Almujaiwel
, Ismail Berrada
, Houda Bouamor

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

17 Scopus citations

Abstract

The expanding financial markets of the Arab world require sophisticated Arabic NLP tools. To address this need within the banking domain, the Arabic Financial NLP (AraFinNLP) shared task proposes two subtasks: (i) Multi-dialect Intent Detection and (ii) Cross-dialect Translation and Intent Preservation. This shared task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in MSA and four dialects. Each query is labeled with one or more of a common 77 intents in the banking domain. These resources aim to foster the development of robust financial Arabic NLP, particularly in the areas of machine translation and banking chat-bots. A total of 45 unique teams registered for this shared task, with 11 of them actively participated in the test phase. Specifically, 11 teams participated in Subtask 1, while only 1 team participated in Subtask 2. The winning team of Subtask 1 achieved F₁ score of 0.8773, and the only team submitted in Subtask 2 achieved a 1.667 BLEU score.

Original language	English
Title of host publication	ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference
Editors	Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Publisher	Association for Computational Linguistics (ACL)
Pages	393-402
Number of pages	10
ISBN (Electronic)	9798891761322
State	Published - 2024
Externally published	Yes
Event	2nd Arabic Natural Language Processing Conference, ArabicNLP 2024 - Bangkok, Thailand Duration: 16 Aug 2024 → …

Publication series

Name	ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference

Conference

Conference	2nd Arabic Natural Language Processing Conference, ArabicNLP 2024
Country/Territory	Thailand
City	Bangkok
Period	16/08/24 → …

Bibliographical note

Publisher Copyright:
©2024 Association for Computational Linguistics.

ASJC Scopus subject areas

Language and Linguistics
Computational Theory and Mathematics
Software
Linguistics and Language

Cite this

Malaysha, S., El-Haj, M., Ezzini, S., Khalilia, M., Jarrar, M., Almujaiwel, S., Berrada, I., & Bouamor, H. (2024). AraFinNLP 2024: The First Arabic Financial NLP Shared Task. In N. Habash, H. Bouamor, R. Eskander, N. Tomeh, I. A. Farha, A. Abdelali, S. Touileb, I. Hamed, Y. Onaizan, B. Alhafni, W. Antoun, S. Khalifa, H. Haddad, I. Zitouni, B. AlKhamissi, R. Almatham, & K. Mrini (Eds.), ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference (pp. 393-402). (ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference). Association for Computational Linguistics (ACL).

Malaysha, Sanad ; El-Haj, Mo ; Ezzini, Saad et al. / AraFinNLP 2024 : The First Arabic Financial NLP Shared Task. ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference. editor / Nizar Habash ; Houda Bouamor ; Ramy Eskander ; Nadi Tomeh ; Ibrahim Abu Farha ; Ahmed Abdelali ; Samia Touileb ; Injy Hamed ; Yaser Onaizan ; Bashar Alhafni ; Wissam Antoun ; Salam Khalifa ; Hatem Haddad ; Imed Zitouni ; Badr AlKhamissi ; Rawan Almatham ; Khalil Mrini. Association for Computational Linguistics (ACL), 2024. pp. 393-402 (ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference).

@inproceedings{d740ce61b31b4d60afa4d89cbf96214b,

title = "AraFinNLP 2024: The First Arabic Financial NLP Shared Task",

abstract = "The expanding financial markets of the Arab world require sophisticated Arabic NLP tools. To address this need within the banking domain, the Arabic Financial NLP (AraFinNLP) shared task proposes two subtasks: (i) Multi-dialect Intent Detection and (ii) Cross-dialect Translation and Intent Preservation. This shared task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in MSA and four dialects. Each query is labeled with one or more of a common 77 intents in the banking domain. These resources aim to foster the development of robust financial Arabic NLP, particularly in the areas of machine translation and banking chat-bots. A total of 45 unique teams registered for this shared task, with 11 of them actively participated in the test phase. Specifically, 11 teams participated in Subtask 1, while only 1 team participated in Subtask 2. The winning team of Subtask 1 achieved F1 score of 0.8773, and the only team submitted in Subtask 2 achieved a 1.667 BLEU score.",

author = "Sanad Malaysha and Mo El-Haj and Saad Ezzini and Mohammed Khalilia and Mustafa Jarrar and Sultan Almujaiwel and Ismail Berrada and Houda Bouamor",

note = "Publisher Copyright: {\textcopyright}2024 Association for Computational Linguistics.; 2nd Arabic Natural Language Processing Conference, ArabicNLP 2024 ; Conference date: 16-08-2024",

year = "2024",

language = "English",

series = "ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference",

publisher = "Association for Computational Linguistics (ACL)",

pages = "393--402",

editor = "Nizar Habash and Houda Bouamor and Ramy Eskander and Nadi Tomeh and Farha, \{Ibrahim Abu\} and Ahmed Abdelali and Samia Touileb and Injy Hamed and Yaser Onaizan and Bashar Alhafni and Wissam Antoun and Salam Khalifa and Hatem Haddad and Imed Zitouni and Badr AlKhamissi and Rawan Almatham and Khalil Mrini",

booktitle = "ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference",

address = "United States",

}

Malaysha, S, El-Haj, M, Ezzini, S, Khalilia, M, Jarrar, M, Almujaiwel, S, Berrada, I & Bouamor, H 2024, AraFinNLP 2024: The First Arabic Financial NLP Shared Task. in N Habash, H Bouamor, R Eskander, N Tomeh, IA Farha, A Abdelali, S Touileb, I Hamed, Y Onaizan, B Alhafni, W Antoun, S Khalifa, H Haddad, I Zitouni, B AlKhamissi, R Almatham & K Mrini (eds), ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference. ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference, Association for Computational Linguistics (ACL), pp. 393-402, 2nd Arabic Natural Language Processing Conference, ArabicNLP 2024, Bangkok, Thailand, 16/08/24.

AraFinNLP 2024: The First Arabic Financial NLP Shared Task. / Malaysha, Sanad; El-Haj, Mo; Ezzini, Saad et al.
ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference. ed. / Nizar Habash; Houda Bouamor; Ramy Eskander; Nadi Tomeh; Ibrahim Abu Farha; Ahmed Abdelali; Samia Touileb; Injy Hamed; Yaser Onaizan; Bashar Alhafni; Wissam Antoun; Salam Khalifa; Hatem Haddad; Imed Zitouni; Badr AlKhamissi; Rawan Almatham; Khalil Mrini. Association for Computational Linguistics (ACL), 2024. p. 393-402 (ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - AraFinNLP 2024

T2 - 2nd Arabic Natural Language Processing Conference, ArabicNLP 2024

AU - Malaysha, Sanad

AU - El-Haj, Mo

AU - Ezzini, Saad

AU - Khalilia, Mohammed

AU - Jarrar, Mustafa

AU - Almujaiwel, Sultan

AU - Berrada, Ismail

AU - Bouamor, Houda

PY - 2024

Y1 - 2024

N2 - The expanding financial markets of the Arab world require sophisticated Arabic NLP tools. To address this need within the banking domain, the Arabic Financial NLP (AraFinNLP) shared task proposes two subtasks: (i) Multi-dialect Intent Detection and (ii) Cross-dialect Translation and Intent Preservation. This shared task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in MSA and four dialects. Each query is labeled with one or more of a common 77 intents in the banking domain. These resources aim to foster the development of robust financial Arabic NLP, particularly in the areas of machine translation and banking chat-bots. A total of 45 unique teams registered for this shared task, with 11 of them actively participated in the test phase. Specifically, 11 teams participated in Subtask 1, while only 1 team participated in Subtask 2. The winning team of Subtask 1 achieved F1 score of 0.8773, and the only team submitted in Subtask 2 achieved a 1.667 BLEU score.

AB - The expanding financial markets of the Arab world require sophisticated Arabic NLP tools. To address this need within the banking domain, the Arabic Financial NLP (AraFinNLP) shared task proposes two subtasks: (i) Multi-dialect Intent Detection and (ii) Cross-dialect Translation and Intent Preservation. This shared task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in MSA and four dialects. Each query is labeled with one or more of a common 77 intents in the banking domain. These resources aim to foster the development of robust financial Arabic NLP, particularly in the areas of machine translation and banking chat-bots. A total of 45 unique teams registered for this shared task, with 11 of them actively participated in the test phase. Specifically, 11 teams participated in Subtask 1, while only 1 team participated in Subtask 2. The winning team of Subtask 1 achieved F1 score of 0.8773, and the only team submitted in Subtask 2 achieved a 1.667 BLEU score.

UR - https://www.scopus.com/pages/publications/85200800655

M3 - Conference contribution

AN - SCOPUS:85200800655

T3 - ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference

SP - 393

EP - 402

BT - ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference

A2 - Habash, Nizar

A2 - Bouamor, Houda

A2 - Eskander, Ramy

A2 - Tomeh, Nadi

A2 - Farha, Ibrahim Abu

A2 - Abdelali, Ahmed

A2 - Touileb, Samia

A2 - Hamed, Injy

A2 - Onaizan, Yaser

A2 - Alhafni, Bashar

A2 - Antoun, Wissam

A2 - Khalifa, Salam

A2 - Haddad, Hatem

A2 - Zitouni, Imed

A2 - AlKhamissi, Badr

A2 - Almatham, Rawan

A2 - Mrini, Khalil

PB - Association for Computational Linguistics (ACL)

Y2 - 16 August 2024

ER -

Malaysha S, El-Haj M, Ezzini S, Khalilia M, Jarrar M, Almujaiwel S et al. AraFinNLP 2024: The First Arabic Financial NLP Shared Task. In Habash N, Bouamor H, Eskander R, Tomeh N, Farha IA, Abdelali A, Touileb S, Hamed I, Onaizan Y, Alhafni B, Antoun W, Khalifa S, Haddad H, Zitouni I, AlKhamissi B, Almatham R, Mrini K, editors, ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference. Association for Computational Linguistics (ACL). 2024. p. 393-402. (ArabicNLP 2024 - 2nd Arabic Natural Language Processing Conference, Proceedings of the Conference).

AraFinNLP 2024: The First Arabic Financial NLP Shared Task

Abstract

Publication series

Conference

Bibliographical note

ASJC Scopus subject areas

Fingerprint

Cite this