Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadata correction for 2023.arabicnlp-1.31 #4476

Closed
AMR-KELEG opened this issue Jan 23, 2025 · 1 comment · Fixed by #4541
Closed

Metadata correction for 2023.arabicnlp-1.31 #4476

AMR-KELEG opened this issue Jan 23, 2025 · 1 comment · Fixed by #4541
Assignees
Labels
approved Used to note team approval of metadata requests correction for corrections submitted to the anthology metadata Correction to metadata

Comments

@AMR-KELEG
Copy link

JSON data block

{
  "anthology_id": "2023.arabicnlp-1.31",
  "abstract": "Automatic Arabic Dialect Identification (ADI) of text has gained great popularity since it was introduced in the early 2010s. Multiple datasets were developed, and yearly shared tasks have been running since 2018. However, ADI systems are reported to fail in distinguishing between the micro-dialects of Arabic. We argue that the currently adopted framing of the ADI task as a single-label classification problem is one of the main reasons for that. We highlight the limitation of the incompleteness of the Dialect labels and demonstrate how it impacts the evaluation of ADI systems. A manual error analysis for the predictions of an ADI, performed by 7 native speakers of different Arabic dialects, revealed that <tex-math>\\approx</tex-math> 66% of the validated errors are not true errors. Consequently, we propose framing ADI as a multi-label classification task and give recommendations for designing new ADI datasets."
}
@AMR-KELEG AMR-KELEG added correction for corrections submitted to the anthology metadata Correction to metadata labels Jan 23, 2025
Copy link

Found ACL Anthology entry: https://aclanthology.org/2023.arabicnlp-1.31

Thumbnail

@nschneid nschneid added the approved Used to note team approval of metadata requests label Jan 24, 2025
@mjpost mjpost closed this as completed in c2fcfd6 Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Used to note team approval of metadata requests correction for corrections submitted to the anthology metadata Correction to metadata
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants