HAHA - Humor Analysis based on Human Annotation at IberLEF 2021

Event Notification Type: 
Call for Participation
Abbreviated Title: 
Location: 
in conjunction with IberLEF 2021
State: 
Country: 
Contact Email: 
City: 
Contact: 
Submission Deadline: 
Monday, 14 June 2021

(apologies for cross-posting)

*** Call for Participation for HAHA at IberLEF 2021 ***

HAHA - Humor Analysis based on Human Annotation at IberLEF 2021

Announcement: Yesterday we released the baselines for the four subtasks. You can now send your submissions for the development phase.

https://competitions.codalab.org/competitions/30090

While humor has been historically studied from a psychological, cognitive, and linguistic standpoint, its study from a computational perspective is an area yet to be explored in Machine Learning and Computational Linguistics. The aim of this task is to gain better insight into what is humorous and what causes laughter, and we propose to go further in the direction of analyzing humor structure and the target, or butt, of the joke. The HAHA task has four subtasks related to automatic humor detection and analysis in Spanish.

We provide a corpus of crowd-annotated tweets in Spanish for training, development, and test. The annotation follows a voting scheme in which users could select one of six options: the tweet is not humorous, or the tweet is humorous and a score is given between one (not funny) to five (excellent). A portion of 20% of the data is further annotated for humor mechanism and target.

These are the four subtasks organized this year:
* Humor Detection: determining if a tweet is a joke or not (intended humor by the author or not).
* Humor Rating: predicting a Funniness Score value for a tweet in a 5-star ranking, assuming it is a joke.
* Humor Mechanism Classification: for a humorous tweet, predict the mechanism by which the tweet conveys humor from a set of classes such as irony, wordplay, or exaggeration.
* Humor Target Classification: for a humorous tweet, predict the target of the joke (what it is making fun of) from a set of classes including things such as racist jokes, misogynistic jokes, etc. This task might be related to other tasks such as detection of offensiveness or hate speech.

How to participate:
If you want to participate in this task, please join our Codalab competition:

https://competitions.codalab.org/competitions/30090

Important Dates:
* March 18th, 2021: CodaLab page.
* April 8th, 2021: training and development sets.
* May 27th, 2021: test set and open for submissions.
* June 3rd, 2021: publication of results.
* June 14th, 2021: paper submission.
* June 24th, 2021: notification of acceptance.
* July 1st, 2021: camera-ready paper submission.
* September, 2021: IberLEF 2021 Workshop.