SemEval Task #14
Task Description | Datasets and Evaluation | Timeline | Resources | Systems and Results | Bibliography
This task is intended as an exploration of the connection between lexical semantics and emotions. All words can potentially convey affective meaning. Every word, even those that are apparently neutral, can evoke pleasant or painful experiences due to their semantic relation with emotional concepts or categories. While some words have emotional meaning with respect to an individual story, for many others the affective power is part of the collective imagination (e.g. words such as "mum", "ghost", "war").
This latter group of words are particularly interesting, because their affective meaning is part of common sense knowledge and can be detected in the linguistic usage. For this reason, we believe it is important to study the use of words in textual productions, and possibly their co-occurrence with words in which the affective meaning is explicit. Several previous studies in linguistics and psychology have considered research issues related to the affective lexicon. For example Ortony et al. [Ortony et al., 1987] distinguishes between words directly referring to emotional states (e.g. "fear", "cheerful") and those having only an indirect reference that depends on the context (e.g. words that indicate possible emotional causes such as "killer" or emotional responses such as "cry").
Datasets and Evaluation
Download the development and test data.
The structure of the task is as follows:
The emotion annotation and the valence labeling will be regarded as two separate subtasks, and therefore a team can choose to participate in only one or both annotation tasks.
The task organizers will provide in advance the set of emotion labels and a development corpus. The timeline of the task will follow the general Semeval-2007 timeframe as follows:
Participants are free to use any resources they wish. We provide here a set words extracted from WordNet Affect, relevant to the six emotions of interest. Note however that the use of this list of words is entirely optional.
Systems and Results
Systems and results are now described in the Semeval proceedings.
For more information, visit the SemEval-2007 home page.