IBEREVAL OMMining Opinions from the new textual genres

  1. Balahur Dobrescu, Alexandra
  2. Boldrini, Ester
  3. Montoyo Guijarro, Andrés
  4. Martínez Barco, Patricio
Journal:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Year of publication: 2010

Issue: 45

Pages: 267-272

Type: Article

DIALNET GOOGLE SCHOLAR lock_openRUA editor

More publications in: Procesamiento del lenguaje natural

Abstract

The increasing amount of subjective data on the Web is creating the need to develop effective Question Answering systems able to discriminate such information from factual data, and subsequently process it with specific methods. The participants in the IBEREVAL OM tasks will be given a set of opinion questions (in Spanish and English). Optionally, they will also be able to receive the same set of opinion questions, in which the source, target and expected polarity, as well as the time span the question is referring to are given. They will also be provided with a collection of blog posts, extracted using the Technorati blog search engine (in Spanish and English), in which the answers to the opinion questions should be found The gold standard for this blog posts collection will previously be annotated using the EmotiBlog scheme, by a number of 3 annotators. The EmotiBlog corpus and the set of questions presented in (Balahur et al., 2009) – in their present state will be provided for system training. The participants will be able to participate in two subtasks : 1) in the first one, they will be asked to provide the list of answers to each of the questions (in the same language as the questions, or in the other language); 2) in the second one, they will be asked to provide a summary of the question answers – the top x% of the most important answers, in a non-redundant manner. The Gold Standard for the summaries will be automatically extracted from the manual annotations, taking into account the “intensity” parameter of the opinions expressed.

Bibliographic References

  • Balahur, A. and Montoyo, A. 2008. An incremental multilingual approach to forming a culture dependent emotion triggers lexical database. In Proceedings of the Conference of Terminology and Knowledge Engineering (TKE 2008).
  • Balahur, A, Steinberg, R., Rethinking Sentiment Analysis in the News:from Theory to Practice and back. In Proceedings of WOMSA 2008, Seville, Spain.
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2009. Opinion and Generic Question Answering systems: a performance analysis. In Proceedings of ACL, 2009, Singapore.
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2009. Opinion Question Answering: Towards a Unified Approach. To appear in proceedings of the ECAI conference.a
  • Balahur, A., Boldrini, E., Montoyo, A., Martínez- Barco, P. 2010. A Unified Proposal for Factoid and Opinionated Question Answering. To appear in proceedings of the COLING conference.b
  • Balahur A., Steinberger, R., Kabadjov, M., Zavarella, V., van der Goot, E., Halkia, M., Pouliquen, B., Belyaeva, J. 2010. Sentiment Analysis in the News. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC'2010) Valletta, Malta.
  • Boldrini, E., Balahur, A. Martínez-Barco, P. and Montoyo A. 2009. EmotiBlog: An Annotation Scheme for EmotionDetection and Analysis in Non-Traditional Textual Genres. In Proceedings of the 5th Conference on Data Mining. Las Vegas, Nevada, USA.
  • Cardie. C. Wiebe. J. Wilson. T. Litman. D. 2003. Combining Low-Level and Summary Representations of Opinions for Multi- Perspective Question Answering. AAAI Spring Symposium on New Directions in Question Answering.
  • Kim, S.-M. and E.H. Hovy. 2005. Identifying Opinion Holders for Question Answering in Opinion Texts. Proceedings of the Workshop on Question Answering in Restricted Domain at the Conference of the American Association of Artificial Intelligence (AAAI-05). Pittsburgh, PA.
  • Pang, B. and Lee, L. (2008). Opinion mining and sentiment analysis.
  • Shen. D. Leidner. J. Merkel. A. Klakow. D. 2007. The Alyssa system at TREC QA 2007: Do we need Blog06? In Proceedings of The Sixteenth Text Retrieval Conference (TREC 2007), Gaithersburg, MD, USA.
  • Wiebe, J., Wilson, T., and C. Cardie. 2005. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, vol. 39, issue 2-3, pp. 165-210.
  • Yu. H. Hatzivassiloglou. V. 2003. Towards Answering Opinion Questions: Separating Facts from Opinions. In Proceedings of EMNLP-03. Wenjie, L., Ouyang, Y., Hu, Y., Wei, F. PolyU at TAC 2008. In Proceedings of Human LanguageTechnologiesConference/Conference on Empirical methods in Natural Language Processing (HLT/EMNLP), Vancouver, BC, Canada.
  • Li, F., Zheng, Z.,Yang T., Bu, F., Ge, R., Zhu, X., Zhang, X., and Huang, M. THU QUANTA at TAC 2008. QA and RTE track. In Proceedings of Human Language Technologies Conference/Conference on Empirical methods in Natural Language Processing (HLT/EMNLP), Vancouver, BC, Canada.
Data source: Dialnet