Skip to main content
×
×
Home

Retrieving implicit positive meaning from negated statements

  • EDUARDO BLANCO (a1) and DAN MOLDOVAN (a1)
Abstract

This paper introduces a model for capturing the meaning of negated statements by identifying the negated concepts and revealing the implicit positive meanings. A negated sentence may be represented logically in different ways depending on what is the scope and focus of negation. The novel approach introduced here identifies the focus of negation and thus eliminates erroneous interpretations. Furthermore, negation is incorporated into a framework for composing semantic relations, proposed previously, yielding a richer semantic representation of text, including hidden inferences. Annotations of negation focus were performed over PropBank, and learning features were identified. The experimental results show that the models introduced here obtain a weighted f-measure of 0.641 for predicting the focus of negation and 78 percent accuracy for incorporating negation into composition of semantic relations.

Copyright
References
Hide All
Baker, Collin F., Fillmore, Charles J., and Lowe, John B. 1998. The Berkeley framenet project. In Proceedings of the 17th International Conference on Computational Linguistics, Montreal, Canada, pp. 86–90.
Blanco, E., and Moldovan, D. 2011a. A model for composing semantic relations. In Proceedings of the 9th International Conference on Computational Semantics (IWCS 2011), Oxford, UK, pp. 45–54.
Blanco, E., and Moldovan, D. 2011b. Semantic representation of negation using focus detection. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT 2011), Portland, OR, pp. 581–589.
Blanco, E., and Moldovan, D. 2011c. Unsupervised learning of semantic relation composition. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT 2011), Portland, OR, pp. 1456–1465.
Bos, J. 2008. Wide-coverage semantic analysis with boxer. In Bos, J., and Delmonte, R. (eds.), Semantics in Text Processing. STEP 2008 Conference Proceedings, vol. 1. Research in Computational Semantics, pp. 277–86. London: College Publications.
Bos, J., and Spenader, J. 2011. An annotated corpus for the analysis of VP ellipsis. Language Resources and Evaluation 45 (2): 132.
Boucher, J., and Osgood, Charles E. 1969, February. The pollyanna hypothesis. Journal of Verbal Learning and Verbal Behavior, 8 (1): 18.
Carreras, X., and Màrquez, L. 2004, May. Introduction to the CoNLL-2004 shared task: semantic role labeling. In Ng, Hwee T., and Riloff, E. (eds.), HLT-NAACL 2004 Workshop: Eighth Conference on Computational Natural Language Learning (CoNLL-2004), Boston, MA, pp. 8997. Stroudsburg, PA: Association for Computational Linguistics.
Carreras, X., and Màrquez, L. 2005. Introduction to the CoNLL-2005 shared task: semantic role labeling. In Proceedings of the Ninth Conference on Computational Natural Language Learning (CONLL '05), Morristown, NJ, pp. 152–64. Stroudsburg, PA: Association for Computational Linguistics.
Choi, Jinho D., Bonial, C., and Palmer, M. 2010. Propbank instance annotation guidelines using a dedicated editor, Jubilee. In Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC’10), Valletta, Malta, pp. 18711875.
Cohen, Paul R., and Loiselle, Cynthia L. 1988. Beyond ISA: structures for plausible inference in semantic networks. In Proceedings of the Seventh National Conference on Artificial Intelligence, St. Paul, MN, pp. 415420.
Councill, I., McDonald, R., and Velikovich, L. 2010, July. What's great and what's not: learning to classify the scope of negation for improved sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in Natural Language Processing, Uppsala, Sweden, pp. 51–9. Antwerp, Belgium: University of Antwerp.
Dang, Hoa T., and Palmer, M. 2005, June. The role of semantic roles in disambiguating verb senses. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), Ann Arbor, MI, pp. 42–9. Stroudsburg, PA, USA: Association for Computational Linguistics.
Dowty, D. 1994. The role of negative polarity and concord marking in natural language reasoning. In Proceedings of Semantics and Linguistics Theory (SALT) 4, Rochester, NY, pp. 114–44.
Farkas, R., Vincze, V., Móra, G., Csirik, J., and Szarvas, G. 2010, July. The CoNLL-2010 shared task: learning to detect hedges and their scope in Natural Language text. In Proceedings of the Fourteenth Conference on Computational Natural Language Learning, Uppsala, Sweden, pp. 112. Stroudsburg, PA, USA: Association for Computational Linguistics.
Fillmore, C. J. 1976, October. Frame semantics and the nature of language. Annals of the New York Academy of Sciences (Origins and Evolution of Language and Speech), 280: 2032.
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, Ian H. 2009, November. The weka data mining software: an update. SIGKDD Exploration Newsletter, 11 (1): 10–18.
Hendrickx, I., Kim, Su N., Kozareva, Z., Nakov, P., O'Seaghdha, D., Padó, S., Pennacchiotti, M., Romano, L., and Szpakowicz, S. 2009, June. SemEval-2010 task 8: multi-way classification of semantic relations between pairs of nominals. In Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions (SEW-2009), Boulder, Colorado, pp. 94–9. Stroudsburg, PA: Association for Computational Linguistics.
Hintikka, J. 2002. Negation in logic and in natural language. Linguistics and Philosophy, 25 (5/6): 585600.
Horn, Laurence R. 1989, June. A Natural History of Negation. Chicago, IL: University of Chicago Press.
Horn, Laurence R., and Kato, Y. (eds.) 2000, October. Negation and Polarity – Syntactic and Semantic Perspectives (Oxford Linguistics), New York: Oxford University Press.
Hu, M., and Liu, B. 2004. Mining and summarizing customer reviews. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '04), New York, NY, pp. 168–77. New York, NY: ACM.
Huddleston, Rodney D., and Pullum, Geoffrey K. 2002, April. The Cambridge Grammar of the English Language. Cambridge, UK: Cambridge University Press.
Huhns, Michael N., and Stephens, Larry M. 1989. Plausible inferencing using extended composition. In Proceedings of the 11th International Joint Conference on Artificial Intelligence (IJCAI’89), San Francisco, CA, pp. 1420–5. Burlington, MA: Morgan Kaufmann.
Jackendoff, R. 1972. Semantic Interpretation in Generative Grammar. Cambridge, MA: MIT Press.
Jia, L., Yu, C., and Meng, W. 2009. The effect of negation on sentiment analysis and retrieval effectiveness. In Proceedings of the 18th ACM Conference on Information and Knowledge Management, (CIKM '09), New York, NY, pp. 1827–30. New York, NY: ACM.
Kingsbury, P., Palmer, M., and Marcus, M. 2002. Adding semantic annotation to the Penn TreeBank. In Proceedings of the Human Language Technology Conference, San Diego, CA.
Koomen, P., Punyakanok, V., Roth, D. and Yih, Wen T. 2005, June. Generalized inference with multiple semantic role labeling systems. In Proceedings of the Ninth Conference on Computational Natural Language Learning (CoNLL-2005), Ann Arbor, MI, pp. 181–4. Stroudsburg, PA: Association for Computational Linguistics.
Ladusaw, William A. 1996. Negation and polarity items. In Lappin, S. (ed.), Handbook of Contemporary Semantic Theory, pp. 321–41. Malden MA: Blackwell.
Lang, J., and Lapata, M. 2010, June. Unsupervised induction of semantic roles. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Los Angeles, CA, pp. 939–47. Stroudsburg, PA: Association for Computational Linguistics.
Li, J., Zhou, G., Wang, H., and Zhu, Q. 2010, August. Learning the scope of negation via shallow semantic parsing. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), Beijing, China, pp. 671–9. Stroudsburg, PA: ACL (Coling 2010 Organizing Committee).
Löbner, S. 2000, June. Polarity in natural language: predication, quantification and negation in particular and characterizing sentences. Linguistics and Philosophy, 23 (3): 213308.
Marcus, M., Santorini, B. and Marcinkiewicz, Mary A. 1994. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19 (2): 313–30.
Màrquez, L., Carreras, X., Litkowski, Kenneth C., and Stevenson, S. 2008, June. Semantic role labeling: an introduction to the special issue. Computational Linguistics, 34 (2): 145–59.
Merlo, P. and Van der Plas, L. 2009, August. Abstraction and generalisation in semantic role labels: PropBank, VerbNet or both? In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Suntec, Singapore, pp. 288–96. Stroudsburg, PA: Association for Computational Linguistics.
Meyers, A., Reeves, R., Macleod, C., Szekely, R., Zielinska, V., Young, B., and Grishman, R. 2004. Annotating noun argument structure for NomBank. In Proceedings of LREC-2004, Lisbon, Portugal, pp. 803806.
Morante, R. 2010, May. Descriptive analysis of negation cues in biomedical texts. In Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC’10), Valletta, Malta. Paris, France: European Language Resources Association (ELRA), pp. 14291436.
Morante, R., and Blanco, E. 2012. *SEM 2012 shared task: resolving the scope and focus of negation. In Proceedings of *SEM 2012: The First Joint Conference on Lexical and Computational Semantics, Montréal, Canada, 7–8 June, pp. 265–74. Stroudsburg, PA: Association for Computational Linguistics.
Morante, R., Liekens, A., and Daelemans, W. 2008, October. Learning the scope of negation in biomedical texts. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, Honolulu, Hawaii, pp. 715–24. Stroudsburg, PA: Association for Computational Linguistics.
Morante, R., Schrauwen, S., and Daelemans, W. 2011. Corpus-based approaches to processing the scope of negation cues: an evaluation of the state of the art. In Proceedings of the 9th International Conference on Computational Semantics (IWCS 2011), Oxford, UK, pp. 350–354.
Morante, R., and Sporleder, C. (eds.) 2010, July. Proceedings of the Workshop on Negation and Speculation in Natural Language Processing. Antwerp, Belgium: University of Antwerp.
Nielsen, Leif A. 2004. Verb phrase ellipsis detection using automatically parsed text. In Proceedings of the 20th International Conference on Computational Linguistics (COLING '04), Stroudsburg, PA, Stroudsburg, PA: Association for Computational Linguistics, pp. 10931099.
Øvrelid, L., Velldal, E., and Oepen, S. 2010, August. Syntactic scope resolution in uncertainty analysis. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), Beijing, China, pp. 1379–87. Stroudsburg, PA: ACL (Coling 2010 Organizing Committee).
Özgür, A. and Radev, Dragomir R. 2009, August. Detecting speculations and their scopes in scientific text. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, Singapore, pp. 1398–407. Stroudsburg, PA: Association for Computational Linguistics.
Palmer, M., Gildea, D., and Kingsbury, P. 2005. The proposition bank: an annotated corpus of semantic roles. Computational Linguistics, 31 (1): 71106.
Pang, B., Lee, L., and Vaithyanathan, S. 2002, July. Thumbs up? sentiment classification using machine learning techniques. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, pp. 7986. Stroudsburg, PA: Association for Computational Linguistics.
Quirk, R., Greenbaum, S., Leech, G., and Svartvik, J. 1985. A Comprehensive Grammar of the English Language. Harlow, UK: Longman.
Rooth, M. 1985. Association with Focus, PhD thesis, Univeristy of Massachusetts, Amherst.
Rooth, M. 1992. A theory of focus interpretation. Natural Language Semantics, 1: 75116.
Rose, Carolyn P., Roque, A., Bhembe, D., and Vanlehn, K. 2003. A hybrid text classification approach for analysis of student essays. In Building Educational Applications Using Natural Language Processing, Stroudsburg, PA: Association for Computational Linguistics, pp. 6875.
Sánchez Valencia, V. 1991. Studies on Natural Logic and Categorial Grammar, PhD thesis, University of Amsterdam, Netherlands.
Sandu, G. 1994. Some aspects of negation in English. Synthese, 99: 345–60.
Saurf, R., and Pustejovsky, J. 2007. Determining modality and factuality for text entailment. In Proceedings of the International Conference on Semantic Computing, (ICSC '07), Washington, DC, pp. 509–16. Washington, DC: IEEE Computer Society.
Saurí, R., and Pustejovsky, J. 2008. From structure to interpretation: a double-layered annotation for event factuality. In Proceedings of the 2nd Linguistic Annotation Workshop (The LAW II), LREC 2008, Marrakech, Morocco, pp. 18.
Saurí, R., and Pustejovsky, J. 2009, September. FactBank: a corpus annotated with event factuality. Language Resources and Evaluation, 43 (3): 227–68.
Szarvas, G., Vincze, V., Farkas, R., and Csirik, J. 2008, June. The bioscope corpus: annotation for negation, uncertainty and their scope in biomedical texts. In Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing, Columbus, OH, pp. 3845. Stroudsburg, PA: Association for Computational Linguistics.
van Munster, E. 1988. The treatment of scope and negation in Rosetta. In Proceedings of the 12th International Conference on Computational Linguistics, Budapest, Hungary, pp. 442–447.
Wiegand, M., Balahur, A., Roth, B., Klakow, D., and Montoyo, A. 2010, July. A survey on the role of negation in sentiment analysis. In Proceedings of the Workshop on Negation and Speculation in Natural Language Processing, Uppsala, Sweden, pp. 60–8. Antwerp, Belgium: University of Antwerp.
Winston, Morton E., Chaffin, R., and Herrmann, D. 1987. A taxonomy of part-whole relations. Cognitive Science, 11 (4): 417–44.
Zapirain, Be N., Agirre, E., and Màrquez, L. 2008, June. Robustness and generalization of role sets: PropBank vs. VerbNet. In Proceedings of ACL-08: HLT, Columbus, OH, pp. 550558. Stroudsburg, PA: Association for Computational Linguistics.
Zeijlstra, H. 2007. Negation in natural language: on the form and meaning of negative elements. Language and Linguistics Compass, 1 (5): 498518.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Natural Language Engineering
  • ISSN: 1351-3249
  • EISSN: 1469-8110
  • URL: /core/journals/natural-language-engineering
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 5
Total number of PDF views: 55 *
Loading metrics...

Abstract views

Total abstract views: 493 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 21st July 2018. This data will be updated every 24 hours.