Skip to main content Accessibility help
×
Home

A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras

Published online by Cambridge University Press:  10 April 2019


Jules Hedges
Affiliation:
Department of Computer Science, University of Oxford, Oxford, UK
Mehrnoosh Sadrzadeh
Affiliation:
School of Electronic Engineering and Computer Science, Queen Mary University of London, London, UK
Corresponding
E-mail address:

Abstract

Categorical compositional distributional semantics is a model of natural language; it combines the statistical vector space models of words with the compositional models of grammar. We formalise in this model the generalised quantifier theory of natural language, due to Barwise and Cooper. The underlying setting is a compact closed category with bialgebras. We start from a generative grammar formalisation and develop an abstract categorical compositional semantics for it, and then instantiate the abstract setting to sets and relations and to finite-dimensional vector spaces and linear maps. We prove the equivalence of the relational instantiation to the truth theoretic semantics of generalised quantifiers. The vector space instantiation formalises the statistical usages of words and enables us to, for the first time, reason about quantified phrases and sentences compositionally in distributional semantics.


Type
Paper
Copyright
© Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below.

References

Ajdukiewicz, K. (1935). Die syntaktische konnexitat. Studia Philosophica 1 127.Google Scholar
Bar-Hillel, Y. (1953). A quasi-arithmetical notation for syntactic description. Language 29 4758.CrossRefGoogle Scholar
Bar-Hillel, Y., Gaifman, C. and Shamir, E. (1960). On categorial and phrase-structure grammars. Bulletin of the Research Council of Israel 9F, 116.Google Scholar
Barwise, J. and Cooper, R. (1981). Generalized quantifiers and natural language. Linguistics and Philosophy 4 159219.CrossRefGoogle Scholar
Bonchi, F., Sobocinski, P. and Zanasi, F. (2014). Interacting bialgebras are Frobenius. In: Muscholl, A. (ed.) Proceedings of FoSSaCS 2014, vol. 8412, Grenoble, France Springer, 351365.Google Scholar
Bullinaria, J. A. and Levy, J. P. (2007). Extracting semantic representations from word co-occurrence statistics: A computational study. Behavior Research Methods 39 510526.CrossRefGoogle ScholarPubMed
Buszkowski, W. (1988). Generative power of categorial grammars. In: Oehrle, R., Bach, E., and Wheeler, D. (eds.) Categorial Grammars and Natural Language Structures, Studies in Linguistics and Philosophy, vol. 32, Springer Netherlands, 6994.CrossRefGoogle Scholar
Buszkowski, W. (2001). Lambek grammars based on pregroups. In: Logical Aspects of Computational Linguistics, Lecture Notes in Computer Science, vol. 2099, Springer Berlin Heidelberg, 95109.CrossRefGoogle Scholar
Chomsky, N. (1956). Three models for the description of language. IRE Transactions on Information Theory 2 113124.CrossRefGoogle Scholar
Clark, S., Coecke, B. and Sadrzadeh, M. (2008). A compositional distributional model of meaning. In: Bruza, P., Lawless, W., Coecke, B. (eds.) Proceedings of the Second Symposium on Quantum Interaction (QI), Oxford University, College Publications, 133140.Google Scholar
Clark, S., Coecke, B. and Sadrzadeh, M. (2013). The Frobenius anatomy of relative pronouns. In: Kornai, A., Kuhlmann, M. (eds.), 13th Meeting on Mathematics of Language (MoL)., Sofia, Bulgaria, ACL, 4151.Google Scholar
Clark, S. and Pulman, S. (2007). Combining symbolic and distributional models of meaning. In: Bruza, P., Lawless, W., van Rijsbergen, C. J. (eds.) Proceedings of the AAAI Spring Symposium on Quantum Interaction, Technical Report SS-07-08, Stanford University, AAAI Press, 5255.Google Scholar
Coecke, B., Grefenstette, E. and Sadrzadeh, M. (2013). Lambek vs. Lambek: Functorial vector space semantics and string diagrams for Lambek calculus. Annals of Pure and Applied Logic 164(11) 10791100, special issue on Seventh Workshop on Games for Logic and Programming Languages (GaLoP VII).CrossRefGoogle Scholar
Coecke, B., Sadrzadeh, M. and Clark, S. (2010). Mathematical foundations for distributed compositional model of meaning. Lambek Festschrift. Linguistic Analysis 36 345384.Google Scholar
Firth, J. (1957). A synopsis of linguistic theory 1930–1955. In: Palmer, F. R. (ed.) Studies in Linguistic Analysis Longmans, 168205.Google Scholar
Frege, G. (1948). On sense and reference. The Philosophical Review 57 209230.CrossRefGoogle Scholar
Geffet, M. and Dagan, I. (2005). The distributional inclusion hypotheses and lexical entailment. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL ‘05, Association for Computational Linguistics, 107114.Google Scholar
Grefenstette, E., Dinu, G., Zhang, Y., Sadrzadeh, M. and Baroni, M. (2013). Multi-step regression learning for compositional distributional semantics. In: 10th International Conference on Computational Semantics (IWCS). Postdam.Google Scholar
Grefenstette, E. and Sadrzadeh, M. (2011). Experimental support for a categorical compositional distributional model of meaning. In: Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP), Computational Linguistics 41. MIT Press 13941404.Google Scholar
Grefenstette, E. and Sadrzadeh, M. (2015). Concrete models and empirical evaluations for the categorical compositional distributional model of meaning. Computational Linguistics 41 71118.CrossRefGoogle Scholar
Harris, Z. (1954). Distributional structure. Word 10, 146162, Routledge.CrossRefGoogle Scholar
Kartsaklis, D. (2015). Compositional Distributional Semantics with Compact Closed Categories and Frobenius Algebras. PhD thesis, Department of Computer Science, University of Oxford.Google Scholar
Kartsaklis, D., Kalchbrenner, N. and Sadrzadeh, M. (2014). Resolving lexical ambiguity in tensor regression models of meaning. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, Volume 2: Short Papers, June 22–27, 2014, ACL 2014, Baltimore, MD, USA, 212217.Google Scholar
Kartsaklis, D. and Sadrzadeh, M. (2013). Prior disambiguation of word tensors for constructing sentence vectors. In: Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP) Association for Computational Linguistics, 15901601.Google Scholar
Kartsaklis, D., Sadrzadeh, M. and Pulman, S. (2012). A unified sentence space for categorical distributional-compositional semantics: Theory and experiments. In: Proceedings of 24th International Conference on Computational Linguistics (COLING 2012): Posters, Mumbai, India, 549558.Google Scholar
Kartsaklis, D., Sadrzadeh, M., Pulman, S. and Coecke, B. (2013). Reasoning about meaning in natural language with compact closed categories and Frobenius algebras. In: Chubb, A., Eskandarian, J. and Harizanov, V. (eds.) Logic and Algebraic Structures in Quantum Computing and Information, Cambridge University Press. 199222.Google Scholar
Kelly, G. and Laplaza, M. (1980). Coherence for compact closed categories. Journal of Pure and Applied Algebra 19, 193213. http://www.sciencedirect.com/science/article/pii/0022404980901012CrossRefGoogle Scholar
Kock, A. (1972). Strong functors and monoidal monads. Archiv der Mathematik 23 113120.CrossRefGoogle Scholar
Lambek, J. (1958). The mathematics of sentence structure. American Mathematics Monthly 65 154170.CrossRefGoogle Scholar
Lambek, J. (1997). Type grammars revisited. In: Proceedings of LACL 97, Lecture Notes in Artificial Intelligence, vol. 1582, Springer Verlag. 127.Google Scholar
Lambek, J. (2008). From Word to Sentence: A Computational Algebraic Approach to Grammar. Polimetrica.Google Scholar
Lambek, J. (2010). Compact monoidal categories from linguistics to physics. In: Coecke, B. (ed.) New Structures for Physics, Lecture Notes in Physics, Springer, 451469.Google Scholar
Landauer, T. and Dumais, S. (1997). A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104 211240.CrossRefGoogle Scholar
Lapesa, G. and Evert, S. (2014). A large scale evaluation of distributional semantic models: Parameters, interactions and model selection. Transactions of the Association for Computational Linguistics 2 531545.CrossRefGoogle Scholar
Lin, D. (1998). Automatic retrieval and clustering of similar words. In: Proceedings of the 17th international conference on Computational linguistics, vol. 2, Association for Computational Linguistics, 768774.Google Scholar
Lund, K. and Burgess, C. (1996). Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods Instruments and Computers 28 (2) 203208.CrossRefGoogle Scholar
McCurdy, M. (2012). Graphical methods for Tannaka duality of weak bialgebras and weak Hopf algebras. Theory and Applications of Categories 26 (9) 233280.Google Scholar
Milajevs, D., Kartsaklis, D., Sadrzadeh, M. and Purver, M. (2014). Evaluating neural word representations in tensor-based compositional settings. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics, 708719.CrossRefGoogle Scholar
Mitchell, J. and Lapata, M. (2010). Composition in distributional models of semantics. Cognitive Science 34 13881439.CrossRefGoogle ScholarPubMed
Montague, R. (1970). English as a formal language. In: Visentini, B. (ed.) Linguaggi nella Società e nella Tecnica, Edizioni di Comunità, 189224.Google Scholar
Polajnar, T., Fagarasan, L. and Clark, S. (2014). Reducing dimensions of tensors in type-driven distributional semantics. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 10361046. Association for Computational Linguistics.CrossRefGoogle Scholar
Preller, A. (2013). From logical to distributional models. In: Proceedings of the 10th International Workshop on Quantum Physics and Logic, QPL 2013, Castelldefels (Barcelona), Spain, July 17–19, 113131.Google Scholar
Preller, A. (2014). Natural language semantics in biproduct dagger categories. Journal of Applied Logic 12 (1) 88108. https://doi.org/10.1016/j.jal.2013.08.001CrossRefGoogle Scholar
Preller, A. and Lambek, J. (2007). Free compact 2-categories. Mathematical Structures in Computer Science 17 309340.CrossRefGoogle Scholar
Preller, A. and Sadrzadeh, M. (2010). Bell states and negative sentences in the distributed model of meaning. In: Coecke, B., Panangaden, P., Selinger, P. (eds.) Proceedings of the 6th QPL Workshop on Quantum Physics and Logic, Electronic Notes in Theoretical Computer Science, University of Oxford. 141153.Google Scholar
Preller, A. and Sadrzadeh, M. (2011). Semantic vector models and functional models for pregroup grammars. Journal of Logic Language and Information 20 419443.CrossRefGoogle Scholar
Rubenstein, H. and Goodenough, J. (1965). Contextual correlates of synonymy. Communications of the ACM 8 (10) 627633.CrossRefGoogle Scholar
Rypacek, O. and Sadrzadeh, M. (2014). A low-level treatment of generalised quantifiers in categorical compositional distributional semantics. In: Joint Proceedings of the Second International Workshop on Natural Language and Computer Science (NLCS14) and First International Workshop on Natural Language Services for Reasoners (NLSR 2014), TR 2014/02, Center for Informatics and Systems of the University of Coimbra, 165177.Google Scholar
Sadrzadeh, M., Clark, S. and Coecke, B. (2013). Frobenius anatomy of word meanings i: Subject and object relative pronouns. Journal of Logic and Computation 23 12931317.CrossRefGoogle Scholar
Sadrzadeh, M., Clark, S. and Coecke, B. (2014). Frobenius anatomy of word meanings 2: Possessive relative pronouns. Journal of Logic and Computation 26 785815.CrossRefGoogle Scholar
Salton, G., Wong, A. and Yang, C. S. (1975). A vector space model for automatic indexing. Communications of the ACM 18 613620.CrossRefGoogle Scholar
Schuetze, H. (1998). Automatic word sense discrimination. Computational Linguistics 24 (1) 97123.Google Scholar
Turney, P. D. (2006). Similarity of semantic relations. Computational Linguistics 32 (3) 379416.CrossRefGoogle Scholar
van Benthem, J. (1987). Categorial grammar and lambda calculus. In: Skordev, Dimiter G. (ed.) Mathematical Logic and Its Applications, Springer, 3960.CrossRefGoogle Scholar
Weeds, J., Weir, D. and McCarthy, D. (2004). Characterising measures of lexical distributional similarity. In: Proceedings of the 20th International Conference on Computational Linguistics, COLING ‘04, Association for Computational Linguistics. 1015.Google Scholar

Altmetric attention score


Full text views

Full text views reflects PDF downloads, PDFs sent to Google Drive, Dropbox and Kindle and HTML full text views.

Total number of HTML views: 0
Total number of PDF views: 52 *
View data table for this chart

* Views captured on Cambridge Core between 10th April 2019 - 1st December 2020. This data will be updated every 24 hours.

Hostname: page-component-79f79cbf67-nqzjh Total loading time: 0.283 Render date: 2020-12-01T19:53:54.726Z Query parameters: { "hasAccess": "0", "openAccess": "0", "isLogged": "0", "lang": "en" } Feature Flags last update: Tue Dec 01 2020 19:06:00 GMT+0000 (Coordinated Universal Time) Feature Flags: { "metrics": true, "metricsAbstractViews": false, "peerReview": true, "crossMark": true, "comments": true, "relatedCommentaries": true, "subject": true, "clr": false, "languageSwitch": true }

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras
Available formats
×
×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *