Skip to main content Accessibility help

Harmonic Grammar with linear programming: from linear systems to linguistic typology*

  • Christopher Potts (a1), Joe Pater (a2), Karen Jesney (a2), Rajesh Bhatt (a2) and Michael Becker (a3)...

Harmonic Grammar is a model of linguistic constraint interaction in which well-formedness is calculated in terms of the sum of weighted constraint violations. We show how linear programming algorithms can be used to determine whether there is a weighting for a set of constraints that fits a set of linguistic data. The associated software package OT-Help provides a practical tool for studying large and complex linguistic systems in the Harmonic Grammar framework and comparing the results with those of OT. We first describe the translation from harmonic grammars to systems solvable by linear programming algorithms. We then develop a Harmonic Grammar analysis of ATR harmony in Lango that is, we argue, superior to the existing OT and rule-based treatments. We further highlight the usefulness of OT-Help, and the analytic power of Harmonic Grammar, with a set of studies of the predictions Harmonic Grammar makes for phonological typology.

Hide All
Albright, Adam, Magri, Giorgio & Michaels, Jennifer (2008). Modeling doubly marked lags with a split additive model. In Chan, Harvey, Jacob, Heather & Kapia, Enkeleida (eds.) Proceedings of the 32nd Annual Boston University Conference on Language Development. Somerville: Cascadilla. 3647.
Archangeli, Diana & Pulleyblank, Douglas (1994). Grounded phonology. Cambridge, Mass.: MIT Press.
BakoviĆ, Eric (2000). Harmony, dominance, and control. PhD dissertation, Rutgers University.
Bavin Woock, Edith & Noonan, Michael (1979). Vowel harmony in Lango. CLS 15. 2029.
Bazaraa, Mokhtar S., Jarvis, John J. & Sherali, Hanif D. (2005). Linear programming and network flows. 3rd edn.Hoboken, NJ: Wiley.
Becker, Michael & Pater, Joe (2007). OT-Help user guide. University of Massachusetts Occasional Papers in Linguistics 36. 112.
Becker, Michael, Pater, Joe & Potts, Christopher (2007). OT-Help 1.2. Software available at
Beckman, Jill N. (1997). Positional faithfulness, positional neutralisation and Shona vowel harmony. Phonology 14. 146.
Beckman, Jill N. (1998). Positional faithfulness. PhD dissertation, University of Massachusetts, Amherst.
Boersma, Paul & Pater, Joe (2008). Convergence properties of a gradual learning algorithm for Harmonic Grammar. Available as ROA-970 from the Rutgers Optimality Archive.
Boersma, Paul & Weenink, David (2009). Praat: doing phonetics by computer (version 5.1.12).
Casali, Roderic F. (1996). Resolving hiatus. PhD dissertation, University of California, Los Angeles.
Chvátal, Vašek (1983). Linear programming. New York: Freeman.
Coetzee, Andries & Pater, Joe (in press). The place of variation in phonological theory. In Goldsmith, John A., Riggle, Jason & Yu, Alan (eds.) The handbook of phonological theory. 2nd edn.Oxford: Blackwell.
Cormen, Thomas H., Leiserson, Charles E., Rivest, Ronald L. & Stein, Clifford (2001). Introduction to algorithms. 2nd edn.Cambridge, Mass.: MIT Press.
Dantzig, George B. (1982). Reminiscences about the origins of linear programming. Operations Research Letters 1. 4348.
Davis, Stuart (1995). Emphasis spread in Arabic and Grounded Phonology. LI 26. 465498.
Dresher, B. Elan & Kaye, Jonathan D. (1990). A computational learning model for metrical phonology. Cognition 34. 137195.
Goldsmith, John A. (1990). Autosegmental and metrical phonology. Oxford & Cambridge, Mass.: Blackwell.
Goldsmith, John A. (1991). Phonology as an intelligent system. In Napoli, Donna Jo & Kegl, Judy Anne (eds.) Bridges between psychology and linguistics: a Swarthmore Festschrift for Lila Gleitman. Hillsdale: Erlbaum. 247268.
Goldsmith, John A. (1993). Introduction. In Goldsmith, John A. (ed.) The last phonological rule: reflections on constraints and derivations. Chicago: University of Chicago Press. 120.
Goldsmith, John A. (1999). Introduction. In Goldsmith, John A. (ed.) Phonological theory: the essential readings. Malden, Mass. & Oxford: Blackwell. 116.
Goldwater, Sharon & Johnson, Mark (2003). Learning OT constraint rankings using a Maximum Entropy model. In Spenador, Jennifer, Eriksson, Anders & Dahl, Östen (eds.) Proceedings of the Stockholm Workshop on Variation within Optimality Theory. Stockholm: Stockholm University. 111120.
Hayes, Bruce, Tesar, Bruce & Zuraw, Kie (2003). OTSoft 2.1.
Hayes, Bruce, Zuraw, Kie, Siptár, Péter & Londe, Zsuzsa Cziráky (2008). Natural and unnatural constraints in Hungarian vowel harmony. Ms, University of California, Los Angeles.
Hyman, Larry M. (2002). Is there a right-to-left bias in vowel harmony? Ms, University of California, Berkeley.
Ito, Junko & Mester, Armin (2003). Japanese morphophonemics: markedness and word structure. Cambridge, Mass.: MIT Press.
Itô, Junko, Mester, Armin & Padgett, Jaye (1995). Licensing and underspecification in Optimality Theory. LI 26. 571613.
Jäger, Gerhard (2007). Maximum entropy models and Stochastic Optimality Theory. In Zaenen, Annie, Simpson, Jane, King, Tracy Holloway, Grimshaw, Jane, Maling, Joan & Manning, Chris (eds.) Architectures, rules, and preferences: variations on themes by Joan W. Bresnan. Stanford: CSLI. 467479.
Jesney, Karen (to appear). Licensing in multiple contexts: an argument for Harmonic Grammar. CLS 45.
Johnson, Mark (2002). Optimality-theoretic Lexical Functional Grammar. In Merlo, Paola & Stevenson, Suzanne (eds.) The lexical basis of sentence processing: formal, computational and experimental issues. Amsterdam & Philadelphia: Benjamins. 5973.
Jurgec, Peter (2009). Autosegmental spreading is a binary relation. Ms, University of Tromsø.
Kager, René (2005). Rhythmic licensing: an extended typology. In Proceedings of the 3rd International Conference on Phonology. Seoul: The Phonology–Morphology Circle of Korea. 5–31.
Kaplan, Aaron F. (2008). Noniterativity is an emergent property of grammar. PhD dissertation, University of California, Santa Cruz.
Kelkar, Ashok R. (1968). Studies in Hindi-Urdu. Vol. 1: Introduction and word phonology. Poona: Deccan College.
Keller, Frank (2000). Gradience in grammar: experimental and computational aspects of degrees of grammaticality. PhD dissertation, University of Edinburgh.
Keller, Frank (2006). Linear optimality theory as a model of gradience in grammar. In Fanselow, Gisbert, Féry, Caroline, Vogel, Ralf & Schlesewsky, Matthias (eds.) Gradience in grammar: generative perspectives. Oxford: Oxford University Press. 270287.
Legendre, Géraldine, Miyata, Yoshiro & Smolensky, Paul (1990a). Harmonic Grammar: a formal multi-level connectionist theory of linguistic well-formedness: theoretical foundations. In Proceedings of the 12th Annual Conference of the Cognitive Science Society. Hillsdale: Erlbaum. 388395.
Legendre, Géraldine, Miyata, Yoshiro & Smolensky, Paul (1990b). Harmonic Grammar: a formal multi-level connectionist theory of linguistic well-formedness: an application. In Proceedings of the 12th Annual Conference of the Cognitive Science Society. Hillsdale: Erlbaum. 884891.
Legendre, Géraldine, Sorace, Antonella & Smolensky, Paul (2006). The Optimality Theory–Harmonic Grammar connection. In Smolensky, & Legendre, (2006: vol. 2). 339402.
Lombardi, Linda (1999). Positional faithfulness and voicing assimilation in Optimality Theory. NLLT 17. 267302.
López, Marco & Still, Georg (2007). Semi-infinite programming. European Journal of Operations Research 180. 491518.
McCarthy, John J. (1997). Process-specific constraints in optimality theory. LI 28. 231251.
McCarthy, John J. (2003). OT constraints are categorical. Phonology 20. 75–138.
McCarthy, John J. (2006). Restraint of analysis. In BakoviĆ, Eric, Ito, Junko & McCarthy, John J. (eds.) Wondering at the natural fecundity of things: essays in honor of Alan Prince. Santa Cruz: Linguistics Research Center. 195219.
McCarthy, John J. (2007). Hidden generalizations: phonological opacity in Optimality Theory. London: Equinox.
McCarthy, John J. (2009). Harmony in Harmonic Serialism. Ms, University of Massachusetts, Amherst. Available as ROA-1009 from the Rutgers Optimality Archive.
McCarthy, John J. & Prince, Alan (1993). Generalized alignment. Yearbook of Morphology 1993. 79–153.
Noonan, Michael (1992). A grammar of Lango. Berlin & New York: Mouton de Gruyter.
Okello, Jenny (1975). Some phonological and morphological processes in Lango. PhD dissertation, Indiana University.
Pater, Joe (2008). Gradual learning and convergence. LI 39. 334345.
Pater, Joe (2009a). Review of Smolensky & Legendre (2006). Phonology 26. 217226.
Pater, Joe (2009b). Weighted constraints in generative linguistics. Cognitive Science 33. 999–1035.
Pater, Joe (to appear). Serial Harmonic Grammar and Berber syllabification. In Borowsky, Toni, Kawahara, Shigeto, Shinya, Takahito & Sugahara, Mariko (eds.) Prosody matters: essays in honor of Elisabeth O. Selkirk. London: Equinox.
Poser, William J. (1982). Phonological representation and action-at-a-distance. In Hulst, Harry van der & Smith, Norval (eds.) The structure of phonological representations. Part 2. Dordrecht: Foris. 121158.
Potts, Christopher, Becker, Michael, Bhatt, Rajesh & Pater, Joe (2007). HaLP: Harmonic Grammar with linear programming. Version 2. Software available at
Prince, Alan (2002). Entailed ranking arguments. Ms, Rutgers University. Available as ROA-500 from the Rutgers Optimality Archive.
Prince, Alan (2003). Anything goes. In Honma, Takeru, Okazaki, Masao, Tabata, Toshiyuki & Tanaka, Shin-ichi (eds.) A new century of phonology and phonological theory: a Festschrift for Professor Shosuke Haraguchi on the occasion of his sixtieth birthday. Tokyo: Kaitakusha. 6690.
Prince, Alan & Smolensky, Paul (1997). Optimality: from neural networks to Universal Grammar. Science 275. 16041610.
Prince, Alan & Smolensky, Paul (2004). Optimality Theory: constraint interaction in generative grammar. Malden, Mass. & Oxford: Blackwell.
Pruitt, Kathryn (2008). Iterative foot optimization and locality in rhythmic word stress. Ms, University of Massachusetts, Amherst.
Riggle, Jason (2004a). Generation, recognition, and learning in finite-state Optimality Theory. PhD dissertation, University of California, Los Angeles.
Riggle, Jason (2004b). Generation, recognition and ranking with compiled OT grammars. Paper presented at the 78th Annual Meeting of the Linguistic Society of America, Boston.
Smolensky, Paul (2006). Optimality in phonology II: harmonic completeness, local constraint conjunction, and feature domain markedness. In Smolensky, & Legendre, (2006: vol. 2). 27–160.
Smolensky, Paul & Legendre, Géraldine (eds.) (2006). The harmonic mind: from neural computation to optimality-theoretic grammar. 2 vols. Cambridge, Mass.: MIT Press.
Tesar, Bruce & Smolensky, Paul (1998a). Learnability in Optimality Theory. LI 29. 229268.
Tesar, Bruce & Smolensky, Paul (1998b). Learning Optimality-Theoretic grammars. Lingua 106. 161196.
Walker, Rachel (2001). Positional markedness in vowel harmony. In Féry, Caroline, Green, Antony Dubach & van de Vijver, Ruben (eds.) Proceedings of HILP 5. Potsdam: University of Potsdam. 212232.
Walker, Rachel (2005). Weak triggers in vowel harmony. NLLT 23. 917989.
Wilson, Colin (2003). Analyzing unbounded spreading with constraints: marks, targets, and derivations. Ms, University of California, Los Angeles.
Wilson, Colin (2006). Learning phonology with substantive bias: an experimental and computational study of velar palatalization. Cognitive Science 30. 945982.
Zoll, Cheryl (1996). Parsing below the segment in a constraint-based framework. PhD dissertation, University of California, Berkeley.
Zoll, Cheryl (1998). Positional asymmetries and licensing. Ms, MIT. Available as ROA-282 from the Rutgers Optimality Archive.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

  • ISSN: 0952-6757
  • EISSN: 1469-8188
  • URL: /core/journals/phonology
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed