Toward an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system

doi:10.1017/CBO9780511731525.016

12 - Toward an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system

from Part II - Computational neuroscience models

Published online by Cambridge University Press: 05 November 2011

Michael J. Frank and

Edited by

Tony J. Prescott and

Anil K. Seth: Affiliation:
University of Sussex
Tony J. Prescott: Affiliation:
University of Sheffield
Joanna J. Bryson: Affiliation:
University of Bath

Book contents

Get access

Summary

The prefrontal cortex (PFC) has long been thought to serve as an ‘executive’ that controls the selection of actions, and cognitive functions more generally. However, the mechanistic basis of this executive function has not been clearly specified, often amounting to a homunculus. This chapter reviews recent attempts to deconstruct this homunculus by elucidating the precise computational and neural mechanisms underlying the executive functions of the PFC. The overall approach builds upon existing mechanistic models of the basal ganglia (BG) and frontal systems known to play a critical role in motor control and action selection, where the BG provide a ‘Go’ versus ‘NoGo’ modulation of frontal action representations. In our model, the BG modulate working memory representations in prefrontal areas to support more abstract executive functions. We have developed a computational model of this system that is capable of developing human-like performance on working memory and executive control tasks through trial-and-error learning. This learning is based on reinforcement learning mechanisms associated with the midbrain dopaminergic system and its activation via the BG and amygdala. Finally, we briefly describe various empirical tests of this framework.

Introduction

There is widespread agreement that some regions of the brain play a larger role in controlling our overall behaviour than others, with a strong consensus that the prefrontal cortex (PFC) is a ‘central executive’ (e.g., Baddeley, 1986; Christoff et al., 2009; Conway et al., 2005; Duncan, 2001; Koechlin and Summerfield, 2007; Miller and Cohen, 2001; Shallice, 1988). However, this central executive label raises many more questions than it answers. How does the PFC know what actions or plans to select? How does experience influence the PFC? How do the specific neural properties of the PFC enable this kind of function, and how do these differ from those in other, non-executive areas? Without answers to these kinds of questions, the notion of a central executive is tantamount to positing a homunculus (small man) living inside the PFC and controlling our actions.

Information

Type: Chapter
Information: Modelling Natural Action Selection , pp. 239 - 263

DOI: https://doi.org/10.1017/CBO9780511731525.016 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Alexander, G. E.DeLong, M. R.Strick, P. L. 1986 Parallel organization of functionally segregated circuits linking basal ganglia and cortexAnnu. Rev. Neurosci. 9 357CrossRef Google Scholar PubMed

Anderson, J. R.Bothell, D.Byrne, M. D. 2004 An integrated theory of the mindPsychol. Rev. 111 1036CrossRef Google Scholar PubMed

Ashby, F. GAlfonso-Reese, L. A.Turken, A. U.Waldron, E. M. 1998 A neuropsychological theory of multiple systems in category learningPsychol. Rev. 105 442CrossRef Google Scholar PubMed

Aston-Jones, G.Cohen, J. D. 2005 An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performanceAnnu. Rev. Neurosci. 28 403CrossRef Google Scholar PubMed

Baddeley, A. D. 1986 Working MemoryNew YorkOxford University PressGoogle Scholar PubMed

Badre, D.D’Esposito, M. 2009 Is the rostro-caudal axis of the frontal lobe hierarchicalNature reviews 10 659CrossRef Google Scholar PubMed

Badre, D.Hoffman, J.Cooney, J.D’Esposito, M 2009 Hierarchical cognitive control deficits following damage to the human frontal lobeNature Neurosci. 12 515CrossRef Google Scholar PubMed

Balleine, B. W.Dickinson, A. 1998 Goal-directed instrumental action: contingency and incentive learning and their cortical substratesNeuropharmacology 37 407CrossRef Google Scholar PubMed

Berns, G. S.Sejnowski, T. J. 1998 A computational model of how the basal ganglia produces sequencesJ. Cogn. Neurosci. 10 108CrossRef Google Scholar

Bogacz, R.Cohen, J. D. 2004 Parameterization of connectionist modelsBehav. Res. Meth. Inst. Comp. 36 732CrossRef Google Scholar PubMed

Botvinick, M. M.Cohen, J. D.Carter, C. S. 2004 Conflict monitoring and anterior cingulate cortex: an updateTrends Cogn. Sci. 8 539CrossRef Google Scholar PubMed

Botvinick, M. M.Niv, Y.Barto, A G. 2009 Hierarchically organized behavior and its neural foundations: A reinforcement learning perspectiveCognition 113 262CrossRef Google Scholar PubMed

Braver, T. S.Barch, D. M.Cohen, J. D. 1999 Cognition and control in schizophrenia: a computational model of dopamine and prefrontal functionBiol. Psych. 46 312CrossRef Google Scholar PubMed

Braver, T. S.Cohen, J. D. 2000 On the control of control: the role of dopamine in regulating prefrontal function and working memoryControl of Cognitive Processes: Attention and Performance, XVIIIMonsell, SDriver, J.Cambridge, MAMIT Press713Google Scholar

Braver, T. S.Cohen, J. D.Nystrom, L. E. 1997 A parametric study of frontal cortex involvement in human working memoryNeuroImage 5 49CrossRef Google Scholar PubMed

Braver, T. S.Cohen, J. D.Servan-Schreiber, D 1995 A computational model of prefrontal cortex functionAdvances in Neural Information Processing SystemsTouretzky, D. S.Tesauro, G.Leen, T. K.Cambridge, MAMIT PressGoogle Scholar

Brown, J. W.Braver, T. S. 2005 Learned predictions of error likelihood in the anterior cingulate cortexScience 307 1118CrossRef Google Scholar PubMed

Brown, J.Bullock, D.Grossberg, S. 1999 How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cuesJ. Neurosci 19 10502CrossRef Google Scholar PubMed

Brown, J.Bullock, D.Grossberg, S. 2004 How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccadesNeural Networks 17 471CrossRef Google Scholar PubMed

Bunge, S. A.Helskog, E. H.Wendelken, C. 2009 Left, but not right, rostrolateral prefrontal cortex meets a stringent test of the relational integration hypothesisNeuroImage 46 338CrossRef Google Scholar

Burgess, N.Hitch, G. J. 1999 Memory for serial order: a network model of the phonological loop and its timingPsychol. Rev. 106 551CrossRef Google Scholar

Chatham, C. H.Frank, M. J.Munakata, Y. 2009 Pupillometric and behavioral markers of a developmental shift in the temporal dynamics of cognitive controlProc. Nat. Acad. Sci. USA 106 5529CrossRef Google Scholar PubMed

Christoff, K.Gabrieli, J. D. E. 2000 The frontopolar cortex and human cognition: evidence for a rostrocaudal hierarchical organization within the human prefrontal cortexPsychobiology 28 168Google Scholar

Christoff, K.Keramatian, K.Gordon, A. M.Smith, R.Mädler, B. 2009 Prefrontal organization of cognitive control according to levels of abstractionBrain Res. 1286 94CrossRef Google Scholar PubMed

Cisek, P. 2007 Cortical mechanisms of action selection: the affordance competition hypothesisPhil. Trans. Roy. Soc. B Biol. Sci. 362 1585CrossRef Google Scholar PubMed

Cohen, J. DBraver, T. S.Brown, J. W. 2002 Computational perspectives on dopamine function in prefrontal cortexCurr. Opin. Neurobiol. 12 223CrossRef Google Scholar PubMed

Cohen, J. D.Braver, T. S.O’Reilly, R. C. 1997 A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challengesPhil. Trans. Roy. Soc. B. Biol. Sci. 351 1515CrossRef Google Scholar

Cohen, J. D.Dunbar, K.McClelland, J. L. 1990 On the control of automatic processes: a parallel distributed processing model of the Stroop effectPsychol. Rev. 97 332CrossRef Google Scholar PubMed

Cohen, J. D.Perlstein, W. M.Braver, T. S. 1997 Temporal dynamics of brain activity during a working memory taskNature 386 604CrossRef Google Scholar

Cohen, J. D.Servan-Schreiber, D. 1992 Context, cortex, and dopamine: a connectionist approach to behavior and biology in schizophreniaPsychol. Rev. 99 45CrossRef Google Scholar

Cohen, J. D.Servan-Schreiber, D.McClelland, J. L. 1992 A parallel distributed processing approach to auomaticityAm. J. Psychol. 105 239CrossRef Google Scholar

Contreras-Vidal, J. L.Schultz, W. 1999 A predictive reinforcement model of dopamine neurons for learning approach behaviorJ. Comput. Neurosci 6 191CrossRef Google Scholar PubMed

Conway, A. R. A.Kane, M. J.Engle, R. W. 2005 Working memory capacity and its relation to general intelligenceTrends Cogn. Sci. 7 547CrossRef Google Scholar

Dayan, P. 2007 Bilinearity, rules, and prefrontal cortexFront. Comput. Neurosci. 1CrossRef Google Scholar PubMed

Dayan, P. 2008 Simple substrates for complex cognitionFront. Comput. Neurosci. 2Google Scholar PubMed

Dominey, P.Arbib, M.Joseph, J-.P. 1995 A model of corticostriatal plasticity for learning oculomotor associations and sequencesJ. Cogn. Neurosci. 7 311CrossRef Google Scholar PubMed

Duncan, J. 2001 An adaptive coding model of neural function in prefrontal cortexNature Rev. Neurosci. 2 820CrossRef Google Scholar PubMed

Durstewitz, D.Kelc, M.Güntürkün, O. 1999 A neurocomputational theory of the dopaminergic modulation of working memory functionsJ. Neurosci. 19 2807CrossRef Google Scholar PubMed

Durstewitz, D.Seamans, J. K. 2002 The computational role of dopamine D1 receptors in working memoryNeural networks 15 561CrossRef Google Scholar PubMed

Durstewitz, D.Seamans, J. K.Sejnowski, T. J. 2000 Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortexJ. Neurophysiol. 83 1733CrossRef Google Scholar

Flaherty, A. WGraybiel, A. M. 1993 Output architecture of the primate putamenJ. Neurosci. 13 3222CrossRef Google Scholar PubMed

Frank, M. J. 2005 Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated ParkinsonismJ. Cogn. Neurosci. 17 51CrossRef Google Scholar PubMed

Frank, M. J. 2006 Hold your horses: a dynamic computational role for the subthalamic nucleus in decision makingNeural Networks 19 1120CrossRef Google Scholar PubMed

Frank, M. J.Claus, E. D 2006 Anatomy of a decision: striatoorbitofrontal interactions in reinforcement learning, decision making, and reversalPsychol. Rev. 113 300CrossRef Google Scholar PubMed

Frank, M. J.Loughry, B.O’Reilly, R. C. 2001 Interactions between the frontal cortex and basal ganglia in working memory: a computational modelCogn., Affect. Behav. Neurosci. 1 137CrossRef Google Scholar PubMed

Frank, M. J.O’Reilly, R. C. 2006 A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidolBehav. Neurosci. 120 497CrossRef Google Scholar PubMed

Frank, M. J.Samanta, J.Moustafa, A. A.Sherman, S. J. 2007 Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonismScience 318 1309CrossRef Google Scholar PubMed

Frank, M. J.Santamaria, A.O’Reilly, R. C.Willcutt, E 2007 Testing computational models of dopamine and noradrenaline dysfunction in attention deficit/hyperactivity disorderNeuropsychopharmacol. 32 1583CrossRef Google Scholar PubMed

Frank, M. J.Scheres, A.Sherman, S. J. 2007 Understanding decision-making deficits in neurological conditions: insights from models of natural action selectionPhil. Trans. Roy. Soc. B. Biol. Sci. 362 1641CrossRef Google Scholar PubMed

Frank, M. J.Seeberger, L. C.O’Reilly, R. C. 2004 By carrot or by stick: cognitive reinforcement learning in ParkinsonismScience 306 1940CrossRef Google Scholar PubMed

Funahashi, S.Bruce, C. J.Goldman-Rakic, P. S. 1989 Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortexJ. Neurophysiol. 61 331CrossRef Google Scholar PubMed

Fuster, J. M. 1989 The Prefrontal Cortex: Anatomy, Physiology and Neuropsychology of the Frontal LobeNew YorkRaven PressGoogle Scholar

Fuster, J. M.Alexander, G. E. 1971 Neuron activity related to shortterm memoryScience 173 652CrossRef Google Scholar

Graybiel, A. M.Kimura, M. 1995 Adaptive neural networks in the basal gangliaModels of Information Processing in the Basal GangliaHouk, J. C.Davis, J. L.Beiser, D. G.Cambridge, MAMIT Press103Google Scholar

Gurney, K.Prescott, T. J.Redgrave, P. 2001 A computational model of action selection in the basal ganglia. I. A new functional anatomyBiol. Cybern 84 401CrossRef Google Scholar PubMed

Hazy, T. E.Frank, M. J.Michael, J.O’Reilly, R. C. 2007 Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia systemPhil. Trans. Roy. Soc. B. Biol. Sci. 362 105CrossRef Google Scholar PubMed

Hazy, T. E.Frank, M. J.O’Reilly, R. C. 2006 Banishing the homunculus: Making working memory workNeuroscience 139 105CrossRef Google Scholar PubMed

Hazy, T. E.Frank, M. J.O’Reilly, R. C. 2010 Neural mechanisms of acquired phasic dopamine responses in learningNeurosci. Biobehav. Rev. 34 701CrossRef Google Scholar

Herd, S. ABanich, M. T.O’Reilly, R. C. 2006 Neural mechanisms of cognitive control: an integrative model of Stroop task performance and FMRI dataJ. Cogn. Neurosci 18 22CrossRef Google Scholar PubMed

Hochreiter, S.Schmidhuber, J. 1997 Long short term memoryNeural Comput. 9 1735CrossRef Google Scholar PubMed

Holt, D. J.Graybiel, A. M.Saper, C. B 1997 Neurochemical architecture of the human striatumJ. Comp. Neurol. 384 13.0.CO;2-5>CrossRef Google Scholar PubMed

Houk, J. C.Adams, J. L.Barto, A. G. 1995 A model of how the basal ganglia generate and use neural signals that predict reinforcementModels of Information Processing in the Basal, GangliaHouk, J. C.Davis, J. L.Beiser, D. G.Cambridge, MAMIT Press233Google Scholar

Houk, J. C.Bastianen, C.Fansler, D. 2007 Action selection and refinement in subcortical loops through basal ganglia and cerebellumPhil. Trans. Roy. Soc. B. Biol. Sci. 362 1573CrossRef Google Scholar PubMed

Houk, J. C.Wise, S. P. 1995 Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling actionCereb. Cortex 5 95CrossRef Google Scholar PubMed

Ivry, R. 1996 The representation of temporal information in perception and motor controlCurr. Opin. Neurobiol. 6 851CrossRef Google Scholar PubMed

Jilk, D.Lebiere, C.O’Reilly, R. C.Anderson, J 2008 SAL: an explicitly pluralistic cognitive architectureJ. Exp. Theor. Artif. Intell 9 197CrossRef Google Scholar

Joel, D.Niv, Y.Ruppin, E. 2002 Actor-critic models of the basal ganglia: new anatomical and computational perspectivesNeural Networks 15 535CrossRef Google Scholar PubMed

Klein, T. A.Neumann, J.Reuter, M. 2007 Genetically determined differences in learning from errorsScience 318 1642CrossRef Google Scholar PubMed

Koechlin, E.Summerfield, C. 2007 An information theoretical approach to prefrontal executive functionTrends Cogn. Sci. 11 229CrossRef Google Scholar PubMed

Kubota, K.Niki, H. 1971 Prefrontal cortical unit activity and delayed alternation performance in monkeysJ. Neurophysiol. 34 337CrossRef Google Scholar PubMed

Levitt, J. B.Lewis, D. A.Yoshioka, T.Lund, J. S. 1993 Topography of pyramidal neuron intrinsic connections in macaque monkey prefrontal cortex (Areas 9 46)J. Comp. Neurol. 338 360CrossRef Google Scholar

Lisman, J. E.Fellous, J. M.Wang, X. J. 1999 A role for NMDA-receptor channels in working memoryNature Neurosci. 1 273CrossRef Google Scholar

Mauk, M. D.Buonomano, D. V 2004 The neural basis of temporal processingAnnu. Rev. Neurosci. 27 307CrossRef Google Scholar PubMed

Middleton, F. A.Strick, P. L 2000 Basal ganglia output and cognition: evidence from anatomical, behavioral, and clinical studiesBrain Cogn. 42 183CrossRef Google Scholar PubMed

Miller, E. K.Cohen, J. D. 2001 An integrative theory of prefrontal cortex functionAnnu. Rev. Neurosci. 24 167CrossRef Google Scholar PubMed

Miller, E. K.Erickson, C. A.Desimone, R. 1996 Neural mechanisms of visual working memory in prefontal cortex of the macaqueJ. Neurosci. 16CrossRef Google Scholar

Mink, J. W. 1996 The basal ganglia: focused selection and inhibition of competing motor programsProg. Neurobiol. 50 381CrossRef Google Scholar PubMed

Miyashita, Y.Chang, H. S. 1988 Neuronal correlate of pictorial short-term memory in the primate temporal cortexNature 331 68CrossRef Google Scholar PubMed

Montague, P. R.Dayan, P.Sejnowski, T. J. 1997 A framework for mesencephalic dopamine systems based on predictive Hebbian learningJ. Neurosci. 16 1936CrossRef Google Scholar

Moustafa, A. A.Cohen, M. X.Sherman, S. J.Frank, M. J. 2008 A role for dopamine in temporal decision making and reward maximization in ParkinsonismJ. Neurosci. 28 12294CrossRef Google Scholar PubMed

Munakata, Y.O’Reilly, R. C. 2003 Developmental and computational neuroscience approaches to cognition: the case of generalizationCogn. Stud. 10 76Google Scholar

Newell, A. 1990 Unified Theories of CognitionCambridge, MAHarvard University PressGoogle Scholar

O’Reilly, R. C. 1996 Biologically plausible error-driven learning using local activation differences: the generalized recirculation algorithmNeural Comput. 8 895CrossRef Google Scholar

O’Reilly, R. C. 2006 Biologically based computational models of high level cognitionScience 314 91CrossRef Google Scholar PubMed

O’Reilly, R. C.Braver, T. S.Cohen, J. D. 1999 A biologically based computational model of working memoryModels of Working Memory: Mechanisms of Active Maintenance and Executive ControlMiyake, A.Shah, P.New YorkCambridge University Press375CrossRef Google Scholar

O’Reilly, R. C.Frank, M. J. 2006 Making working memory work: a computational model of learning in the prefrontal cortex and basal gangliaNeural Comput. 18 283CrossRef Google Scholar PubMed

O’Reilly, R. C.Frank, M. J.Hazy, T. EWatz, B. 2007 PVLV: The primary value and learned value Pavlovian learning algorithmBehav. Neurosci. 121 31CrossRef Google Scholar PubMed

O’Reilly, R. C.Munakata, Y. 2000 Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the BrainCambridge, MAThe MIT PressGoogle Scholar

O’Reilly, R. C.Noelle, D. C.Braver, T. S.Cohen, J. D. 2002 Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory controlCereb. Cortex 12 246CrossRef Google Scholar PubMed

Pauli, W. M.Atallah, H. E.O’Reilly, R. C. 2010 Integrating what and how/where with instrumental and Pavlovian learning: a biologically-based computational modelCognition and Neuropsychology: International Perspectives on Psychological ScienceFrensch, P. A.Schwarzer, R.OxfordPsychology PressGoogle Scholar

Pauli, W. M.Hazy, T. E.O’Reilly, R. C. 2009

Prescott, T. J.Montes, F. M.Gonzalez, Gurney, K.Humphries, M. D.Redgrave, P. 2006 A robot model of the basal ganglia: behavior and intrinsic processingNeural Networks 19 31CrossRef Google Scholar PubMed

Pucak, M. L.Levitt, J. BLund, J. SLewis, D. A. 1997 Patterns of intrinsic and associational circuitry in monkey prefrontal cortexJ. Compar. Neurol. 376 6143.0.CO;2-4>CrossRef Google Scholar

Redgrave, P.Prescott, T. J.Gurney, K. 1999 The basal ganglia: a vertebrate solution to the selection problemNeuroscience 89CrossRef Google Scholar PubMed

Rescorla, R. A.Wagner, A. R. 1972 A theory of Pavlovian conditioning: variation in the effectiveness of reinforcement and non-reinforcementClassical Conditioning II: Theory and ResearchBlack, A. H.Prokasy, W. FNew YorkAppleton-Century-Crofts64Google Scholar

Reynolds, J. RO’Reilly, R. C. 2009 Developing PFC representations using reinforcement learningCognition 113 201CrossRef Google Scholar PubMed

Rougier, N. P.Noelle, D.Braver, T. S.Cohen, J. D.O’Reilly, R. C. 2005 Prefrontal cortex and the flexibility of cognitive control: rules without symbolsProc. Nat. Acad. Sci. 102 7338CrossRef Google Scholar

Rougier, N. P.O‘Reilly, R. C. 2002 Learning representations in a gated prefrontal cortex model of dynamic task switchingCogn. Sci. 26 503CrossRef Google Scholar

Sakagami, M.Pan, X.Uttl, B. 2006 Behavioral inhibition and prefrontal cortex in decision-makingNeural Networks 19 1255CrossRef Google Scholar PubMed

Schultz, W. 1998 Predictive reward signal of dopamine neuronsJ. Neurophysiol. 80CrossRef Google Scholar PubMed

Schultz, W.Apicella, P.Ljungberg, T. 1993 Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response taskJ. Neurosci. 13 900CrossRef Google Scholar PubMed

Schultz, W.Romo, R.Ljungberg, T. 1995 Reward-related signals carried by dopamine neuronsModels of Information Processing in the Basal, GangliaHouk, J. C.Davis, J. L.Beiser, D. G.Cambridge, MAMIT Press233Google Scholar

Seamans, J. K.Yang, C. R. 2004 The principal features and mechanisms of dopamine modulation in the prefrontal cortexProg. Neurobiol. 74 1CrossRef Google Scholar PubMed

Shallice, T. 1988 From Neuropsychology to Mental StructureNew YorkCambridge University PressCrossRef Google Scholar

Stafford, T.Gurney, K. N. 2007 Biologically constrained action selection improves cognitive control in a model of the Stroop taskPhil. Trans. Roy. Soc. B. Biol. Sci. 362 1671CrossRef Google Scholar

Stalnaker, T. A.Franz, T. M.Singh, T.Schoenbaum, G. 2007 Basolateral amygdala lesions abolish orbitofrontal dependent reversal impairmentsNeuron 54 51CrossRef Google Scholar PubMed

Sternberg, S. 1966 High speed scanning in human memoryScience 153 652CrossRef Google Scholar PubMed

Suri, R. E.Bargas, J.Arbib, M. A. 2001 Modeling functions of striatal dopamine modulation in learning and planningNeuroscience 103 65CrossRef Google Scholar PubMed

Sutton, R. S. 1988 Learning to predict by the method of temporal differencesMach. Learn. 3 9CrossRef Google Scholar

Sutton, R. S.Barto, A. G. 1998 Reinforcement Learning: An IntroductionCambridge, MAMIT PressGoogle Scholar

Tanaka, S. 2002 Dopamine controls fundamental cognitive operations of multi-target spatial working memoryNeural Networks 15 573CrossRef Google Scholar PubMed

Tanji, J.Hoshi, E. 2008 Role of the lateral prefrontal cortex in executive behavioral controlPhysiol. Rev 88 37CrossRef Google Scholar PubMed

Todd, M. T.Niv, Y.Cohen, J. D. 2008 Learning to use working memory in partially observable environments through dopaminergic reinforcementAdvances in Neural Information Processing Systems (NIPS) 21Koller, D.Norwich, UKCurran AssociatesGoogle Scholar

Waltz, J. A.Frank, M. J.Robinson, B. M.Gold, J. M. 2007 Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunctionBiol. Psych. 62 756CrossRef Google Scholar PubMed

Wang, X. J. 1999 Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memoryJ. Neurosci. 19CrossRef Google Scholar PubMed

Wickens, J. 1993 A Theory of the StriatumOxfordPergamon PressGoogle Scholar

Wickens, J. R.Kotter, R.Alexander, M. E. 1995 Effects of local connectivity on striatal function: simulation and analysis of a modelSynapse 20 281CrossRef Google Scholar PubMed

Widrow, B.Hoff, M. E. 1960

Wise, S. P. 2008 Forward frontal fields: phylogeny and fundamental functionTrends Neurosci. 31 599CrossRef Google Scholar PubMed

Wood, J. N.Grafman, J. 2003 Human prefrontal cortex: processing and representational perspectivesNature Rev. Neurosci. 4 139CrossRef Google Scholar PubMed

Yeung, N.Botvinick, M. M.Cohen, J. D. 2004 The neural basis of error detection: conflict monitoring and the error-related negativityPsychol. Rev. 111 931CrossRef Google Scholar PubMed

Zipser, D. 1991 Recurrent network model of the neural mechanism of shortterm active memoryNeural Comput. 3 179CrossRef Google Scholar

Accessibility standard: Unknown

Accessibility compliance for the PDF of this book is currently unknown and may be updated in the future.