Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-ndmmz Total loading time: 0 Render date: 2024-05-03T18:03:00.936Z Has data issue: false hasContentIssue false

9 - Introduction to Part II: computational neuroscience models

from Part II - Computational neuroscience models

Published online by Cambridge University Press:  05 November 2011

Anil K. Seth
Affiliation:
University of Sussex
Tony J. Prescott
Affiliation:
University of Sheffield
Joanna J. Bryson
Affiliation:
University of Bath
Get access

Summary

A central and largely unsolved problem in the brain sciences is to understand the functional architecture of the vertebrate nervous system. Many questions about this architecture revolve around the issue of action selection. Because it is a fundamental property of neurons to be selective with regard to the patterns of input activity to which they respond, claims that particular brain subsystems are specifically or preferentially involved in the selection of action, as distinct to other aspects of control, must meet more stringent requirements (see below). It is also by no means inevitable that the functional decomposition of the brain will contain specialist action-selection mechanisms (see Seth, this volume). Appropriate behavioural switching could be a global property of nervous system function, and of its embedding in a body and environment, that cannot be attributed to specific subcomponents of brain architecture. In other words, it is plausible that an animal may ‘flip’ from one integrated pattern of behavioural output to another without some identifiable internal ‘switch’ being thrown. On the other hand, theoretical arguments can be presented, based for instance on the benefits that accrue from modularity (Bryson, 2005; Prescott et al., 1999; Wagner and Altenberg, 1996), to suggest that biological control systems may include specialised action-selection components. Hence, one important debate in this field is whether there are specialised mechanisms for action selection in animal nervous systems, and, if so, where these might be found (see also Prescott, 2007, for an evolutionary perspective on this question).

Neural substrates for action selection in cortico-basal ganglia loops

Redgrave et al. (1999) have proposed that, to be considered as a candidate action-selection mechanism, a neural subsystem should exhibit the following properties. First, it should have inputs that carry information about both internal and external cues relevant to decision making. Second, there should be some internal mechanism that allows calculation of the urgency or ‘salience’ that should be attached to each available action. Third, there should be mechanisms that allow for the resolution of conflicts between competing actions based on their relative salience. Finally, the outputs of the system should be configured so as to allow the expression of winning actions whilst disallowing losers. There is now a growing consensus in the neuroscience literature that the basal ganglia – a group of functionally related structures found in the mid- and forebrain of all vertebrates – meet these criteria and therefore may represent an important neural action-selection substrate.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Barto, A. GMahadevan, S 2003 Recent advances in hierarchical reinforcement learningDiscrete Event Dyn. S 13 341CrossRefGoogle Scholar
Bryson, J 2000 Cross-paradigm analysis of autonomous agent architectureJ. Exp. Theor. Artif. In 12 165CrossRefGoogle Scholar
Bryson, J. J 2005 Modular representations of cognitive phenomena in AI, psychology, and neuroscienceVisions of Mind: Architectures of Cognition and AffectDavis, D. NHershey, PAIdea Group Publishing,66CrossRefGoogle Scholar
Butler, A. BHodos, W 1996 Comparative Vertebrate NeuroanatomyNew YorkWiley-LissGoogle Scholar
Cohen, J. DDunbar, KMcClelland, J. L 1990 On the control of automatic processes: a parallel distributed processing account of the Stroop effectPsychol. Rev 97 332CrossRefGoogle ScholarPubMed
Elman, J 1990 Finding structure in timeCogn. Sci 14 179CrossRefGoogle Scholar
Gurney, KPrescott, T. JRedgrave, P 2001 A computational model of action selection in the basal ganglia. I. A new functional anatomyBiol. Cybern 84 401CrossRefGoogle ScholarPubMed
Gurney, KPrescott, T. JWickens, JRedgrave, P 2004 Computational models of the basal ganglia: from membranes to robotsTrends Neurosci 27 453CrossRefGoogle ScholarPubMed
Humphries, M. DGurney, KPrescott, T. J 2006 The brainstem reticular formation is a small-world, not scale-free, networkProc. Soc. Roy. Soc. B. Biol. Sci 273 503CrossRefGoogle Scholar
Kilmer, W. LMcCulloch, W. SBlum, J 1969 A model of the vertebrate central command systemInt. J. Man. Mach. Stud 1 279CrossRefGoogle Scholar
McHaffie, J. GStanford, T. RStein, B. ECoizet, VRedgrave, P 2005 Subcortical loops through the basal gangliaTrends Neurosci 28 401CrossRefGoogle ScholarPubMed
Miller, E. KCohen, J. D 2001 An integrative theory of prefrontal cortex functionAnnu. Rev. Neurosci 27 167CrossRefGoogle Scholar
O’Reilly, R. CFrank, M. J 2006 Making working memory work: a computational model of learning in the prefrontal cortex and basal gangliaNeural Computation 18 283CrossRefGoogle ScholarPubMed
Prescott, T. J 2007 Forced moves or good tricks? Landmarks in the evolution of neural mechanisms for action selectionAdapt. Behav 15 9CrossRefGoogle Scholar
Prescott, T. JRedgrave, PGurney, K. N 1999 Layered control architectures in robots and vertebratesAdapt. Behav 7 99CrossRefGoogle Scholar
Redgrave, PPrescott, TGurney, K. N 1999 The basal ganglia: a vertebrate solution to the selection problem?Neuroscience 89 1009CrossRefGoogle ScholarPubMed
Wagner, G. PAltenberg, L 1996 Perspective: complex adaptations and the evolution of evolvabilityEvolution 50 967CrossRefGoogle ScholarPubMed
Watts, D. JStrogatz, S. H 1998 Collective dynamics of ‘small-world’ networksNature 393 440CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×