Tải bản đầy đủ - 0 (trang)
1 Automatic and Controlled Processes: A Historical View

1 Automatic and Controlled Processes: A Historical View

Tải bản đầy đủ - 0trang


B.D. Devan et al.

Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex

of rats. Cereb Cortex 13(4):400–408

Kim H, Lee D, Jung MW (2013) Signals for previous goal choice persist in the dorsomedial, but

not dorsolateral striatum of rats. J Neurosci 33(1):52–63

Kimura M (1986) The role of primate putamen neurons in the association of sensory stimuli with

movement. Neurosci Res 3(5):436–443

Kimura M (1995) Role of basal ganglia in behavioral learning. Neurosci Res 22(4):353–358

Kimura M, Aosaki T, Hu Y et al (1992) Activity of primate putamen neurons is selective to the

mode of voluntary movement: visually guided, self-initiated or memory-guided. Exp Brain Res


Kimura M, Aosaki T, Ishida A (1993) Neurophysiological aspects of the differential roles of the

putamen and caudate nucleus in voluntary movement. Adv Neurol 60:62–70

Kosaki Y, Dickinson A (2010) Choice and contingency in the development of behavioral autonomy during instrumental conditioning. J Exp Psychol Anim Behav Process 36(3):334–342

Krebs MO, Trovero F, Desban M et al (1991) Distinct presynaptic regulation of dopamine release

through NMDA receptors in striosome- and matrix-enriched areas of the rat striatum. J Neurosci


Krushel LA, Fishell G, van der Kooy D (1995) Pattern formation in the mammalian forebrain:

striatal patch and matrix neurons intermix prior to compartment formation. Eur J Neurosci


Lee SW, Shimojo S, O’Doherty JP (2014) Neural computations underlying arbitration between

model-based and model-free learning. Neuron 81(3):687–699

Lidsky TI, Schneider JS (1994) Effects of experience on striatal sensory responses. Neurosci Lett


López-Figueroa MO, Ramirez-Gonzalez JA, Divac I (1995) Projections from the visual areas to

the neostriatum in rats. A re-examination. Acta Neurobiol Exp (Wars) 55(3):165–175

Lucantonio F, Capriol D, Schoenbaum G (2014) Transition from ‘model-based’ to ‘model-free’

behavioral control in addiction: involvement of the orbitofrontal cortex and dorsolateral striatum. Neuropharmacology 76:407–415

Maguire EA, Burgess N, Donnett JG et al (1998) Knowing where and getting there: a human navigation network. Science 280(5365):921–924

Maguire EA, Burgess N, O’Keefe J (1999) Human spatial navigation: cognitive maps, sexual

dimorphism, and neural substrates. Curr Opin Neurobiol 9(2):171–177

Marr D (1982) Vision. W.H. Freeman, San Francisco

Marsden CD (1980) The enigma of the basal ganglia and movement. Trends Neurosci 3:284–287

Marsden CD (1981) Motor activity and the outputs of the basal ganglia. Trends Neurosci


Marsden CD (1982) The mysterious motor function of the basal ganglia: the Robert Wartenberg

Lecture. Neurology 32(5):514–539

Marsden CD, Olanow CW (1998) The causes of Parkinson’s disease are being unraveled and

rational neuroprotective therapy is close to reality. Ann Neurol 44:S189–S196

May PJ, McHaffie JG, Stanford TR et al (2009) Tectonigral projections in the primate: a pathway

for pre-attentive sensory input to midbrain dopaminergic neurons. Eur J Neurosci


McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning

task activate human striatum. Neuron 38(2):339–346

McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience.

Trends Neurosci 26(8):423–428

McDannald MA, Lucantonio F, Burke KA et al (2011) Ventral striatum and orbitofrontal cortex are

both required for model-based, but not model-free, reinforcement learning. J Neurosci


McDonald RJ (2002) Multiple combinations of co-factors produce variants of age-related cognitive decline: a theory. Can J Exp Psychol 56(3):221–239


Cognitive and Stimulus–Response Habit Functions of the Neo- (Dorsal) Striatum


McDonald RJ, Hong NS (2004) A dissociation of dorso-lateral striatum and amygdala function on

the same stimulus-response habit task. Neuroscience 124(3):507–513

McDonald RJ, White NM (1993) A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav Neurosci 107(1):3–22

McDonald RJ, White NM (1994) Parallel information processing in the water maze: evidence for

independent memory systems involving dorsal striatum and hippocampus. Behav Neural Biol


McDonald RJ, White NM (2013) A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav Neurosci 127(6):835–853

McDonald RJ, Devan BD, Hong NS (2004a) Multiple memory systems: the power of interactions.

Neurobiol Learn Mem 82(3):333–346

McDonald RJ, Hong NS, Devan BD (2004b) The challenges of understanding mammalian cognition and memory-based behaviors: an interactive learning and memory systems approach.

Neurosci Biobehav Rev 28(7):719–745

McDonald RJ, Hong NS, Craig LA et al (2005) NMDA-receptor blockade by CPP impairs posttraining consolidation of a rapidly acquired spatial representation in rat hippocampus. Eur

J Neurosci 22(5):1201–1213

McDonald RJ, King AL, Wasiak TD et al (2007) A complex associative structure formed in the

mammalian brain during acquisition of a simple visual discrimination task: dorsolateral striatum, amygdala, and hippocampus. Hippocampus 17(9):759–774

McGeorge AJ, Faull RL (1987) The organization and collateralization of corticostriate neurones in

the motor and sensory cortex of the rat brain. Brain Res 423(1-2):318–324

McGeorge AJ, Faull RL (1989) The organization of the projection from the cerebral cortex to the

striatum in the rat. Neuroscience 29(3):503–537

Mcgrayne SB (2011) The theory that would not die. Yale University Press, New Haven & London

McNaughton BL, Battaglia FP, Jensen O et al (2006) Path integration and the neural basis of the

‘cognitive map’. Nat Rev Neurosci 7(8):663–678

Mishkin M, Petri HL (1984) Memories and habits: some implications for the analysis of learning

and retention. In: Squire LR, Butters N (eds) Neuropsychology of memory. Guilford Press,

New York, pp 287–296

Mishkin M, Malamut B, Bachevalier J (1984) Memories and habits: two neural systems. In: Lynch

G, McGaugh JL, Weinberger NM (eds) Neurobiology of learning and memory. Guilford Press,

New York, pp 65–77

Nastuk MA, Graybiel AM (1985) Patterns of muscarinic cholinergic binding in the striatum and

their relation to dopamine islands and striosomes. J Comp Neurol 237(2):176–194

Nauta HJ (1979) A proposed conceptual reorganization of the basal ganglia and telencephalon.

Neuroscience 4(12):1875–1881

Nelson A, Killcross S (2006) Amphetamine exposure enhances habit formation. J Neurosci


Niv Y, Daw ND, Joel D et al (2007) Tonic dopamine: opportunity costs and the control of response

vigor. Psychopharmacology (Berl) 191(3):507–520

Öberg RGE, Divac I (1979) ‘Cognitive’ functions of the neostriatum. In: Divac I, Öberg RGE (eds)

The neostriatum. Pergamon Press, Oxford, pp 291–313

Öberg RGE, Divac I (1981) The basal ganglia and the control of movement. Levels of motor planning: cognition and the control of movement. Trends Neurosci 4:122–124

Olson L, Seiger A, Fuxe K (1972) Heterogeneity of striatal and limbic dopamine innervation:

highly fluorescent islands in developing and adult rats. Brain Res 44(1):283–288

Otto AR, Gershman SJ, Markman AB et al (2013a) The curse of planning: dissecting multiple

reinforcement-learning systems by taxing the central executive. Psychol Sci 24(5):751–761

Otto AR, Raio CM, Chiang A et al (2013b) Working-memory capacity protects model-based learning from stress. Proc Natl Acad Sci U S A 110(52):20941–20946

Otto AR, Skatova A, Madlon-Kay S et al (2015) Cognitive control predicts use of model-based

reinforcement learning. J Cogn Neurosci 27(2):319–333


B.D. Devan et al.

Packard MG, Hirsh R, White NM (1989) Differential effects of fornix and caudate nucleus lesions

on two radial maze tasks: evidence for multiple memory systems. J Neurosci 9(5):1465–1472

Parent A (1986) Comparative neurobiology of the basal ganglia. Wiley, New York

Parent A (1990) Extrinsic connections of the basal ganglia. Trends Neurosci 13(7):254–258

Paxinos G, Watson C (2014) The rat brain in stereotaxic coordinates, 7th edn. Academic, San


Pellegrino LJ, Cushman AJ (1967) Stereotaxic atlas of the rat brain. Appleton, New York

Pert CB, Kuhar MJ, Snyder SH (1976) Opiate receptor: autoradiographic localization in rat brain.

Proc Natl Acad Sci U S A 73(10):3729–3733

Petri HL, Mishkin M (1994) Behaviorism, cognitivism and the neuropsychology of memory. Am

Sci 82:30–37

Quirk GJ, Russo GK, Barron JL et al (2000) The role of ventromedial prefrontal cortex in the

recovery of extinguished fear. J Neurosci 20(16):6225–6231

Redgrave P, Coizet V, Comoli E et al (2010) Interactions between the midbrain superior colliculus

and the basal ganglia. Front Neuroanat 4:1–8

Rolls ET (1992) Neurophysiological analysis of striatal function. In: Vallar G, Capra SF, Wallesch

CW (eds) Neuropsychological disorders associated with subcortical lesions. Oxford University

Press, Oxford, pp 61–97

Rolls ET (1994) Neurophysiology and cognitive functions of the striatum. Rev Neurol (Paris)


Romo R, Scarnati E, Schultz W (1992) Role of primate basal ganglia and frontal cortex in the

internal generation of movements. II. Movement-related activity in the anterior striatum. Exp

Brain Res 91(3):385–395

Rosa-Neto P, Doudet DJ, Cumming P (2004) Gradients of dopamine D1- and D2/3-binding sites

in the basal ganglia of pig and monkey measured by PET. Neuroimage 22(3):1076–1083

Schad DJ, Jünger E, Sebold M, Garbusow M, Bernhardt N, Javadi AH, Huys QJ (2014) Processing

speed enhances model-based over model-free reinforcement learning in the presence of high

working memory functioning. Front Psychol 5

Schoenbaum G, Setlow B (2005) Cocaine makes actions insensitive to outcomes but not extinction: implications for altered orbitofrontal–amygdalar function. Cereb Cortex


Schultz W (1995) The primate basal ganglia between the intention and outcome of action. In: Kimura

M, Graybiel AM (eds) Functions of the cortico-basal ganglia loop. Springer, Japan, pp 31–48

Schultz W, Romo R (1992) Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum. Exp Brain Res


Selemon LD, Goldman-Rakic PS (1985) Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5(3):776–794

Shah A, Barto AG (2009) Effect on movement selection of an evolving sensory representation: a

multiple controller model of skill acquisition. Brain Res 1299:55–73

Skatova A, Chan PA, Daw ND (2013) Extraversion differentiates between model-based and

model-free strategies in a reinforcement learning task. Front Hum Neurosci 7(525):1–10

Skelin I, Hakstol R, VanOyen J et al (2014) Lesions of dorsal striatum eliminate lose-switch

responding but not mixed-response strategies in rats. Eur J Neurosci 39(10):1655–1663

Smith AD, Bolam JP (1990) The neural network of the basal ganglia as revealed by the study of

synaptic connections of identified neurones. Trends Neurosci 13(7):259–265

Smittenaar P, FitzGerald TH, Romei V et al (2013a) Disruption of dorsolateral prefrontal cortex

decreases model-based in favor of model-free control in humans. Neuron 80(4):914–919

Smittenaar P, Guitart-Masip M, Lutti A et al (2013b) Preparing for selective inhibition within

frontostriatal loops. J Neurosci 33(46):18087–18097

Snyder-Keller AM (1991) Development of striatal compartmentalization following pre- or postnatal dopamine depletion. J Neurosci 11(3):810–821

Stalnaker TA, Calhoon GG, Ogawa M et al (2010) Neural correlates of stimulus-response and

response-outcome associations in dorsolateral versus dorsomedial striatum. Front Integr

Neurosci 4(12):1–18


Cognitive and Stimulus–Response Habit Functions of the Neo- (Dorsal) Striatum


Stalnaker TA, Cooch NK, Schoenbaum G (2015) What the orbitofrontal cortex does not do. Nat

Neurosci 18(5):620–627

Suri RE, Bargas J, Arbib MA (2001) Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103(1):65–85

Sutherland RJ, Hamilton DA (2004) Rodent spatial navigation: at the crossroads of cognition and

movement. Neurosci Biobehav Rev 28(7):687–697

Sutton RS (1990) Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In: Proceedings of the seventh international conference on

machine learning, pp 216–224

Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge

Swanson LW (1995) Mapping the human brain: past, present, and future. Trends Neurosci


Swanson L (2004) Brain maps: structure of the rat brain, vol 363, 3rd edn. Academic, London

Swanson LW (2012) Brain architecture: understanding the basic plan, 2nd edn. Oxford University

Press, New York

Takahashi YK, Roesch MR, Wilson RC et al (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14(12):1590–1597

Tennyson VM, Barrett RE, Cohen G et al (1972) The developing neostriatum of the rabbit: correlation of fluorescence histochemistry, electron microscopy, endogenous dopamine levels, and

(3H) dopamine uptake. Brain Res 46:251–285

Thompson RF (2013) An essential memory trace found. Behav Neurosci 127(5):669–675

Thorn CA, Atallah H, Howe M et al (2010) Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66(5):781–795

Tolman EC (1932) Purposive behavior in animals and man. Appleton, New York

Tolman EC (1949) The nature and functioning of wants. Psychol Rev 56(6):357–369

Tolman EC, Ritchie BF, Kalish D (1946) Studies in spatial learning; place learning versus response

learning. J Exp Psychol 36:221–229

Tricomi E, Balleine BW, O’Doherty JP (2009) A specific role for posterior dorsolateral striatum in

human habit learning. Eur J Neurosci 29(11):2225–2232

van der Kooy D, Fishell G (1987) Neuronal birthdate underlies the development of striatal compartments. Brain Res 401(1):155–161

van der Kooy D, Fishell G (1992) Embryonic lesions of the substantia nigra prevent the patchy

expression of opiate receptors, but not the segregation of patch and matrix compartment neurons, in the developing rat striatum. Brain Res Dev Brain Res 66(1):141–145

van der Meer MA, Johnson A, Schmitzer-Torbert NC, Redish AD (2010) Triple dissociation of

information processing in dorsal striatum, ventral striatum, and hippocampus on a learned

spatial decision task. Neuron 67(1):25–32

Van Vulpen EH, Van Der Kooy D (1996) Differential maturation of cholinergic interneurons in the

striatal patch versus matrix compartments. J Comp Neurol 365(4):683–691

Voon V, Derbyshire K, Ruck C et al (2015) Disorders of compulsivity: a common bias towards

learning habits. Mol Psychiatry 20(3):345–352

Voorn P, Vanderschuren LJ, Groenewegen HJ (2004) Putting a spin on the dorsal-ventral divide of

the striatum. Trends Neurosci 27(8):468–474

Webster KE (1979) Some aspects of the comparative study of the corpus striatum. In: Divac I,

Öberg RGE (eds) The neostriatum. Pergamon Press, Oxford, pp 107–126

White NM (2009) Some highlights of research on the effects of caudate nucleus lesions over the

past 200 years. Behav Brain Res 199(1):3–23

White NM, McDonald RJ (2002) Multiple parallel memory systems in the brain of the rat.

Neurobiol Learn Mem 77(2):125–184

White IM, Rebec GV (1993) Responses of rat striatal neurons during performance of a leverrelease version of the conditioned avoidance response task. Brain Res 616(1-2):71–82

White NM, Packard MG, McDonald RJ (2013) Dissociation of memory systems: the story unfolds.

Behav Neurosci 127(6):813–834

Wied HM, Jones JL, Cooch NK et al (2013) Disruption of model-based behavior and learning by

cocaine self-administration in rats. Psychopharmacology (Berl) 229(3):493–501


B.D. Devan et al.

Wilson AG, Pizzo MJ, Crystal JD (2013) Event-based prospective memory in the rat. Curr Biol


Wise SP (1991) A brief history of the basal ganglia. In: Carroll BJ, Barrett JE (eds) Psychopathology

and the brain. Raven, New York, pp 45–63

Wolpert DM (2014) Computations in sensorimotor learning. Cold Spring Harb Symp Quant Biol


Woolley DG, Mantini D, Coxon JP et al (2015) Virtual water maze learning in human increases

functional connectivity between posterior hippocampus and dorsal caudate. Hum Brain Mapp


Wouterlood FG, Hartig W, Groenewegen HJ et al (2012) Density gradients of vesicular glutamateand GABA transporter-immunoreactive boutons in calbindinand mu-opioid receptor-defined

compartments in the rat striatum. J Comp Neurol 520(10):2123–2142

Wunderlich K, Dayan P, Dolan RJ (2012a) Mapping value based planning and extensively trained

choice in the human brain. Nat Neurosci 15(5):786–791

Wunderlich K, Smittenaar P, Dolan RJ (2012b) Dopamine enhances model-based over model-free

choice behavior. Neuron 75(3):418–424

Yahr MD (1976) The basal ganglia. Raven, New York

Yin HH, Knowlton BJ, Balleine BW (2004) Lesions of dorsolateral striatum preserve outcome

expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci


Yin HH, Ostlund SB, Knowlton BJ et al (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22(2):513–523

Yin HH, Mulcare SP, Hilario MR et al (2009) Dynamic reorganization of striatal circuits during the

acquisition and consolidation of a skill. Nat Neurosci 12(3):333–341

Zelinski EL, Hong NS, Tyndall AV et al (2010) Prefrontal cortical contributions during discriminative fear conditioning, extinction, and spontaneous recovery in rats. Exp Brain Res


Zilli EA, Hasselmo ME (2008) Modeling the role of working memory and episodic memory in

behavioral tasks. Hippocampus 18(2):193–209

Chapter 19

Neural Dynamics of the Basal Ganglia During

Perceptual, Cognitive, and Motor Learning

and Gating

Stephen Grossberg

19.1  Introduction

19.1.1  L

 inking Brain to Mind with Neural Models: Method

of Minimal Anatomies

The rapid development of behavioral and cognitive neuroscience parallels the growing interest in mechanistically linking brain mechanisms to behavioral functions.

Expressed in another way, this interest asks: How can a brain gives rise to a mind?

How can the classical Mind/Body Problem be solved? The remarkable experimental

and theoretical progress in understanding brain or mind in the fields of neuroscience

and psychology has not often provided clear mechanistic links between them, if

only because mind is an emergent property that arises from widespread interactions

among multiple brain regions, and experimental methods can probe the detailed

structure of such interactions only partially. Yet establishing such a linkage between

brain and mind is crucial in any mature theory of how a brain or mind works.

Without such a link, the mechanisms of the brain have no functional significance,

and the functions of behavior have no mechanistic explanation.

In order to establish such a link with sufficient clarity for it to be scientifically

predictive, rigorous mathematical models are needed that can simultaneously

describe multiple levels of brain and behavioral organization. A rapidly growing

number of such models can now quantitatively simulate the neurophysiologically

recorded dynamics of identified nerve cells in known anatomies and the behaviors

that they control. Many predictions of these models have also been supported by

S. Grossberg, Ph.D. (*)

Center for Adaptive Systems, Graduate Program in Cognitive and Neural Systems,

Department of Mathematics, Boston University, 677 Beacon Street, Boston, MA 02215, USA

e-mail: steve@bu.edu

© Springer International Publishing Switzerland 2016

J.-J. Soghomonian (ed.), The Basal Ganglia, Innovations in Cognitive

Neuroscience, DOI 10.1007/978-3-319-42743-0_19


Tài liệu bạn tìm kiếm đã sẵn sàng tải về

1 Automatic and Controlled Processes: A Historical View

Tải bản đầy đủ ngay(0 tr)