How does the brain translate information signaling potential rewards into motivation to get them? Motivation obtain reward is thought depend on midbrain [particularly ventral tegmental area (VTA)], nucleus accumbens (NAcc), and dorsolateral prefrontal cortex (dlPFC), but it not clear how interactions among these regions relate reward-motivated behavior. To study influence of reward-responsive their interactions, we used dynamic causal modeling analyze functional magnetic resonance imaging...

ORIGINAL RESEARCH article Front. Neurosci., 16 November 2011Sec. Decision Neuroscience volume 5 - 2011 | https://doi.org/10.3389/fnins.2011.00126

Impulsivity is a variable behavioral trait that depends on numerous factors. For example, increasing the absolute magnitude of available choice options promotes farsighted decisions. We argue this effect arises in part from differential exertion self-control as perceived importance increases. First, we demonstrated frontal executive-control areas were more engaged for difficult decisions and was enhanced high-magnitude rewards. Second, showed increased hunger, which associated with lower...

Animals rely on learned associations to make decisions. Associations can be based relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes rash). More often, are linked multidimensional states is green in summer but red spring). Feature-based reinforcement learning fails when values individual depend other present. One solution assign value multi-featural conjunctive representations. Here, we test if hippocampus forms separable representations that...

Anorexia nervosa is a severe eating disorder characterized by food restriction in service of future goal: thinness and weight loss. Prior work suggests altered intertemporal decision-making this disorder, with more farsighted decisions-i.e. reduced delay discounting-in patients acute anorexia nervosa. Future-oriented cognition, such as frequent prospective thinking daily life, promotes decision making. However, whether temporal orientation nervosa, potentially contributing to discounting...

Spatial variations in dopamine function are linked to cognition and substance use disorders but challenging characterize with current methods. Because influences blood vessel dilation, we hypothesized that hemodynamic latency, which reflects BOLD signal timing, could serve as an indirect marker of physiology. Across four datasets, found a topography latencies precisely distinguished the nucleus accumbens, dopaminergic region implicated motivation abuse, from other striatal regions. Using...

Novelty detection, a critical computation within the medial temporal lobe (MTL) memory system, necessarily depends on prior experience. The current study used functional magnetic resonance imaging (fMRI) in humans to investigate dynamic changes MTL activation and connectivity as experience with novelty accumulates. fMRI data were collected during target detection task: Participants monitored series of trial-unique novel familiar scene images detect repeating scene. Even though themselves did...

The mesolimbic dopamine system contributes to a remarkable variety of behaviors at multiple timescales. Midbrain neurons have fast and slow signaling components, specific afferent systems, such as the hippocampus (HPC) prefrontal cortex (PFC), been demonstrated drive these components in anesthetized animals. Whether interactions exist during behavior, however, is unknown. To address this question, we developed novel analysis human functional magnetic resonance imaging data that fits models...

Abstract Humans naturally group the world into coherent categories defined by membership rules. Rules can be learned implicitly building stimulus-response associations using reinforcement learning or explicit reasoning. We tested if striatum, in which activation reliably scales with reward prediction error, would track errors a task that required rule generation. Using functional magnetic resonance imaging during categorization task, we show striatal responses to feedback scale “surprise”...

Abstract Stimulus–response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at cost reduced flexibility to adapt when circumstances change. The goal-directed system is thought counteract habit providing pursue context-appropriate behaviors. dichotomy between habitual action and flexible has recently been challenged findings showing that rewards bias both goal selection. Here, we test whether reward reinforcement give rise much as...

People often learn from the outcomes of their actions, even when these do not involve material rewards or punishments. How does our brain provide this flexibility? We combined behavior, computational modeling, and functional neuroimaging to probe whether learning abstract novel harnesses same circuitry that supports familiar secondary reinforcers. Behavior revealed images can act as a substitute for during instrumental learning, producing reliable reward-like signals in dopaminergic...

Emotional states provide an ever-present source of contextual information that should inform behavioral goals. Despite the ubiquity emotional signals in our environment, neural mechanisms underlying their influence on goal-directed action remains unclear. Prior work suggests lateral frontal pole (FPl) is uniquely positioned to integrate affective into cognitive control representations. We used pattern similarity analysis examine content representations FPl and interconnected mid-lateral...

Impulsivity refers to the tendency insufficiently consider alternatives or overvalue rewards that are available immediately. is a hallmark of human decision making with well documented health and financial ramifications. Numerous contextual changes framing manipulations powerfully influence impulsivity. One most robust such phenomenon finding people more patient as values choice options increased. This magnitude effect has been related cognitive control mechanisms in dorsal lateral...

Preferences for novel stimuli tend to develop slowly over many exposures. Psychological accounts of this effect suggest that it depends on changes in the brain's valuation system. Participants consumed a fluid daily 10 days and underwent fMRI first last days. We hypothesized activation areas associated with dopamine system would accompany preference. The change ventral tegmental area (VTA) between sessions scaled preference change. Furthermore, network comprising sensory thalamus, posterior...

1 ABSTRACT Animals rely on learned associations to make decisions. Associations can be based relationships between object features (e.g., the three-leaflets of poison ivy leaves) and outcomes rash). More often, are linked multidimensional states is green in summer but red spring). Feature-based reinforcement learning fails when values individual depend other present. One solution assign value multifeatural conjunctive representations. We tested if hippocampus formed separable representations...

Abstract Background Reinforcement learning models provide excellent descriptions of in multiple species across a variety tasks. Many researchers are interested relating parameters reinforcement to neural measures, psychological variables or experimental manipulations. We demonstrate that parameter identification is difficult because range values approximately equal quality fits data. This problem has large impact on power: we show researcher who wants detect medium sized correlation ( r =...

ABSTRACT Humans naturally group the world into coherent categories defined by membership rules. Rules can be learned implicitly building stimulus-response associations using reinforcement learning (RL) or explicit reasoning. We tested if striatum, in which activation reliably scales with reward prediction error, would track errors a task that required rule generation. Using functional magnetic resonance imaging during categorization task, we show striatal responses to feedback scale...

Abstract Recent work has identified a critical role for the hippocampus in reward-sensitive behaviors, including motivated memory, reinforcement learning, and decision-making. Animal histology human functional neuroimaging have shown that brain regions involved reward processing motivation are more interconnected with ventral/anterior hippocampus. However, direct evidence examining gradients of structural connectivity between humans is lacking. The present study used diffusion MRI...

Abstract Anorexia Nervosa is a severe eating disorder characterized by food restriction in service of future goal: thinness and weight loss. Prior work suggests abnormal intertemporal decision-making anorexia, with more farsighted decisions observed patients acute anorexia. Prospective thinking daily life, or temporal orientation, promotes delay discounting. However, whether orientation altered underlies reduced discounting this population, remains unclear. Further, because changes could...

Abstract Recent work has identified a critical role for the hippocampus in reward‐sensitive behaviors, including motivated memory, reinforcement learning, and decision‐making. Animal histology human functional neuroimaging have shown that brain regions involved reward processing motivation are more interconnected with ventral/anterior hippocampus. However, direct evidence examining gradients of structural connectivity between humans is lacking. The present study used diffusion MRI (dMRI)...

ABSTRACT Both goal-directed and automatic processes shape human behavior. These often conflict, behavioral control is the decision about which determines Behavioral control, or deciding how to decide, critical for adaptive However, neural mechanisms underlying remain unclear. We performed deep phenotyping of individual dopamine system function by combining PET measures physiology, functional MRI, administration dopaminergic drugs in a within-subject, double-blind, placebo-controlled design....