Figures
Abstract
To function during social interactions, we must be able to consider and coordinate our actions with other people’s perspectives. This process unfolds from decision-making, to anticipation of that decision’s consequences, to feedback about those consequences, in what can be described as a “cascade” of three phases. The iterated Prisoner’s Dilemma (iPD) task, an economic-exchange game used to illustrate how people achieve stable cooperation over repeated interactions, provides a framework for examining this “social decision cascade”. In the present study, we examined neural activity associated with the three phases of the cascade, which can be isolated during iPD game rounds. While undergoing functional magnetic resonance imaging (fMRI), 31 adult participants made a) decisions about whether to cooperate with a co-player for a monetary reward, b) anticipated the co-player’s decision, and then c) learned the co-player’s decision. Across all three phases, participants recruited the temporoparietal junction (TPJ) and the dorsomedial prefrontal cortex (dmPFC), regions implicated in numerous facets of social reasoning such as perspective-taking and the judgement of intentions. Additionally, a common distributed neural network underlies both decision-making and feedback appraisal; however, differences were identified in the magnitude of recruitment between both phases. Furthermore, there was limited evidence that anticipation following the decision to defect evoked a neural signature that is distinct from the signature of anticipation following the decision to cooperate. This study is the first to delineate the neural substrates of the entire social decision cascade in the context of the iPD game.
Citation: Thompson K, Nahmias E, Fani N, Kvaran T, Turner J, Tone E (2021) The Prisoner’s Dilemma paradigm provides a neurobiological framework for the social decision cascade. PLoS ONE 16(3): e0248006. https://doi.org/10.1371/journal.pone.0248006
Editor: Jun Tanimoto, Kyushu Daigaku, JAPAN
Received: December 31, 2020; Accepted: February 17, 2021; Published: March 18, 2021
Copyright: © 2021 Thompson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by: a National Science Foundation Graduate Research Fellowship [DGE-1550139] to K. Thompson, a GSU Brains & Behavior seed grant to E. Tone & E. Nahmias, the GSU/GA Tech Center for Advanced Brain Imaging grant to E. Tone & J. Turner, a National Institute of Health grant to J. Turner [NIH-5R01MH121246], as well as a 2CI Fellowship for Neuroimaging from GSU awarded to K. Thompson. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. https://nsf.gov/ https://www.nih.gov/ https://neuroscience.gsu.edu/brains-behavior/ http://www.cabiatl.com/CABI/.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Many of the consequential decisions people make in their day-to-day lives occur within social contexts. Social decision-making involves interdependency and mutual commitment; individuals must consider not only how possible outcomes will affect them, but also how those outcomes will affect other people with similar or conflicting needs and desires [1]. Functional magnetic resonance imaging (fMRI) studies that have modelled social interaction using the Prisoner’s Dilemma (PD) paradigm have typically targeted neural activity during isolated snapshots of the process of either making a decision or receiving feedback about one’s decision [2–6]. The unfolding of the interaction from decision-making, to the anticipation of outcome, to receiving feedback on one’s decision constitutes a “cascade” of events that may be better understood as a dynamic, cyclical flow of interdependent social phenomena. The purpose of the present paper is to provide an integrated picture of the neural mechanisms of the entire “social decision cascade”. Of note, we include the anticipatory process that occurs between decision-making and processing of outcome feedback, which has received minimal attention in the literature.
The PD task is an economic-exchange game that elicits distinct, quantifiable patterns of interaction (e.g., displays of pro-social, submissive, hostile or competitive behavior) in a structured context that models reciprocal altruism and strategic conflict [6, 7]. In this task, an individual and a social partner engage in a series of bilateral exchanges that can yield rewards or punishments, depending on the choices that each individual makes. Each exchange in the task constitutes a round that unfolds as a series of three phases. First, the participant makes a dichotomous decision (to cooperate with or defect from the other player), then the participant waits in anticipation of the outcome (whether the co-player chooses to cooperate or defect), and finally, the co-player’s response is revealed and the participant receives feedback regarding the monetary reward that results from the conjunction of the two players’ decisions.
The principles underlying the application of economic-exchange tasks to the study of social behavior stem from game theory, which describes how people navigate strategic interactions and bargaining scenarios while aiming to optimize or maximize their interests by selecting options that provide the greatest personal utility [8, 9]. However, the current literature indicates that game theory and rational decision-making models cannot completely account for all of human behavior when social norms, preferences, and situational context are taken into consideration [10, 11]. We hope that by delineating neural mechanisms of decision-making in this reciprocal exchange-based task we can help to further refine theoretical models that illustrate how humans adapt their behavior within diverse social contexts.
To date, at least 42 fMRI studies have used the PD task to characterize the neural correlates of social behavior during individual social decision-making phases (e.g., decision or feedback) in samples drawn from diverse populations. Of these 39 studies, 34 used the iterated format (iPD), which allows for repeated interaction with a co-player; the remaining eight used the one-shot format, in which a participant engages in only one round with different co-players. Of the 33 iPD studies that we located, only seven targeted healthy populations and developed hypotheses solely focused on the neural substrates of PD behavior and gameplay in healthy populations. The remainder focused on clinical populations or groups subjected to external environmental constraints such as the endorsement of social preference, priming about the reputation of co-players, and the administration of exogenous chemical substances (e.g., oxytocin or vasopressin). Therefore, we will direct our attention to these seven studies for neurobiological evidence of distinctive PD gameplay.
Four of these studies investigated the neural basis of social cooperation with human co-players [2, 3, 11, 12]. Findings from the earliest of these studies indicated that decision-making in the iPD game was associated with activity in the rostral anterior cingulate (rACC) and the caudate [2]. This study and two subsequent studies also found activity in two additional networks when participants received feedback about their co-player’s decision [2, 3, 12]. Co-player cooperation was positively correlated with activity in the orbitofrontal cortex, the rACC, and the ventral striatum [2, 12], both of which have been shown to respond during subjective valuation [13, 14]. In contrast, co-player defection was positively correlated with activity in the amygdala, anterior insula, ACC, and hippocampus [3, 12], a set of structures implicated in fear-based associative learning [15, 16].
The last study examined neural activity averaged across the entire iPD task rather than during isolated phases of decision-making [11], and focused on whether BOLD signals varied as a function of the co-player’s ostensible playing style. Gameplay with “cooperative” partners preferentially evoked activity in the valuation network. In contrast, gameplay against “competitive” partners (those with a greater tendency to defect) evoked activity in the temporoparietal junction (TPJ) and the precuneus, brain regions implicated in understanding others mental states and self-referential processing respectively [17, 18].
Given the increasing breadth of the iPD/neuroimaging literature, it is surprising that, to date, no study has analyzed brain function during anticipation of the outcome following decision-making in the iPD. Such analyses seem important, given evidence that prior expectations about the consequences of a decision can influence how an interaction progresses [19, 20]. Moreover, research examining gain or loss in monetary and social reward situations has yielded evidence of a possible anticipatory processing network that comprises the dorsomedial prefrontal cortex (dmPFC), the anterior mid cingulate [21], the anterior insula [22] and the striatum [23].
We defined anticipation in the context of this study, as the period of time between a decision and an incentivized outcome. This period of time, during which a person presumably generates expectations about the outcome, has been linked in cued response studies to “anticipatory affect”, which can encompass a broad spectrum of emotions [24]. Cued response studies allow for the examination of anticipation as an independent construct that is dissociated from, but still coupled with the decision-making process [25–27]. Cued response paradigms contrast with paradigms such as the mixed gamble task, in which anticipation and decision-making are modelled as a nondissociable combined unit [28–32].
The purpose of the current study was to characterize neural correlates of cognition and behavior during the decision-making, anticipation, and feedback phases of the iPD game in a healthy sample. We localized markers of neural activity in each phase and compared activity between phases. We predicted, based on previous findings that a network including the dmPFC, caudate, aMCC, and TPJ would activate preferentially during the decision-making phase of the task. Furthermore, a network spanning the vmPFC/OFC, rostral ACC/aMCC, TPJ, ventral striatum, anterior insula, amygdala and hippocampus would be significantly activated during processing of feedback. Although predictions about anticipation were necessarily more speculative due to the sparse literature on this topic, we predicted that the dmPFC, rostral ACC, the anterior insula and the striatum would show significant activation during the anticipation phase of the task.
Methods
Participants
The data for this study were drawn from two independent datasets. One set was collected at the Georgia State University/Georgia Tech Center for Advanced Brain Imaging (CABI) in 2016 and one was collected at the Emory University Biomedical Imaging Technology Center (BITC) in 2008. Both datasets were collected using identical behavioral paradigms and subject recruitment procedures.
The Georgia State University and Emory University Institutional Review Board (IRB) reviewed and approved the above referenced study in accordance with 45 CFR 46.111. The IRB has reviewed and approved the study and any informed consent forms, recruitment materials, and other research materials that are marked as approved in the application. Written informed consent was obtained for this study.
For the 2008 dataset, 19 subjects were scanned; however, usable data from only 14 subjects were available. Data for the remaining five subjects had been corrupted during storage and could not be recovered. Subjects were recruited from the GSU undergraduate psychology student pool via the SONA online questionnaire system. Participants were scanned at the Emory University BITC. For the 2016 dataset, 20 subjects were recruited using the methods from the 2008 study. All 20 were scanned at the CABI; however, data from only 17 subjects were usable (two subjects exited the study prematurely due to elevated anxiety and one subject failed to remain engaged with the task for substantial periods of scan time). In total, we had complete and usable data from 26 females and 5 males, with a mean age of 20.6 years (SD = 3.5 years; see Table 1 for detailed demographic comparisons of the datasets).
Experimental design
The experimental procedure was identical for the two datasets. Following consent, an examiner informed participants that they would play a 20-round game three times with different study participants via a wireless computer network. Confederates completed consent and training procedures with the actual participant, whom the examiner then selected from the group (apparently at random) to play the game in the scanner, while the others ostensibly played the game in separate rooms. During each of the three games that constituted a session, two players (the participant and a computerized co-player that the participant was deceived into believing was a real human) independently chose, during each of the 20 rounds, to cooperate with or not cooperate with each other. After both players submitted their choices, the outcome of the round appeared on the screen, along with a running total of each player’s cumulative earnings for a game. Periodically during and after the game, participants were asked (via the computer screen) about their perceptions of and predictions about their co-player’s intentions and goals, as well as about their own emotional responses during play and their levels of confidence in their predictions; these self-report data are not included in the present manuscript. A task overview, as well as timing information during scanning, is presented in S1 Fig.
At the end of the study session, in accordance with guidelines for ethically appropriate authorized deception [33], the examiner debriefed participants about the deception involved in the task and the motivation for its use. No participants expressed concerns. All subjects reported being deceived and thus their data were included in subsequent analyses (see S1 File).
Task design
In each 20-round iPD game [2] rounds proceeded as shown in Fig 1; the participant chose to cooperate or not cooperate, and then waited for a “co-player”, who independently decided to cooperate or to not cooperate (defect). The participant and co-player were equally rewarded (Reward payoff—R; $2) if both cooperated; if one player defected but the other cooperated, the betraying player received a reward (Temptation payoff–T; $3) while the cooperating player received nothing (Sucker’s Payoff–S; $0). If both chose to defect, both received a diminished reward (Punishment Payoff–P; $1) [34].
Each round comprises decision, anticipation, and feedback phases of the task. The participant’s choices are located on the left of the 2x2 payoff matrix while the co-players choices are located a the top of the matrix.
The monetary distributions depicted in Fig 1 are organized to conform to the universal scaling parameters for the PDG as an evolutionary dyadic game that promotes cooperation through a number of different reciprocity mechanisms [34–37]. In order to maintain universal dilemma strength in both limited and unlimited well-mixed populations and construct the necessary parametric constraints for the PDG, the gamble-intending dilemma (Dg’) and the risk-averting dilemma (Dr’) must be equal and greater than 0 such that: (Dg’ = (T-R)/(R-P)) and Dr’ = (P-S)/(R-P)) [34–37]. This generates a Donor & Recipient dilemma template where, given a single decision, defection is incentivized at no cost to the defector; however, given repeated interactions, cooperation is incentivized but at a cost to the cooperator, who risks betrayal and an omission of a reward for the current round [38].
All participants played three games—in two, they were deceived to believe that they were playing with a human confederate and shown a picture of that confederate before starting the game (but they actually played a computer algorithm) and in one they were told that they were playing a computer program. The order of the three games was randomized for each participant (see S2 File).
The participant was given up to six seconds to make a decision in each round. The decision was followed by a 3-, 6-, or 9-second jittered interstimulus interval which constituted the anticipation phase of the round. After the jitter period, feedback regarding the round outcome was presented for six seconds. See S3 File.
The 20-round game was split into four 5-round blocks, with an additional blank round included in each block. After every five rounds, the participant was given an indefinite amount of time to answer four questions (two about their feelings, two about their assessment of the co-player’s intentions) before beginning the next 5-round block. After the last 5-round block of the game, the participant answered four final emotional assessment questions and then viewed their total earnings for the game. After 12–20 seconds, the participants then answered 10 additional questions about their experience of play. Each game proceeded in this fashion. Participants were paid the average of the amount that they earned over the three games.
Out of the 40 rounds that each participant played with the “human” confederate, an average of 12 rounds resulted in mutual cooperation (CC); 6 resulted in unreciprocated cooperation (CD); 9 resulted in unreciprocated defection (DC); and 13 resulted in mutual defection (DD). Out of the 20 rounds played with the computer, an average of 4 rounds resulted in CC; 3 resulted in CD; 5 resulted in DC; and 8 resulted in DD. A contingency table detailing total frequencies of cooperate and defection for the human and computer games is displayed in Table 2.
Scanning procedure
2008 data.
The 2008 dataset was collected using a Siemens TIM Trio 3T MRI scanner equipped with a 12-channel head coil. E-Prime 1.1 was used to present task stimuli (Psychology Software Tools, Inc.). Participants recorded decisions to cooperate or defect using a hand-held, 4-button response box. A localizer and a manual shim procedure preceded each functional scan. A functional task-related blood-oxygen-level-dependent (BOLD) scan was acquired with a ZSAGA functional protocol. ZSAGA is a method for reducing the influence of susceptibility artifacts in echo planar imaging [34]. The number of volumes varied depending on time spent on task (participants spent variable amount of time completing emotional assessment questions); TR = 3,000 ms; TE 1 = 30 ms; TE 2 = 65.8ms; matrix size = 64 x 64mm; FA = 90°; 3.3 x 3.3x 3.3 mm3 voxels; 30 interleaved slices; FOV = 210 mm. A high-resolution anatomical image was also acquired using a T1-weighted standardized magnetization gradient echo sequence to aid spatial normalization (MPRAGE; sagittal plane; TR = 2300 ms; TE = 3.02 ms; matrix size = 256x256 mm, 1 mm3 isomorphic voxels, 176 interleaved slices; FOV = 256 mm; flip angle 8°).
2016 data.
The 2016 dataset was collected using a Siemens TIM Trio 3T MRI scanner equipped with a 12-channel head coil. E-Prime 2.0 was used to present the task stimuli (Psychology Software Tools, Inc.), and the responses were collected using a Current Designs MRI compatible button box. A localizer and a manual shim procedure preceded each functional scan. A functional task-related BOLD scan was acquired with a T2*-weighted echo-planar functional protocol (number of volumes vary depending time spent on task; TR = 2,000 ms; TE = 30 ms; matrix size = 64 x 64mm; FA = 77°; 3.4 x 3.4x 4.0 mm3 voxels; 33 interleaved slices; FOV = 220 mm). A high-resolution anatomical image was also acquired using a T1-weighted standardized magnetization spoiled gradient echo sequence to aid spatial normalization (MPRAGE; sagittal plane; TR = 2250 ms; TE = 4.18 ms; GRAPPA parallel imaging factor of 2; matrix resolution size = 256x256 mm, 1 mm3 isomorphic voxels, 176 interleaved slices; FOV = 256 mm; flip angle 9°).
Preprocessing
2008 data.
Using Statistical Parametric Mapping (SPM)12 (Wellcome Trust Center for Neuroimaging), the 2008 functional data were corrected for slice timing and motion, realigned and registered to the mean image, spatially normalized to the SPM Montreal Neurological Institute (MNI) template and resliced into isotropic 2mm voxels, and smoothed using an 8mm FWHM Gaussian kernel.
2016 data.
Using Data Processing Assistant for Resting-State fMRI (DPARSF) software [35], each subject’s functional data were corrected for slice timing and head motion, and co-registered to their anatomical data. The images were resliced and resized to match the scale and dimensions of the original 2008 dataset, then spatially normalized to the SPM MNI template and smoothed using an 8mm FWHM Gaussian kernel. The quality of the co-registration and normalization procedure was evaluated by visually inspecting the fMRI images for any inconsistencies.
Behavioral analysis
To compare participants’ average cooperation rates during gameplay across co-players we conducted a one-way repeated measures ANOVA with co-player (human, computer) as the within-subjects factor and cooperation rate during the human and computer games as the dependent variable.
Neuroimaging analysis
General linear modeling (GLM) in SPM12 was used to estimate event-related BOLD response amplitudes relative to baseline (periods of the minimal task engagement between the phases) across the three phases of the task at the individual subject level and the group level. Primary regressors included two regressors for the decision phase, two regressors for the anticipation phase, and four regressors for the feedback phase of the task, as listed in Table 3.
To account for unrelated cognitive processes that could confound results, a regressor was included for the time points at which participants answered emotional assessment questions. Further, to account for the fact that two out of the three games were played against a “human” and one game was played against a computer, the regressors included a set that distinguished between rounds played against a human and a computer. In total, we included 18 task regressors (9 human and 9 computer regressors) in our design matrix (see S2 Fig). Finally, we included a framewise displacement (FD) regressor in the single subject analyses as an additional motion nuisance covariate.
Two-tailed one-sample t-tests contrasted activity within each individual human regressor versus baseline. Based on our expectation that participants would respond differently to cooperative vs. uncooperative (monetary gain/loss) and reciprocated vs. unreciprocated (social coordination/conflict) feedback, we collapsed round types as follows: CC and DC (Co-Player Cooperation), CD and DD (Co-Player Defection), CC and DD (Reciprocated), and CD and DC (Unreciprocated). We took this approach to increase the power of the analysis and to permit distinct evaluation of responses to the social conflict and monetary gain and loss, consistent with previous PD research [3, 36, 37]. Additionally, direct contrasts were used to compare BOLD responses within phases [(Ex. (CC + DD) > (CD + DC), etc.] and between phases (Ex. Decision > Feedback etc.).
A total of sixteen group-level analyses were conducted. Site was included as a covariate in all group-level analyses (see S3 Fig in the supplemental materials Section 6 for a visual overlay of brain activity between the two sites). All results were corrected for multiple comparisons using familywise error rate correction (FWE), and the significance threshold was established at p < .05, with a spatial extent threshold of 30 mm3. Results for the decision and feedback contrasts surpassed a t-statistic of 6.05 (df = 30).
Results for the anticipation phase contrasts did not survive FWE correction, with the exception of activity in the occipital lobe. We conducted exploratory analyses using an uncorrected voxel-wise primary threshold set at p < .001 and a cluster-wise FWE-corrected threshold determined by SPM12 [38]. Because direct contrasts also did not survive FWE correction, we used the same cluster-based threshold method to conduct exploratory analyses on these contrasts (e.g., Decision Coop>Decision Def, CC+DD<CD+DC, etc.) within and between phases of interest.
Results
Behavioral analysis
There was a significant effect of co-player on the average cooperation rate between games, F(1,30) = 14.37, p < 0.001. Overall, participants tended to cooperate more against “human” co-players (M = 45.88, SD = 17.78) than they did against computer co-players (M = 34.12, SD = 19.47; see Fig 2).
Participants tended to cooperate more often against their human co-players suggesting that prosocial norms were at least partially taken into consideration during these games.
Human game neuroimaging baseline contrast analysis
Decision phase.
During the decision to cooperate, significant activation relative to baseline was detected in diverse prefrontal cortical regions of the brain (see Fig 3)—the lateral OFC, bilateral ventrolateral prefrontal cortex (vlPFC), and dmPFC/aMCC. Significant activity was also identified across the parietal lobe, including the left TPJ, bilateral superior parietal lobule and precuneus. Lastly, significant activation was detected in the bilateral anterior insula and the bilateral hippocampus (see Table 4).
In each contrast map the cursor is placed within the peak voxel of activity for each condition. The dmPFC and the bilateral TPJ were the only regions that were recruited across all three phases of the task, suggesting that the PD task serves as a valid and robust model of social reciprocation despite its underlying economic principles. (Decision and feedback phases are thresholded at t(29) = 6.00, p < .05; FWE-corrected voxel-wise threshold while the anticipation phase was thresholded at t(29) = 3.40, p < .001 uncorrected voxel-wise threshold; FWE-corrected cluster-wise threshold determined by SPM12). (Red = Human Game, Blue = Computer Game, C = Cooperate, D = Defect). Ex. [42, –48, 42] = peak voxel MNI coordinates.
During the decision to defect, significant activation was again elicited in regions across the prefrontal cortex (see Fig 3). Lateral OFC and bilateral vlPFC activity were consistently active during decisions to cooperate and to defect. However, in contrast to activation patterns observed during cooperation decisions, decisions to defect were positively correlated with right dlPFC activity, but not dmPFC/aMCC activity. Significant activation to that observed during cooperation decisions emerged in the parietal lobule, including left-lateralized TPJ activity. Bilateral hippocampus activity was present; however, in contrast to what was observed during the decision to cooperate, a significant neural response was not elicited in the bilateral anterior insula (see Table 4).
Anticipation.
During the anticipation phase, no individual voxels survived FWE correction in a whole brain voxel-wise analysis, therefore we report results were obtained using a cluster-wise thresholding approach and FDR-correcting significant clusters. During anticipation following cooperation, significant cluster-wise activity was detected in the right dmPFC, right TPJ, and right anterior insula (see Table 5 for results and details of thresholding).
During anticipation following defection, significant cluster-wise activity was detected more broadly across the prefrontal cortex and included the dmPFC, right dlPFC, and bilateral TPJ. However, anterior insula activity was not detected, mirroring what we observed in the decision contrasts (see Table 5).
Feedback.
Across all four feedback conditions (reciprocated, unreciprocated, co-player cooperation, co-player defection), a common pattern of significant activation emerged that spanned the frontoparietal and salience networks of the brain. Active regions included the dmPFC, right dlPFC, bilateral vlPFC, the lateral OFC, the aMCC, the bilateral TPJ, bilateral superior parietal lobules, the precuneus, the bilateral anterior insula, and the bilateral hippocampi. Unique regions of activity included the right temporal pole during unreciprocated feedback and feedback following co-player defection and bilateral lateral OFC activity during reciprocated feedback and feedback following co-player cooperation. See Table 6 for detailed results.
Human game direct contrasts analysis
Direct contrasts were delineated between sub-epochs within the three phases of the task (e.g., decision to cooperate versus decision to defect). The results of these analyses did not survive voxel-wise FWE correction, necessitating the use of a cluster-wise, FDR corrected threshold. (see Table 7). A direct contrast between the decision to cooperate versus the decision to defect revealed limited relative elevation of activation in the calcarine sulcus during the decision to cooperate, t(29) = 5.05, p < .001.
There was significantly greater activity in the hippocampus during anticipation following cooperation versus anticipation following defection, t(29) = 4.96, p < .001, while anticipation following defection elicited greater activity in the right dlPFC, t(29) = 4.36, p < .001, the precentral gyrus, t(29) = 5.55, p < .001, and the postcentral gyrus, t(29) = 4.82, p < .001 (see Fig 4)
The most salient finding was the activation of the precuneus, involved in self-referential processing, during aversive social outcomes regardless of context (monetary vs social). This result also supports the precuneus’s potential role in conflict monitoring and social adapation in response to negative outcomes. All results for these contrasts were thresholded at t(29) = 3.40, p < .001 uncorrected voxel-wise threshold; FWE-corrected cluster-wise threshold determined by SPM12. (Red = Human Game, Blue = Computer Game, C = Cooperate, D = Defect). Ex. [42, –48, 42] = peak voxel MNI coordinates.
For the feedback conditions, a direct contrast between reciprocated and unreciprocated feedback revealed heightened activity in the precuneus when participants experienced unreciprocated feedback, t(29) = 4.33, p < .001. A similar result was found in the direct contrast between feedback following co-player cooperation and defection. Significant activity was elicited in the precuneus when participants experienced co-player defection in comparison to co-player cooperation, t(29) = 5.05, p < .001.
Lastly, direct contrasts were implemented between phases in the task irrespective of the decision made by the participant (see Table 8; see Fig 5). Significant activity was only detected in the Decision>Feedback, Decision>Anticipation, and Feedback>Anticipation contrasts. Within these contrasts, significant activity was identified in the dlPFC, vlPFC, TPJ, superior parietal lobules, anterior insula, bilateral hippocampi, and thalami. However, while the Decision>Anticipation and Feedback>Anticipation contrasts also revealed activity in the right lateral OFC, aMCC, and precuneus, the Decision>Feedback contrast did not. Lastly, activity in the right temporal pole and posterior midcingulate was unique to the Feedback>Anticipation contrast. See S4 File and S1–S4 Tables for the results of the neuroimaging analysis for the computer game. See S5 File and S5–S9 Tables for neuroimaging findings directly contrasting neural activity between human and computer gameplay.
The decision-making phase exhibited the strongest neural signature in comparison to the other phases of the task, suggesting a significantly elevated cognitive and neural resource requirement for that phase. All contrasts were thresholded at t(29) = 6.00, p < .05; FWE-corrected voxel-wise threshold. Direct contrasts not displayed returned no suparthreshold voxels of activation using voxel-wise or cluster-wise thresholding. (Red = Human Game, Blue = Computer Game, C = Cooperate, D = Defect). Ex. [42, –48, 42] = peak voxel MNI coordinates.
Discussion
The goal of the current study was to characterize neural substrates of reciprocal social exchange, modelled as phases of a prospective “social decision cascade” using the iPD task. As expected, we found both common and distinct patterns of neural activity across phases. Our results reaffirm findings in the iPD literature that implicate functional nodes associated with social reasoning as active during decision-making and feedback appraisal [2–6]. Additionally, our findings offer tentative support for the significance of internal conflict as a predictor of regional activity during the anticipation phase. Notably, only structures previously implicated in ToM reasoning (TPJ and dmPFC; [39, 40] reached a significant threshold of activation during all phases of the task. Our results, taken collectively, paint a more complete picture of the social decision cascade and its neural correlates than the literature to date has presented, and several key points warrant mention.
We had hypothesized that activity in the dmPFC, the caudate, rostral ACC/aMCC, and the TPJ would significantly be associated with decision-making in the task. Our results revealed a larger distribution of regions that, taken together, could constitute a social decision-making network. This network included among its nodes the dmPFC, aMCC and the left TPJ; however, activity in the caudate was absent. This finding was unexpected especially given the wealth of literature that supports the caudate’s involvement in mediating goal-oriented decision-making and adaptive behavior in social tasks [41–43]. A possible explanation is that the repetitive nature of the task diminished the motivational efficacy of the reward derived from gameplay and rendered goal formation inconsequential; however this outcome is unlikely given previous iPD findings [3, 44, 45]. A more plausible explanation could be that our preprocessing pipeline, which included smoothing images with a relatively large Gaussian kernel of 8mm FWHM as a noise reduction approach, may have hindered detection of localized brain activity within small, subcortical structures such as the striatum and the amygdala [46]. A number of additional regions that had been implicated in iPD studies targeting specific populations were recruited; these included the precuneus and the anterior insula. Of note, we also observed activity in the dmPFC and the vlPFC, which are regions that had not shown significant activation in prior iPD studies. These findings suggest additional regions to consider as salient to social decision-making in the context of the iPD.
Of all of the phases, the feedback phase has been the most clearly characterized in the iPD fMRI literature to date [3–6, 13]. The present findings extend this work by providing evidence of significant engagement during feedback of our hypothesized social decision-making network, along with the dlPFC, vlPFC, precuneus, and temporal pole. Previous iPD studies had detected no more than three of these regions activated concurrently during trials; our findings, however, suggest the possibility of large-scale interdependency among these neuroanatomical structures that supports the appraisal of either social harmony/conflict or monetary gain/loss. This interpretation is bolstered by the observation that the same regions were recruited across each feedback outcome (Social outcome: reciprocated and unreciprocated; Monetary outcome: co-player cooperation and co-player defection). Additionally, the majority of the detected regions are part of the frontoparietotemporal network of the brain, a multi-faceted and dynamic network that mediates cognitive flexibility, problem-solving and emotional regulation more broadly in task-related contexts [47, 48]. This observation provides a foundation for future functional connectivity analyses that could elucidate whether the neural substrates of social reasoning conform to a larger coherent executive functioning network or whether social cognition and executive functioning are dissociable at the neural level [49–53].
A qualitative examination of findings for the decision and feedback phases of iPD rounds revealed that they share substantially overlapping neural networks. We observed common activation across these phases in several regions involved in subjective valuation, social reasoning and problem solving such as the lateral frontal gyri, the dmPFC, lateral OFC, bilateral TPJ, precuneus, bilateral anterior insula, bilateral hippocampi and the bilateral thalami [14, 40, 54]. The striking similarities in patterns of activation during the decision and feedback phases raise the possibility that the same neural networks contribute to both, at a domain-general level. However, it is difficult to say, based on our data, whether these networks would support social reasoning specifically or general executive functioning more broadly.
However, a direct contrast between the two phases yielded evidence that the phases might also appropriately be treated as distinct. In particular, all commonly activated neural regions exhibited significantly stronger BOLD activity during decision-making than during feedback. This finding suggests that the mental processes involved in making a social choice and those involved in processing feedback about whether one’s social choice yields reward or punishment draw on a common neural network, but do so in different ways. Stronger inferences concerning the behavior of these networks could be facilitated through the utilization of robust functional connectivity techniques. For example, mapping changes in dynamic functional connectivity within the network over the course of task engagement could be an appropriate approach to determining the magnitude and temporal stability of network recruitment over the course of gameplay. Network dynamics research suggests that moment-to-moment fluctuations in functional connectivity are more stable during complex task performance than at rest and that interregional neuronal hubs often reorganize during tasks, a phenomenon that could easily be captured with the iPD, given the breadth of regional activation identified in this study [55]. However, such research would require a much larger participant sample than we recruited for the present study.
Another direct contrast within the decision-making phase of the game revealed an amplified neural response in the visual cortex when making cooperative versus defection-based decisions. PD fMRI literature overwhelmingly suggests that most individuals oftentimes find the prospect of defecting against their partner to be more aversive and conflict-laden that cooperating [3, 4, 13], which we posited would evoke a heightened neural signature during defection in a direct contrast to cooperation. This outcome may possibly be the result of our reduced dilemma strength for our version of the PDG (Dg’ = Dr’ = 1). It is possible that the various outcomes did not register as significantly differentiated for our participants, which could also explain the lack of reward-based striatal activity over the course of the task. If the dilemma strength was increased by a factor of 5, for example, to increase the earning stakes of the game, this could significantly augment the neural response to defection by intensifying the desire to betray the partner for elevated gains, even while risking periods of social disintegration due to fear of betrayal from the participant. This is another avenue that we believe is worth exploration in future research utilizing this paradigm., especially given the fact that the vast majority of PD fMRI research also employs this same reduced strength variant as the prototypical model of the PD.
Although our findings regarding activity during the anticipation phase are necessarily tentative, given that significant activations only emerged at a liberal cluster-wise threshold, they offer potential evidence that anticipation following participant defection is functionally dissociable from anticipation following participant cooperation. This finding raises the possibility that sensitivity to social conflict may modulate brain activity during the anticipatory process. Anticipation following the decision to cooperate elicited a cluster of activity within the anterior insula, while anticipation following defection elicited clusters of activity within the aMCC, right dlPFC, dmPFC, and bilateral TPJ. Striatum activity was absent in this phase, remaining consistent with observations in the decision and feedback phases.
With regard to anticipation following cooperation, research suggests that the anterior insula is involved in self-awareness and subjective emotional experience [56, 57]. In the context of social interaction, this region has been implicated in mediating affective empathic response, and more specifically generating shared representations of the feelings others [58, 59]. It is possible that the anterior insula facilitated reciprocation in the iPD task by processing emotions associated with desirable positive outcomes of decisions [60]. If this interpretation is accurate, it would align with prior evidence that humans receive emotional reward from cooperating with their peers and anticipating positive outcomes in the social situations such as the PD [61, 62]. However, the anterior insula has also been heavily implicated in associative fear-based learning and the anticipation and processing of aversive outcomes [56, 63, 64]. From this viewpoint, engagement of the anterior insula may signal a fear of betrayal after making the risky decision to cooperate with an unpredictable and previously unknown social partner. Greater insight into the motivations and perceptions of the participants is required to decompose these possibilities.
In contrast, anticipation following defection elicited activity in a network involving aMCC, dmPFC, right dlPFC, and TPJ. Converging neural activity within the rostral ACC and dlPFC has been associated with conflict monitoring/resolution, cognitive control and feedback-mediated decision-making based on the evaluation of previous action outcomes [65–67]. Furthermore, the joint recruitment of the TPJ and dmPFC could suggest activation of a network that differentiates the processing of socio-cognitive conflict (e.g., social cues suggesting conflicting assumptions about the subjective states of an individual) from the processing of general conflict (e.g., interpreting descriptive or declarative sentences) [68] It is possible that participants perceive the decision to defect as conflict-laden because it contradicts social norms, and thus must recruit greater cognitive and neural resources to prepare for the prospect of further social conflict introduced by the participant or the co-player. Alternatively, these regions could be operating independently and be constrained by domain-specific functions attached to the anticipatory process. Replication in larger datasets will be necessary to obtain more robust results and examine each of these possibilities; the current results, however, provide a starting point from which to approach the examination of this phase of the social decision cascade.
We found evidence that the TPJ and the dmPFC were both active during all phases of the cascade. This finding merits note, given that multiple meta-analytic studies have identified these areas as “core” nodal regions underlying social cognition and Theory of Mind (ToM). ToM is defined as the ability to attribute goals, intentions, and beliefs to other individuals [69–71]. The TPJ has specifically been implicated in third person perspective-taking and in creating temporary representations of other peoples’ mental states [72, 73], while the dmPFC appears to support inferences from a first person perspective about stable personality dispositions of the self as well as others, along with mediating the application of social norms and scripts [71]. These functions are essential during a task like the iPD game, which requires participants to attempt to predict partner behavior on a round by round basis. They are asked to think from their own and their partner’s perspectives and coordinate responses with the partner in order to mutually benefit from the interaction or adapt to the partner’s inconsistent behavior [74]. The iPD task should thus tend to consistently recruit social cognition nodes such as the TPJ and dmPFC, and the presence of activation in these regions could serve as a quality check when assessing the effectiveness and utility of the iPD task as a model of social interaction.
Lastly, the anterior insula showed stronger activation when processing “human” co-player defection versus computer co-player defection, based on findings from a direct comparison of brain activity following these negative outcomes. Previous iPD findings support the idea that people tend to treat their decisions as more important and to show more willingness to conform to social standards when they believe their partner is a human being whose actions are perceived as more deliberate and intentional [75, 76]. It is unsurprising then that co-player defection was met with a salient aversive response in the anterior insula when perpetrated by a human partner rather than a computer partner.
A few limitations of this study warrant mention. First, data were collected at two independent sites, with several years separating time of collection. Scanner and MR sequence protocols diverged across the two studies, which necessitated data correction during preprocessing to ensure that parameters were consistent across the final dataset (see S4 Fig in the supplemental materials for a comparison of activity between our two datasets). We included site as a regressor in all analyses to mitigate the impact of site effects. Second, a number of participants defected much more often than they cooperated. Consequently, only a limited number of CD trials could be sampled for those participants. These contrast images were still included in the subsequent group analysis, which could have reduced the overall power of the analysis. Another limitation was the lack of an explicit baseline condition (e.g., cross fixation). All periods in which the participant was not engaged in playing the PD task or answering emotional assessment questions acted as an “implicit” baseline. An additional limitation concerning the emotional assessment questions is the possibility that interruptions during gameplay could have affected the “natural” experience and engagement during play. We decided to use an “online” rating with the knowledge that while disrupting the flow of an ongoing task might alter the emotions being measured, online ratings do show a resistance to degeneration due to memory limitations and allow researcher to more effectively probe emotions related to specific events [25].
Our findings complement the existing iPD fMRI literature by providing evidence that a shared neural network may support social cognition during decision-making and feedback appraisal. The findings lend support to the idea that the dmPFC and TPJ play roles in social reasoning and suggest that these regions should be focal points of analysis in future economic-exchange studies. We also provide a foundation for the examination of the anticipation phase of iPD task rounds, which has received little research attention to date. Future research aimed at replicating and extending our findings regarding the social decision cascade could help further validate the use of economic exchange paradigms as models of social interaction in social neuroscience research.
Supporting information
S1 File. Elaboration of the deception protocol.
https://doi.org/10.1371/journal.pone.0248006.s001
(DOCX)
S2 File. Description of computerized co-player algorithm.
https://doi.org/10.1371/journal.pone.0248006.s002
(DOCX)
S3 File. Description of jittered ISI in task design.
https://doi.org/10.1371/journal.pone.0248006.s003
(DOCX)
S5 File. Neuroimaging analysis of the first human PD game vs. computer game.
https://doi.org/10.1371/journal.pone.0248006.s005
(DOCX)
S1 Fig. Time course of one Prisoner’s Dilemma game.
The chart progresses from left-to-right, top-to-bottom. The first section details the timing of one round. The round always begins at “show round”, “Get Ready” only preceded the first round. The second section details the timing of one block, which includes 5 trials and a set of four assessment questions. The final section details the timing of the entire four block run which concludes with 11 debriefing questions to end the game.
https://doi.org/10.1371/journal.pone.0248006.s006
(TIF)
S2 Fig. Design matrix of the 18-condition task.
https://doi.org/10.1371/journal.pone.0248006.s007
(TIF)
S3 Fig. Comparison of BOLD activity between the two datasets within the feedback phase of the task.
There were no significant differences in patterns of activation between the datasets. Decision: (GSU, t(16) = 3.69, p < .001 uncorrected; Emory, t(13) = 3.85, p < .001 uncorrected). Anticipation: (GSU, t(16) = 1.80, p < .05 uncorrected; Emory, t(13) = 1.75, p < .05 uncorrected). Feedback: (GSU, t(16) = 3.89, p < .001 uncorrected; Emory, t(13) = 3.85, p < .001 uncorrected).
https://doi.org/10.1371/journal.pone.0248006.s008
(TIF)
S4 Fig. The left anterior insula (AI) exhibited greater BOLD response to unreciprocated cooperation (CD) when experienced during human play (1st game) in contrast to computer play [t(29) = 3.43, p < .001 voxel-wise uncorrected, p < .05 FWE-cluster correction, k = 44, peak voxel = -30, 14, -11].
https://doi.org/10.1371/journal.pone.0248006.s009
(TIF)
S1 Table. Significant regional activation during decision phases with computer.
https://doi.org/10.1371/journal.pone.0248006.s010
(DOCX)
S2 Table. Significant regional activation during anticipation phases with computer.
https://doi.org/10.1371/journal.pone.0248006.s011
(DOCX)
S3 Table. Significant regional activation during feedback phases with computer.
https://doi.org/10.1371/journal.pone.0248006.s012
(DOCX)
S4 Table. Regional activation during direct comparison contrasts with computer.
https://doi.org/10.1371/journal.pone.0248006.s013
(DOCX)
S5 Table. Significant peak voxels during the decision-making phase of the first PD game.
https://doi.org/10.1371/journal.pone.0248006.s014
(DOCX)
S6 Table. Significant peak clusters during the anticipation phase of the first PD game.
https://doi.org/10.1371/journal.pone.0248006.s015
(DOCX)
S7 Table. Significant peak voxels during the feedback phase of the first PD game.
https://doi.org/10.1371/journal.pone.0248006.s016
(DOCX)
S8 Table. Direct contrasts within and between phases for the first PD game.
https://doi.org/10.1371/journal.pone.0248006.s017
(DOCX)
S9 Table. Direct comparison between human (1st game) and computer BOLD activity during PD gameplay.
https://doi.org/10.1371/journal.pone.0248006.s018
(DOCX)
References
- 1. Rilling JK, Sanfey AG. The Neuroscience of Social Decision-Making. Annual Review of Psychology. 2011;62(1):23–48. pmid:20822437
- 2. Lambert B, Declerck CH, Emonds G, Boone C. Trust as commodity: social value orientation affects the neural substrates of learning to cooperate. Soc Cogn Affect Neurosci. 2017 Jan 24; pmid:28119509
- 3. Rilling JK, Gutman DA, Zeh TR, Pagnoni G, Berns GS, Kilts CD. A Neural Basis for Social Cooperation. Neuron. 2002 Jul 18;35(2):395–405. pmid:12160756
- 4. Rilling JK, Goldsmith DR, Glenn AL, Jairam MR, Elfenbein HA, Dagenais JE, et al. The neural correlates of the affective response to unreciprocated cooperation. Neuropsychologia. 2008 Apr;46(5):1256–66. pmid:18206189
- 5. Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD. The neural correlates of theory of mind within interpersonal interactions. Neuroimage. 2004 Aug;22(4):1694–703. pmid:15275925
- 6. Suzuki S, Niki K, Fujisaki S, Akiyama E. Neural basis of conditional cooperation. Soc Cogn Affect Neurosci. 2011 Jun;6(3):338–47. pmid:20501484
- 7. Axelrod R, Hamilton WD. The evolution of cooperation. Science. 1981 Mar 27;211(4489):1390–6. pmid:7466396
- 8. Axelrod R. Effective Choice in the Prisoner’s Dilemma. Journal of Conflict Resolution. 1980 Mar 1;24(1):3–25.
- 9. Kreps DM, Milgrom P, Roberts J, Wilson R. Rational cooperation in the finitely repeated prisoners’ dilemma. Journal of Economic Theory. 1982 Aug 1;27(2):245–52.
- 10. Fehr E, Schmidt KM. A Theory of Fairness, Competition, and Cooperation. Q J Econ. 1999 Aug 1;114(3):817–68.
- 11.
Fehr E, Schmidt KM. Chapter 8 The Economics of Fairness, Reciprocity and Altruism–Experimental Evidence and New Theories. In: Kolm S-C, Ythier JM, editors. Handbook of the Economics of Giving, Altruism and Reciprocity [Internet]. Elsevier; 2006 [cited 2019 May 13]. p. 615–91. (Foundations; vol. 1). Available from: http://www.sciencedirect.com/science/article/pii/S1574071406010086
- 12. Bitsch F, Berger P, Nagels A, Falkenberg I, Straube B. The role of the right temporo-parietal junction in social decision-making. Hum Brain Mapp. 2018 Jul;39(7):3072–85. pmid:29582502
- 13. Patel RS, Bowman FD, Rilling JK. A Bayesian approach to determining connectivity of the human brain. Hum Brain Mapp. 2006 Mar;27(3):267–76. pmid:16092131
- 14. Bartra O, McGuire JT, Kable JW. The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. NeuroImage. 2013 Aug 1;76:412–27. pmid:23507394
- 15. Haber SN, Behrens TEJ. The Neural Network Underlying Incentive-Based Learning: Implications for Interpreting Circuit Disruptions in Psychiatric Disorders. Neuron. 2014 Sep 3;83(5):1019–39. pmid:25189208
- 16. Greco JA, Liberzon I. Neuroimaging of Fear-Associated Learning. Neuropsychopharmacology. 2016 Jan;41(1):320–34. pmid:26294108
- 17. Maren S, Holmes A. Stress and Fear Extinction. Neuropsychopharmacology. 2016 Jan;41(1):58–79. pmid:26105142
- 18. Cavanna AE. The precuneus and consciousness. CNS Spectr. 2007 Jul;12(7):545–52. pmid:17603406
- 19. Schurz M, Radua J, Aichhorn M, Richlan F, Perner J. Fractionating theory of mind: a meta-analysis of functional brain imaging studies. Neurosci Biobehav Rev. 2014 May;42:9–34. pmid:24486722
- 20. Cohen MX. Individual differences and the neural representations of reward expectation and reward prediction error. Soc Cogn Affect Neurosci. 2007 Mar 1;2(1):20–30. pmid:17710118
- 21. Knutson B, Cooper JC. Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol. 2005 Aug;18(4):411–7. pmid:16003117
- 22. Grupe DW, Oathes DJ, Nitschke JB. Dissecting the Anticipation of Aversion Reveals Dissociable Neural Networks. Cereb Cortex. 2013 Aug 1;23(8):1874–83. pmid:22763169
- 23. Simmons A, Strigo I, Matthews SC, Paulus MP, Stein MB. Anticipation of Aversive Visual Stimuli Is Associated With Increased Insula Activation in Anxiety-Prone Subjects. Biological Psychiatry. 2006 Aug 15;60(4):402–9. pmid:16919527
- 24. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G. Distributed Neural Representation of Expected Value. J Neurosci. 2005 May 11;25(19):4806–12. pmid:15888656
- 25. Knutson B, Greer SM. Anticipatory affect: neural correlates and consequences for choice. Philosophical Transactions of the Royal Society of London B: Biological Sciences. 2008 Dec 12;363(1511):3771–86. pmid:18829428
- 26. Cohen MX, Heller AS, Ranganath C. Functional connectivity with anterior cingulate and orbitofrontal cortices during decision-making. Cognitive Brain Research. 2005 Apr 1;23(1):61–70. pmid:15795134
- 27. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, et al. Choice selection and reward anticipation: an fMRI study. Neuropsychologia. 2004 Jan 1;42(12):1585–97. pmid:15327927
- 28. Smoski MJ, Felder J, Bizzell J, Green SR, Ernst M, Lynch TR, et al. fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder. Journal of Affective Disorders. 2009 Nov 1;118(1):69–78.
- 29. Botvinick MM, Rosen ZB. Anticipation of cognitive demand during decision-making. Psychol Res. 2009 Nov;73(6):835–42. pmid:19023592
- 30. Forbes EE, May JC, Siegle GJ, Ladouceur CD, Ryan ND, Carter CS, et al. Reward-related decision-making in pediatric major depressive disorder: an fMRI study. Journal of Child Psychology and Psychiatry. 2006 Nov 1;47(10):1031–40. pmid:17073982
- 31. Fukui H, Murai T, Fukuyama H, Hayashi T, Hanakawa T. Functional activity related to risk anticipation during performance of the Iowa gambling task. NeuroImage. 2005 Jan 1;24(1):253–9. pmid:15588617
- 32. Mathews Z, Cetnarski R, Verschure PFMJ. Visual anticipation biases conscious decision making but not bottom-up visual processing. Front Psychol [Internet]. 2015 [cited 2018 Aug 21];5. Available from: https://www.frontiersin.org/articles/10.3389/fpsyg.2014.01443/full
- 33. Miller FG, Gluck JP, Wendler D. Debriefing and accountability in deceptive research. Kennedy Inst Ethics J. 2008 Sep;18(3):235–51. pmid:18935922
- 34. Arefin M, Kabir K, Jusup M, Ito H, Tanimoto J. Social efficiency deficit deciphers social dilemmas. Scientific Reports. 2020 Sep 30;10:16092. pmid:32999303
- 35. Ito H, Tanimoto J. Scaling the phase-planes of social dilemma strengths shows game-class changes in the five rules governing the evolution of cooperation. R Soc Open Sci [Internet]. 2018 Oct 17 [cited 2021 Feb 1];5(10). Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6227953/ pmid:30473853
- 36. Wang Z, Kokubo S, Jusup M, Tanimoto J. Universal scaling for the dilemma strength in evolutionary games. Physics of Life Reviews. 2015 Sep 1;14:1–30. pmid:25979121
- 37. Tanimoto J, Sagara H. Relationship between dilemma occurrence and the existence of a weakly dominant strategy in a two-player symmetric game. Biosystems. 2007 Aug;90(1):105–14. pmid:17188808
- 38.
Tanimoto J. Evolutionary Games with Sociophysics: Analysis of Traffic Flow and Epidemics [Internet]. Springer Singapore; 2018 [cited 2021 Feb 1]. (Evolutionary Economics and Social Complexity Science). Available from: https://www.springer.com/gp/book/9789811327681
- 39. Heberlein KA, Hu X. Simultaneous acquisition of gradient‐echo and asymmetric spin‐echo for single‐shot z‐shim: Z‐SAGA. Magnetic Resonance in Medicine. 2004 Jan 1;51(1):212–6. pmid:14705064
- 40. Chao-Gan Y, Yu-Feng Z. DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI. Front Syst Neurosci. 2010;4:13. pmid:20577591
- 41. McClure-Tone EB, Nawa NE, Nelson EE, Detloff AM, Fromm S, Pine DS, et al. Preliminary Findings: Neural Responses to Feedback Regarding Betrayal and Cooperation in Adolescent Anxiety Disorders. Dev Neuropsychol. 2011 May;36(4):453–72. pmid:21516543
- 42. Rilling JK, King-Casas B, Sanfey AG. The neurobiology of social decision-making. Curr Opin Neurobiol. 2008 Apr;18(2):159–65. pmid:18639633
- 43. Woo C-W, Krishnan A, Wager TD. Cluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations. Neuroimage. 2014 May 1;91:412–9. pmid:24412399
- 44. Schurz M, Radua J, Aichhorn M, Richlan F, Perner J. Fractionating theory of mind: A meta-analysis of functional brain imaging studies. Neuroscience & Biobehavioral Reviews. 2014 May 1;42:9–34. pmid:24486722
- 45. Schurz M, Radua J, Tholen MG, Maliske L, Margulies DS, Mars RB, et al. Toward a hierarchical model of social cognition: A neuroimaging meta-analysis and integrative review of empathy and theory of mind. Psychol Bull. 2020 Nov 5;
- 46. Chase HW, Kumar P, Eickhoff SB, Dombrovski AY. Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis. Cogn Affect Behav Neurosci. 2015 Jun;15(2):435–59. pmid:25665667
- 47. Liljeholm M, O’Doherty JP. Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn Sci (Regul Ed). 2012 Sep;16(9):467–75.
- 48. O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning. Science. 2004 Apr 16;304(5669):452–4. pmid:15087550
- 49. Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD. The neural correlates of theory of mind within interpersonal interactions. NeuroImage. 2004 Aug 1;22(4):1694–703. pmid:15275925
- 50. Sun P, Zheng L, Li L, Guo X, Zhang W, Zheng Y. The Neural Responses to Social Cooperation in Gain and Loss Context. PLoS ONE. 2016;11(8):e0160503. pmid:27494142
- 51. Walter M, Stadler J, Tempelmann C, Speck O, Northoff G. High resolution fMRI of subcortical regions during visual erotic stimulation at 7 T. MAGMA. 2008 Mar;21(1–2):103–11. pmid:18183443
- 52. DeSalvo MN, Douw L, Takaya S, Liu H, Stufflebeam SM. Task-dependent reorganization of functional connectivity networks during visual semantic decision making. Brain and Behavior. 2014;4(6):877–85. pmid:25365802
- 53. Rubia K. Functional brain imaging across development. Eur Child Adolesc Psychiatry. 2013 Dec 1;22(12):719–31. pmid:22729957
- 54. Blakemore S-J, Choudhury S. Development of the adolescent brain: implications for executive function and social cognition. J Child Psychol Psychiatry. 2006 Apr;47(3–4):296–312. pmid:16492261
- 55. Eslinger PJ, Moore P, Anderson C, Grossman M. Social cognition, executive functioning, and neuroimaging correlates of empathic deficits in frontotemporal dementia. J Neuropsychiatry Clin Neurosci. 2011;23(1):74–82. pmid:21304142
- 56. Levan A, Black G, Mietchen J, Baxter L, Brock Kirwan C, Gale SD. Right frontal pole cortical thickness and executive functioning in children with traumatic brain injury: the impact on social problems. Brain Imaging Behav. 2016;10(4):1090–5. pmid:26542618
- 57. Loitfelder M, Huijbregts SCJ, Veer IM, Swaab HS, Van Buchem MA, Schmidt R, et al. Functional Connectivity Changes and Executive and Social Problems in Neurofibromatosis Type I. Brain Connect. 2015 Jun;5(5):312–20. pmid:25705926
- 58. Lough S, Gregory C, Hodges JR. Dissociation of social cognition and executive function in frontal variant frontotemporal dementia. Neurocase. 2001;7(2):123–30. pmid:11320160
- 59. Phan KL, Wager T, Taylor SF, Liberzon I. Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI. NeuroImage. 2002 Jun 1;16(2):331–48. pmid:12030820
- 60. Gonzalez-Castillo J, Bandettini PA. Task-based dynamic functional connectivity: Recent findings and open questions. NeuroImage. 2018 Oct 15;180:526–33. pmid:28780401
- 61. Gu X, Hof PR, Friston KJ, Fan J. Anterior insular cortex and emotional awareness. J Comp Neurol. 2013 Oct 15;521(15):3371–88. pmid:23749500
- 62. Zaki J, Davis JI, Ochsner KN. Overlapping activity in anterior insula during interoception and emotional experience. Neuroimage. 2012 Aug 1;62(1):493–9. pmid:22587900
- 63. Bernhardt BC, Singer T. The neural basis of empathy. Annu Rev Neurosci. 2012;35:1–23. pmid:22715878
- 64. Engen HG, Singer T. Empathy circuits. Curr Opin Neurobiol. 2013 Apr;23(2):275–82. pmid:23219409
- 65. Lamm C, Singer T. The role of anterior insular cortex in social emotions. Brain Struct Funct. 2010 Jun;214(5–6):579–91. pmid:20428887
- 66. Cáceda R, James GA, Gutman DA, Kilts CD. Organization of intrinsic functional brain connectivity predicts decisions to reciprocate social behavior. Behav Brain Res. 2015 Oct 1;292:478–83. pmid:26166191
- 67. Watanabe T, Takezawa M, Nakawake Y, Kunimatsu A, Yamasue H, Nakamura M, et al. Two distinct neural mechanisms underlying indirect reciprocity. Proc Natl Acad Sci USA. 2014 Mar 18;111(11):3990–5. pmid:24591599
- 68. (Bud) Craig AD. How do you feel—now? The anterior insula and human awareness. Nat Rev Neurosci. 2009 Jan;10(1):59–70. pmid:19096369
- 69. Shankman SA, Gorka SM, Nelson BD, Fitzgerald DA, Phan KL, O’Daly O. Anterior insula responds to temporally unpredictable aversiveness: an fMRI study. Neuroreport. 2014 May 28;25(8):596–600. pmid:24614364
- 70. Botvinick MM. Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function. Cognitive, Affective, & Behavioral Neuroscience. 2007 Dec 1;7(4):356–66. pmid:18189009
- 71. Kerns JG, Cohen JD, MacDonald AW, Cho RY, Stenger VA, Carter CS. Anterior Cingulate Conflict Monitoring and Adjustments in Control. Science. 2004 Feb 13;303(5660):1023–6. pmid:14963333
- 72. Milham MP, Banich MT. Anterior cingulate cortex: An fMRI analysis of conflict specificity and functional differentiation. Hum Brain Mapp. 2005 Jul 1;25(3):328–35. pmid:15834861
- 73.
Social Cognitive Conflict Resolution: Contributions of Domain-General and Domain-Specific Neural Systems | Journal of Neuroscience [Internet]. [cited 2017 Nov 4]. Available from: http://www.jneurosci.org/content/30/25/8481.short
- 74. Mitchell JP. Inferences about mental states. Philos Trans R Soc Lond B Biol Sci. 2009 May 12;364(1521):1309–16. pmid:19528012
- 75. Schurz M, Aichhorn M, Martin A, Perner J. Common brain areas engaged in false belief reasoning and visual perspective taking: a meta-analysis of functional brain imaging studies. Front Hum Neurosci [Internet]. 2013 Nov 1 [cited 2016 Jul 17];7. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3814428/ pmid:24198773
- 76. Van Overwalle F. Social cognition and the brain: a meta-analysis. Hum Brain Mapp. 2009 Mar;30(3):829–58. pmid:18381770