Dynamics of working memory for moving sounds: an event-related potential and scalp current density study

Human brain imaging studies have suggested that posterior temporo-parietal regions are involved in auditory spatial processing. We used electroencephalography to investigate the dynamics of temporo-parietal networks during working memory for moving sounds. A delayed matching-to-sample task required a decision on the identity of positions and trajectories of two moving sounds S1 and S2 presented with delays of 927 or 1427 ms. Moving sounds consisted of noise bursts positioned at successive angles to create the impression of one of six possible trajectories at variable spatial positions. Stimuli in the equally difficult control condition were identical to the memory task up to S2, which was replaced by a spatial displacement in the otherwise stationary background sound whose direction had to be detected. Event-related potentials were recorded from 31 scalp electrodes in 15 subjects. Scalp current density estimates allowed to identify the following components. The fronto-central negative variation preceding S2 did not differ between tasks. In contrast, the sustained negative current during the presentation of S1 originating from superior temporal cortex was more pronounced for the memory task, probably reflecting enhanced attention allocation and foreground-background discrimination. Most importantly, the memory task activated current sources over bilateral posterior parietal regions between the middle of S1 and the end of the delay phase. This component was completely absent in the control condition. In summary, the present study disclosed varying degrees of memorization-related, top-down driven influences on the processing of moving sounds at different stages of an auditory network involving temporal and parietal regions.     

Dynamics of gamma-band activity in human magnetoencephalogram during auditory pattern working memory

Both electrophysiological research in animals and human brain imaging studies have suggested that, similar to the visual system, separate cortical ventral "what" and dorsal "where" processing streams may also exist in the auditory domain. Recently we have shown enhanced gamma-band activity (GBA) over posterior parietal cortex belonging to the putative auditory dorsal pathway during a sound location working memory task. Using a similar methodological approach, the present study assessed whether GBA would be increased over auditory ventral stream areas during an auditory pattern memory task. Whole-head magnetoencephalogram was recorded from N = 12 subjects while they performed a working memory task requiring same-different judgments about pairs of syllables S1 and S2 presented with 0.8-s delays. S1 and S2 could differ either in voice onset time or in formant structure. This was compared with a control task involving the detection of possible spatial displacements in the background sound presented instead of S2. Under the memory condition, induced GBA was enhanced over left inferior frontal/anterior temporal regions during the delay phase and in response to S2 and over prefrontal cortex at the end of the delay period. gamma-Band coherence between left frontotemporal and prefrontal sensors was increased throughout the delay period of the memory task. In summary, the memorization of syllables was associated with synchronously oscillating networks both in frontotemporal cortex, supporting a role of these areas as parts of the putative auditory ventral stream, and in prefrontal, possible executive regions. Moreover, corticocortical connectivity was increased between these structures.     

Developmental changes in neural activation and psychophysiological interaction patterns of brain regions associated with interference control and time perception

Interference control and time perception are mediated by common neural networks, including the frontal and parietal lobes, the cerebellum and the basal ganglia. Previous studies have shown that while time perception develops early in life, interference control seems to follow a protracted course of maturation into late adolescence. Thus, the current study examined developmental changes in neural activation and functional interaction between brain regions during a combined time discrimination and interference control task using fMRI. Thirty-four participants, aged 8-15 years, were scanned while performing a spatial stimulus response compatibility (SRC) task and a time discrimination (TD) task using identical stimuli. We found shared neural activation in a fronto-parieto-cerebellar network as well as task-specific patterns of psychophysiological interaction with positive coupling between the right inferior frontal gyrus (IFG), the superior parietal lobes bilaterally, the contralateral IFG and the thalamus during interference control and positive interactions between the right IFG and bilateral cerebellar activity and the thalamus during time discrimination. Developmental changes in task performance and brain activation patterns were only observed during the SRC task, with increased neural activity in the left inferior parietal gyrus and positive coupling between fronto-parietal brain regions that was only observed in the adolescents group. These results suggest that although both cognitive tasks rely on a shared neural network, distinct developmental curves of brain activation and connectivity could be observed associated with differential maturation patterns underlying cognitive development.     

Segregated processing of auditory motion and auditory location: an ERP mapping study

Recent studies have revealed a distinct cortical network activated during the analysis of sounds' spatial properties. Whether common brain regions in this auditory where pathway are involved in both auditory motion and location processing is unresolved. We investigated this question with multichannel auditory evoked potentials (AEPs) in 11 subjects. Stimuli were binaural 500-ms white noise bursts. Interaural time differences (ITD) created the sensation of moving or stationary sounds within each auditory hemifield, and subjects discriminated either their position or direction of motion in a blocked design. Scalp potential distributions (AEP maps) differentiated electric field configurations across stimulus classes. The initial approximately 250-ms poststimulus yielded common topographies for both stimulus classes and hemifields. After approximately 250-ms, moving and stationary sounds engaged distinct cortical networks at two time periods, again with no differences observed between hemifields. The first ( approximately 250- to 350-ms poststimulus onset) was during stimulus presentation, and the second ( approximately 550- to 900-ms poststimulus onset) occurred after stimulus offset. Distributed linear inverse solutions of the maps over the 250- to 350-ms time period revealed not only bilateral inferior frontal activation for both types of auditory spatial processing, but also strong right inferior parietal activation in the case of auditory motion discrimination. During the later 550-to 900-ms time period, right inferior parietal and bilateral inferior frontal activity was again observed for moving sounds, whereas strong bilateral superior frontal activity was seen in the case of stationary sounds. Collectively, the evidence supports the existence of partly segregated networks within the auditory where pathway for auditory location and auditory motion processing.     

Assessing the auditory dual-pathway model in humans

Evidence from anatomical and neurophysiological studies in nonhuman primates suggests a dual-pathway model of auditory processing wherein sound identity and sound location information are segregated along ventral and dorsal streams, respectively. The present meta-analysis reviewed evidence from auditory functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) studies to determine the reliability of this model in humans. Activation coordinates from 11 "spatial" studies (i.e., listeners made localization judgements on sounds that could occur at two or more perceptually different positions) and 27 "nonspatial" studies (i.e., listeners completed nonspatial tasks involving sounds presented from the same location) were entered into the analysis. All but one of the spatial studies reported activation within the inferior parietal lobule as opposed to only 41% of the nonspatial studies. In addition, 55% of spatial studies reported activity around the superior frontal sulcus as opposed to only 7% of the nonspatial studies. In comparison, inferior frontal activity (Brodmann's areas 45 and 47) was reported in only 9% of the spatial studies, but in 56% of the nonspatial studies. Finally, almost all temporal lobe activity observed during spatial tasks was confined to posterior areas, whereas nonspatial activity was distributed throughout the temporal lobe. These results support an auditory dual-pathway model in humans in which nonspatial sound information (e.g., sound identity) is processed primarily along the ventral stream whereas sound location is processed along the dorsal stream and areas posterior to primary auditory cortex.     

Exploring the contributions of premotor and parietal cortex to spatial compatibility using image-guided TMS

Functional brain imaging studies have demonstrated increased activity in dorsal premotor and posterior parietal cortex when performing spatial stimulus-response compatibility tasks (SRC). We tested the specific role of these regions in stimulus-response mapping using single-pulse transcranial magnetic stimulation (TMS). Subjects were scanned using functional magnetic resonance imaging (fMRI) prior to the TMS session during performance of a task in which spatial compatibility was manipulated. For each subject, the area of increased signal within the regions of interest was registered onto their own high-resolution T1-weighted anatomic scan. TMS was applied to these areas for each subject using a frameless stereotaxic system. Task accuracy and reaction time (RT) were measured during blocks of compatible or incompatible trials and during blocks of real TMS or sham stimulation. On each trial, a single TMS pulse was delivered at 50, 100, 150, or 200 ms after the onset of the stimulus in the left or right visual field. TMS over the left premotor cortex produced various facilitatory effects, depending on the timing of the stimulation. At short intervals, TMS appeared to prime the left dorsal premotor cortex to select a right-hand response more quickly, regardless of stimulus-response compatibility. The strongest effect of stimulation, however, occurred at the 200-ms interval, when TMS facilitated left-hand responses during the incompatible condition. Facilitation of attention to the contralateral visual hemifield was observed during stimulation over the parietal locations. We conclude that the left premotor cortex is one of the cortical regions responsible for overriding automatic stimulus-response associations.     

The musician's brain: functional imaging of amateurs and professionals during performance and imagery

We compared activation maps of professional and amateur violinists during actual and imagined performance of Mozart's violin concerto in G major (KV216). Execution and imagination of (left hand) fingering movements of the first 16 bars of the concerto were performed. Electromyography (EMG) feedback was used during imagery training to avoid actual movement execution and EMG recording was employed during the scanning of both executed and imagined musical performances. We observed that professional musicians generated higher EMG amplitudes during movement execution and showed focused cerebral activations in the contralateral primary sensorimotor cortex, the bilateral superior parietal lobes, and the ipsilateral anterior cerebellar hemisphere. The finding that professionals exhibited higher activity of the right primary auditory cortex during execution may reflect an increased strength of audio-motor associative connectivity. It appears that during execution of musical sequences in professionals, a higher economy of motor areas frees resources for increased connectivity between the finger sequences and auditory as well as somatosensory loops, which may account for the superior musical performance. Professionals also demonstrated more focused activation patterns during imagined musical performance. However, the auditory-motor loop was not involved during imagined performances in either musician group. It seems that the motor and auditory systems are coactivated as a consequence of musical training but only if one system (motor or auditory) becomes activated by actual movement execution or live musical auditory stimuli.     

Anatomic dissociation of selective and suppressive processes in visual attention

Visual spatial attention is associated with activation in parietal regions as well as with modulation of visual activity in ventral occipital cortex. Within the parietal lobe, localisation of activity has been hampered by variation in individual anatomy. Using fMRI within regions of interest derived from individual functional maps, we examined the response of superior parietal lobule, intraparietal sulcus, and ventral occipital cortex in 11 normal adults as attention was directed to the left and right visual hemifields during bilateral visual stimulation. Activation in ventral occipital cortex was augmented contralateral to the attended hemifield (P < 0.006), while intraparietal activation was augmented ipsilaterally (P < 0.009), and superior parietal lobule showed no modulation of activity as a function of attended hemifield. These findings suggest that spatial enhancement of relevant stimuli in ventral occipital cortex is complemented by an intraparietal response associated with suppression of, or preparation of a reflexive shift of attention toward, irrelevant stimuli. The spatial attention system in superior parietal cortex, in contrast, may be driven to equal degrees by currently attended stimuli and by stimuli that are potential targets of attention.     

Interaural temporal and coherence cues jointly contribute to successful sound movement perception and activation of parietal cortex

The perception of movement in the auditory modality requires dynamic changes in the input that reaches the two ears (e.g. sequential changes of interaural time differences; dynamic ITDs). However, it is still unclear as to what extent these temporal cues interact with other interaural cues to determine successful movement perception, and which brain regions are involved in sound movement processing. Here, we presented trains of white-noise bursts containing either static or dynamic ITDs, and we varied parametrically the level of binaural coherence (BC) of both types of stimuli. Behaviorally, we found that movement discrimination sensitivity decreased with decreasing levels of BC. fMRI analyses highlighted a network of temporal, frontal and parietal regions where activity decreased with decreasing BC. Critically, in the intra-parietal sulcus and the supra-marginal gyrus brain activity decreased with decreasing BC, but only for dynamic-ITD sounds (BC by ITD interaction). Thus, these regions activated selectively when the sounds contained both dynamic ITDs and high levels of BC; i.e. when subjects perceived sound movement. We conclude that sound movement perception requires both dynamic changes of the auditory input and effective sound-source localization, and that parietal cortex utilizes interaural temporal and coherence cues for the successful perception of sound movement.     

Right parietal dominance in spatial egocentric discrimination

Egocentric tactile perception is crucial for skilled hand motor control. In order to better understand the brain functional underpinnings related to this basic sensorial perception, we performed a tactile perception functional magnetic resonance imaging (fMRI) experiment with two aims. The first aim consisted of characterizing the neural substrate of two types of egocentric tactile discrimination: the spatial localization (SLD) and simultaneity succession discrimination (SSD) in both hands to define hemispheric dominance for these tasks. The second goal consisted of characterizing the brain activation related to the spatial attentional load, the functional changes and their connectivity patterns induced by the psychometric performance (PP) during SLD. We used fMRI in 25 right-handed volunteers, applying pairs of sinusoidal vibratory stimuli on eight different positions in the palmar surface of both hands. Subjects were required either to identify the stimulus location with respect to an imaginary midline (SLD), to discriminate the simultaneity or succession of a stimuli pair (SSD) or to simply respond to stimulus detection. We found a fronto-parietal network for SLD and frontal network for SSD. During SLD we identified right hemispheric dominance with increased BOLD activation and functional interaction of the right supramarginal gyrus with contralateral intra-parietal sulcus for right and left hand independently. Brain activity correlated to spatial attentional load was found in bilateral structures of intra-parietal sulcus, precuneus extended to superior parietal lobule, pre-supplementary motor area, frontal eye fields and anterior insulae for both hands. We suggest that the right supramarginal gyrus and its interaction with intra-parietal lobule may play a pivotal role in the phenomenon of tactile neglect in right fronto-parietal lesions.     

Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction

We recorded cortical-evoked responses with a whole-scalp neuromagnetometer to study human brain dynamics associated with audiotactile interaction. The subjects received unilateral auditory (A) or tactile (T) stimuli, or both stimuli simultaneously (AT), alternating to the left and right side. Responses to AT stimuli differed significantly from the algebraic sum of responses to A and T stimuli (A + T) at 75-85 and 105-130 ms and indicated suppressive audiotactile interaction. Source modeling revealed that the earlier interaction occurred in the contralateral posterior parietal cortex and the later interaction in the contralateral parietal opercula between the SII cortex and the auditory cortex. The interaction was significantly stronger in the left than the right hemisphere. In most subjects, AT responses were far more similar to T than to A responses, suggesting suppression of auditory processing during the spatially and temporally concordant audiotactile stimuli in which the tactile component was subjectively more salient.     

Distinct pathways involved in sound recognition and localization: a human fMRI study

Evidence from psychophysical studies in normal and brain-damaged subjects suggests that auditory information relevant to recognition and localization are processed by distinct neuronal populations. We report here on anatomical segregation of these populations. Brain activation associated with performance in sound identification and localization was investigated in 18 normal subjects using fMRI. Three conditions were used: (i) comparison of spatial stimuli simulated with interaural time differences; (ii) identification of environmental sounds; and (iii) rest. Conditions (i) and (ii) required acknowledgment of predefined targets by pressing a button. After coregistering, images were normalized and smoothed. Activation patterns were analyzed using SPM99 for individual subjects and for the whole group. Sound recognition and localization activated, as compared to rest, inferior colliculus, medial geniculate body, Heschl gyrus, and parts of the temporal, parietal, and frontal convexity bilaterally. The activation pattern on the fronto-temporo-parietal convexity differed in the two conditions. Middle temporal gyrus and precuneus bilaterally and the posterior part of left inferior frontal gyrus were more activated by recognition than by localization. Lower part of inferior parietal lobule and posterior parts of middle and inferior frontal gyri were more activated, bilaterally, by localization than by recognition. Regions selectively activated by sound recognition, but not those selectively activated by localization, were significantly larger in women. Passive listening paradigm revealed segregated pathways on superior temporal gyrus and inferior parietal lobule. Thus, anatomically distinct networks are involved in sound recognition and sound localization.     

The effect of verbal feedback on motor learning--a PET study. Positron emission tomography

The purpose of this study was to investigate brain mechanisms underlying feedback effects on motor learning. We measured human brain activity using positron emission tomography (PET) during length-of-line drawing tasks in the presence or absence of verbal feedback, i.e., information on the precision of motor performance. The average error in responses was significantly lower and the percentage of correct responses was significantly higher in the case of tasks with feedback than those in the absence of feedback. The contralateral sensorimotor, premotor, supplementary motor, the right prefrontal, bilateral parietal and temporal, and anterior cingulate cortices, and the left basal ganglia were activated during all the line-drawing tasks. The right lateral prefrontal and occipital cortices and the left basal ganglia exhibited marked increase in activity after learning. The right inferior parietal and the anterior cingulate cortices were activated in the presence of feedback which provided information on how the subjects should correct their performances. The results indicate that these brain areas may play an important role in representing knowledge of results during motor learning and that appropriate feedback may facilitate motor learning.     

The Effect of Verbal Feedback on Motor Learning—A PET Study

The purpose of this study was to investigate brain mechanisms underlying feedback effects on motor learning. We measured human brain activity using positron emission tomography (PET) during length-of-line drawing tasks in the presence or absence of verbal feedback, i.e., information on the precision of motor performance. The average error in responses was significantly lower and the percentage of correct responses was significantly higher in the case of tasks with feedback than those in the absence of feedback. The contralateral sensorimotor, premotor, supplementary motor, the right prefrontal, bilateral parietal and temporal, and anterior cingulate cortices, and the left basal ganglia were activated during all the line-drawing tasks. The right lateral prefrontal and occipital cortices and the left basal ganglia exhibited marked increase in activity after learning. The right inferior parietal and the anterior cingulate cortices were activated in the presence of feedback which provided information on how the subjects should correct their performances. The results indicate that these brain areas may play an important role in representing knowledge of results during motor learning and that appropriate feedback may facilitate motor learning.     

Evidence for a frontal cortex role in both auditory and somatosensory habituation: a MEG study

Auditory and somatosensory responses to paired stimuli were investigated for commonality of frontal activation that may be associated with gating using magnetoencephalography (MEG). A paired stimulus paradigm for each sensory evoked study tested right and left hemispheres independently in ten normal controls. MR-FOCUSS, a current density technique, imaged simultaneously active cortical sources. Each subject showed source localization, in the primary auditory or somatosensory cortex, for the respective stimuli following both the first (S1) and second (S2) impulses. Gating ratios for the auditory M50 response, equivalent to the P50 in EEG, were 0.54+/-0.24 and 0.63+/-0.52 for the right and left hemispheres. Somatosensory gating ratios were evaluated for early and late latencies as the pulse duration elicits extended response. Early gating ratios for right and left hemispheres were 0.69+/-0.21 and 0.69+/-0.41 while late ratios were 0.81+/-0.41 and 0.80+/-0.48. Regions of activation in the frontal cortex, beyond the primary auditory or somatosensory cortex, were mapped within 25 ms of peak S1 latencies in 9/10 subjects during auditory stimulus and in 10/10 subjects for somatosensory stimulus. Similar frontal activations were mapped within 25 ms of peak S2 latencies for 75% of auditory responses and for 100% of somatosensory responses. Comparison between modalities showed similar frontal region activations for 17/20 S1 responses and for 13/20 S2 responses. MEG offers a technique for evaluating cross modality gating. The results suggest similar frontal sources are simultaneously active during auditory and somatosensory habituation.     

Automatic prediction error responses to hands with unexpected laterality: An electrophysiological study

Little is known about how the human brain keeps track of body parts in the visual field. Here we show that unattended images of right/left hands elicit a mismatch response when they violate a regularity established by repeated visual presentations of the other hand. In a visual oddball experiment we found mismatch responses to hands with unexpected laterality (e.g. left versus predicted right hand) in the periphery of the visual field. Unexpected left hands were processed predominantly in the contralateral superior parietal cortex, whereas unexpected right hands evoked differential activity in the contralateral superior parietal, ventral premotor, prefrontal and temporal areas, indicating a more elaborate automatic processing of the dominant hand. The amplitude of the differential activity to the right hand correlated with handedness test scores. Our results reveal the continuous monitoring of the left or right identity of hands, which is prerequisite to the ability to automatically transform observed actions into the observer's ego-centric spatial reference frame.     

Attention-dependent changes of activation and connectivity in dichotic listening

Functional studies of auditory spatial attention generally report enhanced neural responses in auditory cortical regions. However, activity in regions of the spatial attentional network as described in the visual modality is not consistently observed. Data analysis limitations due to oppositely lateralized activity depending on the side of attentional orientation and heterogeneity of paradigms makes it hard to untangle the possible causes of these various activation patterns. In the present article we present a PET study of auditory spatial attention in which we manipulated orientation of attention, attentional load, and difficulty of the task by means of the dichotic listening paradigm. Moreover, we designed a systematic, voxel-specific, method in order to deal with oppositely lateralized activity. The results show that when listeners are involved in auditory spatial attention tasks an interacting network of frontal, temporal, and parietal regions is activated. Selective orientation toward one side mostly yields activity and connectivity modulations in the hemisphere contralateral to the attended side while in divided attention activity is mostly bilateral. Taken together, our observations are consistent with the idea of a multimodal large-scale attentional network.     

Cortical activation during perception of a rotating wide-field acoustic stimulus.

We describe sound stimuli that produce the perception of complete rotation around the head. Such stimuli are analogous to wide-field motion stimuli used in visual research, though auditory stimuli, unlike visual stimuli, can be perceived at any point around the head; they are the only cues for spatial perception behind the subject. Using PET on six subjects, we have compared regional brain activity during the perception of such motion stimuli, with the perception of a control stimulus producing equivalent amplitude changes without rotation. Rotation produced activation of the premotor cortex bilaterally and the right superior parietal cortex. The premotor activation involved the frontal eye fields and ventral premotor areas. The bifrontal and right parietal activation is consistent with previous demonstrations of activation within a frontoparietal network of areas during perception of a linear motion stimulus. The inferior premotor activation in this experiment may reflect preparation for head turning in response to auditory targets that cannot be tracked visually.     

BOLD correlates of edge detection in human auditory cortex

Edges are important cues defining coherent auditory objects. As a model of auditory edges, sound on- and offset are particularly suitable to study their neural underpinnings because they contrast a specific physical input against no physical input. Change from silence to sound, that is onset, has extensively been studied and elicits transient neural responses bilaterally in auditory cortex. However, neural activity associated with sound onset is not only related to edge detection but also to novel afferent inputs. Edges at the change from sound to silence, that is offset, are not confounded by novel physical input and thus allow to examine neural activity associated with sound edges per se. In the first experiment, we used silent acquisition functional magnetic resonance imaging and found that the offset of pulsed sound activates planum temporale, superior temporal sulcus and planum polare of the right hemisphere. In the planum temporale and the superior temporal sulcus, offset response amplitudes were related to the pulse repetition rate of the preceding stimulation. In the second experiment, we found that these offset-responsive regions were also activated by single sound pulses, onset of sound pulse sequences and single sound pulse omissions within sound pulse sequences. However, they were not active during sustained sound presentation. Thus, our data show that circumscribed areas in right temporal cortex are specifically involved in identifying auditory edges. This operation is crucial for translating acoustic signal time series into coherent auditory objects.     

Human complex sound analysis

The analysis of complex sound features is important for the perception of environmental sounds, speech and music, and may be abnormal in disorders such as specific language impairment in children, and in common adult lesions including stroke and multiple sclerosis. This work addresses the problem of how the human auditory system detects features in complex sound, and uses those features to perceive the auditory world. The work has been carried out using two independent means of testing the same hypotheses; detailed psychophysical studies of neurological patients with central lesions, and functional imaging using positron emission tomography and functional magnetic resonance imaging of normal subjects. The psychophysical and imaging studies have both examined which brain areas are concerned with the analysis of auditory space, and which are concerned with the analysis of timing information in the auditory system. This differs from many previous human auditory studies, which have concentrated on the analysis of sound frequency. The combined lesion and functional imaging approach has demonstrated analysis of the spatial property of sound movement within the right parietal lobe. The timing work has confirmed that the primary auditory cortex is active as a function of the time structure of sound, and therefore not only concerned with frequency representation of sounds.