Auditory imagery mismatch negativity elicited in musicians

A mismatch between auditory sensation and expectant imagery of syllables elicited a possible equivalent of mismatch negativity in a previous study. The purpose of this study was to verify whether auditory imagery from musical notation could also mediate such imagery-based mismatch negativity. Neuromagnetic recording was obtained from eight musicians, who were instructed to identify unpredictably occurring pitch mismatches between a random tone sequence and a visually presented musical score. The difference between incongruent and congruent responses showed a magnetic distribution consistent with two frontal-negative current dipoles bilaterally located in the vicinity of Heschl's gyrus, peaking at approximately 150 ms in latency. This imagery-based mismatch negativity may represent an early neural process of deviance detection between the sensory input and expectant imagery.     

Intracranial identification of an electric frontal-cortex response to auditory stimulus change: a case study

The aim of the present study was to clarify whether ERPs recorded directly from the human frontal cortex contributed to the auditory N1 and mismatch negativity (MMN) elicited by changes in non-phonetic and phonetic sounds. We examined the role of prefrontal cortex in the processing of stimulus repetition and change in a 6-year-old child undergoing presurgical evaluation for epilepsy. EEG was recorded from three bilateral sub-dural electrode strips located over lateral prefrontal areas during unattended auditory stimulation. EEG epochs were averaged to obtain event-related potentials (ERPs) to repeating (standard) tones and to infrequent (deviant) shorter duration tones and complex sounds (telephone buzz). In another condition, ERPs were recorded to standard and deviant syllables, /ba/ and /da/, respectively. ERPs to vibration stimuli delivered to the fingertips were not observed at any of the sub-dural electrodes, confirming modality specificity of the auditory responses. Focal auditory ERPs consisting of P100 and N150 deflections were recorded to both tones and phonemes over the right lateral prefrontal cortex. These responses were insensitive to the serial position of the repeating sound in the stimulus train. Deviant tones evoked an MMN peaking at around 128 ms. Deviant complex sounds evoked ERPs with a similar onset latency and morphology but with an approximately two-fold increase in peak-to-peak amplitude. We conclude that right lateral prefrontal cortex (Brodmann's area 45) is involved in early stages of processing repeating sounds and sound changes.     

Auditory cortex evoked magnetic fields and lateralization of speech processing

Potential use of different auditory evoked brain responses for determining cerebral lateralization of speech function was evaluated. Cortical magnetic fields elicited by plosive syllables or complex non-speech sounds analogous to them were recorded with 122-channel magnetometer. We estimated parameters of magnetic P1, N1 and P2 responses to both stimuli in the two hemispheres and found no hemispheric asymmetry for any of the responses. No correlation between the right-ear advantage, determined with dichotic listening test, and any of asymmetry indexes, calculated for the speech-elicited responses, was observed. These results suggest that P1, N1 and P2 responses to speech signals do not indicate lateralization of speech function in the brain. The results are discussed in relation to previous studies suggesting that the mismatch negativity (MMN) seems to be the only early auditory cortex response sensitive to the lateralization of speech function.     

Phonetic mismatch negativity predicts verbal memory deficits in schizophrenia

Deficits in auditory sensory memory at the electrophysiological level as indexed by mismatch negativity and those in auditory verbal memory at the neuropsychological level have been independently demonstrated in previous studies of schizophrenia. We predicted a specific association between these indices in schizophrenia. Mismatch negativities elicited by change in tone duration and phoneme duration were recorded in 23 schizophrenia patients, who were also evaluated for auditory verbal memory and executive function. Lower amplitude of mismatch negativity under the phoneme-duration condition was significantly associated with worse verbal memory. Phoneme-duration mismatch negativity was not correlated with executive function, nor was tone-duration mismatch negativity correlated with verbal memory. These results suggest that electrophysiological auditory sensory memory dysfunction underlies the basis for neuropsychological auditory verbal memory deficits in schizophrenia.     

The impact of spectral resolution on the mismatch response to Mandarin Chinese tones: An ERP study of cochlear implant simulations

ObjectiveThis study examined the impact of spectral resolution on the processing of lexical tones and the number of frequency channels required for a cochlear implant (CI) to transmit Chinese tonal information to the brain.MethodsERPs were recorded in an auditory oddball task. Normal-hearing participants listened to speech sounds of two tones and their CI simulations in 1, 4, 8, or 32 channels. The mismatch response elicited by speech sounds and CI simulations in different numbers of channels were compared.ResultsThe mismatch negativity (MMN) was observed for speech sounds. For the 1-channel CI simulations, deviants elicited a more positive waveform than standard stimuli. No MMN response was observed with the 4-channel simulations. A reliable MMN response was observed for the 8- and 32-channel simulations. The MMN responses elicited by the 8- and 32-channel simulations were equivalent in magnitudes and smaller than that elicited by speech sounds.ConclusionsMore than eight frequency channels are required for a CI to transmit Chinese tonal information. The presence of both positive and negative mismatch responses suggests multiple mechanisms underlying auditory mismatch responses.SignificanceThe current findings of spectral resolution constraints on the transmission of tonal information should be taken into account in the design of the CI devices.     

Organization of sequential sounds in auditory memory

A repeating five-tone pattern was presented at several stimulus rates (200, 400, 600, and 800 ms onset-to-onset) to determine at what temporal proximity the five-tone repeating unit would be represented in memory. The mismatch negativity component of event-related brain potentials was used to index how the sounds were organized in memory when participants had no task with the sounds. Only at the 200-ms onset-to-onset pace was the five-tone sequence unitized in memory. At presentation rates of 400 ms and above, the regularity (a different frequency tone occurred every fifth tone) was not detected and mismatch negativity was elicited by these tones in the sequence. The results show that temporal proximity plays a role in unitizing successive sounds in auditory memory. These results also suggest that global relationships between successive sounds are represented at the level of auditory cortices.     

Hearing syllables by seeing visual stimuli

Currently it is discussed whether the same cortical areas are activated during the imagination of as during the actual presentation of specific stimuli. Some argue that mostly the secondary but not the primary sensory areas are active during imagination. Using functional magnetic resonance imaging we explored whether auditory verbal imagery of syllables has sufficient power to evoke haemodynamic responses in the auditory cortex. To overcome the detrimental effects of scanner noise, one group of subjects was trained to vividly imagine hearing a syllable while a flashlight was presented. A control group did not receive this training. We found that only the trained group revealed haemodynamic responses in the auditory cortex during auditory imagination while the control group showed no activation within the auditory cortex. Peak activations during auditory verbal imagery are located bilaterally within the superior temporal gyrus region in the vicinity of the planum temporale. While these secondary auditory areas are active during auditory verbal imagery, there was no activation in Heschl's gyrus. We hypothesize that auditory verbal imagery is associated with haemodynamic responses in secondary auditory and not primary auditory areas.     

Multisensory integration of speech sounds with letters vs. visual speech: only visual speech induces the mismatch negativity

Numerous studies have demonstrated that the vision of lip movements can alter the perception of auditory speech syllables (McGurk effect). While there is ample evidence for integration of text and auditory speech, there are only a few studies on the orthographic equivalent of the McGurk effect. Here, we examined whether written text, like visual speech, can induce an illusory change in the perception of speech sounds on both the behavioural and neural levels. In a sound categorization task, we found that both text and visual speech changed the identity of speech sounds from an /aba/‐/ada/ continuum, but the size of this audiovisual effect was considerably smaller for text than visual speech. To examine at which level in the information processing hierarchy these multisensory interactions occur, we recorded electroencephalography in an audiovisual mismatch negativity (MMN, a component of the event‐related potential reflecting preattentive auditory change detection) paradigm in which deviant text or visual speech was used to induce an illusory change in a sequence of ambiguous sounds halfway between /aba/ and /ada/. We found that only deviant visual speech induced an MMN, but not deviant text, which induced a late P3‐like positive potential. These results demonstrate that text has much weaker effects on sound processing than visual speech does, possibly because text has different biological roots than visual speech.     

Impaired cortical network for preattentive detection of change in speech sounds in schizophrenia: a high-resolution event-related potential study

OBJECTIVE: Schizophrenia is associated with language-related dysfunction. At the most basic level, the dysfunction of schizophrenic patients in perceiving phoneme boundaries has been demonstrated in a behavioral task. The goal in this study was to obtain an electrophysiological index of preattentive detection of change in speech sounds by schizophrenic patients. METHOD: A high-density recording system was used to measure mismatch negativity, i.e., difference in electrophysiological responses between standard and deviant auditory stimuli. The amplitude of mismatch negativity was measured in 23 right-handed schizophrenic patients and in 28 healthy comparison subjects. Three types of mismatch negativity were recorded: change in duration of pure-tone stimuli, change in duration of the Japanese vowel /a/, and difference between vowels /a/ and /o/ (across-phoneme change). RESULTS: The schizophrenic patients had a lower amplitude of mismatch negativity for across-phoneme change than for change in duration of tone or vowel. For across-phoneme change, the schizophrenia group showed significantly lower bilateral amplitude of mismatch negativity than the comparison subjects. These findings coincide with those from the analysis of scalp current density, indicating that the schizophrenic patients had a significantly weaker left temporal combination of current sink (perpendicularly sinking into the scalp) and current source (arising out of the scalp) and a significantly weaker right frontal/temporal current sink than the comparison subjects. CONCLUSIONS: These results demonstrate impaired frontotemporal cortical networks for preattentive detection of change in speech sounds in schizophrenia. The language-related dysfunction in schizophrenia may be present at the early stage of auditory processing of relatively simple stimuli, such as phonemes, and not just at stages involving higher-order semantic processes.     

Simultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain

Regular sequences of sounds (i.e., non-random) can usually be described by several, equally valid rules. Rules allowing extrapolation from one sound to the next are termed local rules, those that define relations between temporally non-adjacent sounds are termed global rules. The aim of the present study was to determine whether both local and global rules can be simultaneously extracted from a sound sequence even when attention is directed away from the auditory stimuli. The pre-attentive representation of a sequence of two alternating tones (differing only in frequency) was investigated using the mismatch negativity (MMN) auditory event-related potential. Both local- and global-rule violations of tone alternation elicited the MMN component while subjects ignored the auditory stimuli. This finding suggests that (a) pre-attentive auditory processes can extract both local and global rules from sound sequences, and (b) that several regularity representations of a sound sequence are simultaneously maintained during the pre-attentive phase of auditory stimulus processing.     

A modified parallel paradigm for clinical evaluation of auditory echoic memory

We established a new parallel paradigm for mismatch negativity by presenting repetitive trains of three consonant-vowel syllables and those of three sinusoidal tones alternately. Magnetoencephalography was performed to test the new method, and mismatch negativities in six study participants with normal hearing were compared with the results of the conventional oddball paradigm. Peak amplitude and latencies of mismatch negativity showed no significant difference between the methods. The maximum amplitude in short memory probe interval of 1.0 s was significantly larger than in long memory probe interval of 3.0 s, demonstrating decay in auditory echoic memory caused by a prolonged memory probe interval. The new method facilitated simultaneous evaluation of mismatch negativity with various stimuli in a shorter period.     

Phonological deficit in school children is reflected in the Mismatch Negativity

Deficits in processing of auditory stimuli are known to play an important role in the aetiology of dyslexia. To specify the auditory deficit in children at risk for dyslexia, 19 children with a phonological deficit and 15 controls were tested using the mismatch negativity event-related potential, which reflects preattentive auditory processing. Children with a phonological deficit, not yet suffering from dyslexia, had similar mismatch negativity patterns to dyslexics. The deficit was speech specific, because there were significant group differences only with syllables but not with pure tones.     

Visual processing affects the neural basis of auditory discrimination

The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the "McGurk effect": The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746-748, 1976]. Previous studies have demonstrated the interaction of auditory and visual streams at the auditory cortex level, but the importance of these interactions for the qualitative perception change remained unclear because the change could result from interactions at higher processing levels as well. In our electroencephalogram experiment, we combined the McGurk effect with mismatch negativity (MMN), a response that is elicited in the auditory cortex at a latency of 100-250 msec by any above-threshold change in a sequence of repetitive sounds. An "odd-ball" sequence of acoustic stimuli consisting of frequent /va/ syllables (standards) and infrequent /ba/ syllables (deviants) was presented to 11 participants. Deviant stimuli in the unisensory acoustic stimulus sequence elicited a typical MMN, reflecting discrimination of acoustic features in the auditory cortex. When the acoustic stimuli were dubbed onto a video of a mouth constantly articulating /va/, the deviant acoustic /ba/ was heard as /va/ due to the McGurk effect and was indistinguishable from the standards. Importantly, such deviants did not elicit MMN, indicating that the auditory cortex failed to discriminate between the acoustic stimuli. Our findings show that visual stream can qualitatively change the auditory percept at the auditory cortex level, profoundly influencing the auditory cortex mechanisms underlying early sound discrimination.     

Mismatch responses to lexical tone,initial consonant,and vowel in Mandarin-speaking preschoolers

The present study investigates how age, phonological saliency, and deviance size affect the presence of mismatch negativity (MMN) and positive mismatch response (P-MMR). This work measured the auditory mismatch responses to Mandarin lexical tones, initial consonants, and vowels in 4- to 6-year-old preschoolers using the multiple-deviant oddball paradigm. The data showed the coexistence of MMN and P-MMR in the same age group when responding to the three types of syllabic features in Mandarin. The transition from a predominantly positive response to a predominantly negative response supported the multiple MMN mechanisms. Congruent with the phonological saliency hypothesis and the phonetic acquisition order of Mandarin in behavioral studies, for the compulsory elements of Mandarin syllables, lexical tones, and vowels, the larger deviants elicited adult-like MMNs, whereas the smaller deviants elicited P-MMRs. The optional elements of the Mandarin syllables, the initial consonant, only elicited P-MMR in preschoolers. These findings suggest that MMN and P-MMR index different functional characteristics and may provide information on when and how children's speech perception becomes automatic at different developmental stages.     

Automatic auditory change detection in humans is influenced by visual-auditory associative learning

Automatic detection of auditory changes that violate a regular sound sequence is indexed by the mismatch negativity (MMN) component of the event-related potential. The MMN is considered to reflect an auditory sensory memory and attention switching mechanism. Our aim was to study whether the auditory MMN can be associated with visual cues that have predictive value. By using visual cues that predicted the appearance of a deviant sound in most but not all of the cases, we were able to elicit MMN not only to the deviant sounds but also to those regular sounds that were misleadingly preceded by the visual cue. This result indicates high flexibility in the human automatic auditory change detection system, as it is affected by short-term visual-auditory associative learning.     

Auditory‐evoked potentials to changes in sound duration in urethane‐anaesthetized mice

Spectrotemporally complex sounds carry important information for acoustic communication. Among the important features of these sounds is the temporal duration. An event‐related potential called mismatch negativity indexes auditory change detection in humans. An analogous response (mismatch response) has been found to duration changes in speech sounds in rats but not yet in mice. We addressed whether mice show this response, and, if elicited, whether this response is functionally analogous to mismatch negativity or whether adaptation‐based models suffice to explain them. Auditory‐evoked potentials were epidurally recorded above the mice auditory cortex. The differential response to the changes in a repeated human speech sound /a/ was elicited 53–259 ms post‐change (oddball condition). The differential response was observable to the largest duration change (from 200 to 110 ms). Any smaller (from 200 to 120–180 ms at 10 ms steps) duration changes did elicit an observable response. The response to the largest duration change did not robustly differ in amplitude from the response to the change‐inducing sound presented without its repetitive background (equiprobable condition). The findings suggest that adaptation may suffice to explain responses to duration changes in spectrotemporally complex sounds in anaesthetized mice. The results pave way for development of a variety of murine models of acoustic communication.     

Feature conjunctions and auditory sensory memory

This study sought to obtain additional evidence that transient auditory memory stores information about conjunctions of features on an automatic basis. The mismatch negativity of event-related potentials was employed because its operations are based on information that is stored in transient auditory memory. The mismatch negativity was found to be elicited by a tone that differed from standard tones in a combination of its perceived location and frequency. The result lends further support to the hypothesis that the system upon which the mismatch negativity relies processes stimuli in an holistic manner.     

Organizing sound sequences in the human brain: the interplay of auditory streaming and temporal integration

The present study examined the relationship between two of the early brain processes of sound organization: auditory streaming and the temporal window of integration (TWI). Presented at a fast stimulus delivery rate, two tones alternating in frequency are perceived as separate streams of high and low sounds. However, when two sounds are presented within a ca. 200 ms temporal window, they are often processed as a single auditory event. Both stream segregation and temporal integration occur even in the absence of focused attention as was shown by their effect on the mismatch negativity (MMN) event-related potential. The goal of the present study was to determine the precedence between these two sound organization processes by using the stimulus-omission MMN paradigm. Infrequently omitting one stimulus from a homogeneous tone sequence only elicits an MMN when the stimulus onset asynchrony separating successive tones is shorter than 170 ms. This demonstrates the effect of the TWI. Magnetic brain responses elicited by infrequent stimulus omissions appearing in a sequence of two alternating tones were recorded. The magnetic MMN was elicited by tone omission when the alternating tones formed a single stream (with no or only small frequency separation between the two tones) but not when separate high and low streams emerged in perception (large frequency separation between the two alternating tones). This result shows that auditory streaming takes precedence over the processes of temporal integration.     

Grouping of sequential sounds--an event-related potential study comparing musicians and nonmusicians

It is believed that auditory processes governing grouping and segmentation of sounds are automatic and represent universal aspects of music perception (e.g., they are independent of the listener's musical skill). The present study challenges this view by showing that musicians and nonmusicians differ in their ability to preattentively group consecutive sounds. We measured event-related potentials (ERPs) from professional musicians and nonmusicians who were presented with isochronous tone sequences that they ignored. Four consecutive tones in a sequence could be grouped according to either pitch similarity or good continuation of pitch. Occasionally, the tone-group length was violated by a deviant tone. The mismatch negativity (MMN) was elicited to the deviants in both subject groups when the sounds could be grouped based on pitch similarity. In contrast, MMN was only elicited in musicians when the sounds could be grouped according to good continuation of pitch. These results suggest that some forms of auditory grouping depend on musical skill and that not all aspects of auditory grouping are universal.     

Human auditory cortex tracks task-irrelevant sound sources

The brain organizes sound into coherent sequences, termed auditory streams. We asked whether task-irrelevant sounds would be detected as separate auditory streams in a natural listening environment that included three simultaneously active sound sources. Participants watched a movie with sound while street-noise and sequences of naturally varying footstep sounds were presented in the background. Occasional deviations in the footstep sequences elicited the mismatch negativity (MMN) event-related potential. The elicitation of MMN showed that the regular features of the footstep sequences had been registered and their violations detected, which could only occur if the footstep sequence had been detected as a separate auditory stream. Our results demonstrate that sounds are organized into auditory streams irrespective of their relevance to ongoing behavior.