Categorical perception of lexical tones in Chinese revealed by mismatch negativity

The present study investigated the neurophysiological correlates of categorical perception of Chinese lexical tones in Mandarin Chinese. Relative to standard stimuli, both within- and across-category deviants elicited mismatch negativity (MMN) in bilateral frontal-central recording sites. The MMN elicited in the right sites was marginally larger than in the left sites, which reflects the role of the right hemisphere in acoustic processing. At the same time, relative to within-category deviants, the across-category deviants elicited larger MMN in the left recording sites, reflecting the long-term phonemic traces of lexical tones. These results provide strong neurophysiological evidence in support of categorical perception of lexical tones in Chinese. More important, they demonstrate that acoustic and phonological information is processed in parallel within the MMN time window for the perception of lexical tones. Finally, homologous nonspeech stimuli elicited similar MMN patterns, indicating that lexical tone knowledge influences the perception of nonspeech signals.     

Dissociation of tone and vowel processing in Mandarin idioms

Using event-related potentials, this study measured the access of suprasegmental (tone) and segmental (vowel) information in spoken word recognition with Mandarin idioms. Participants performed a delayed-response acceptability task, in which they judged the correctness of the last word of each idiom, which might deviate from the correct word in either tone or vowel. Results showed that, compared with the correct idioms, a larger early negativity appeared only for vowel violation. Additionally, a larger N400 effect was observed for vowel mismatch than tone mismatch. A control experiment revealed that these differences were not due to low-level physical differences across conditions; instead, they represented the greater constraining power of vowels than tones in the lexical selection and semantic integration of the spoken words. Furthermore, tone violation elicited a more robust late positive component than vowel violation, suggesting different reanalyses of the two types of information. In summary, the current results support a functional dissociation of tone and vowel processing in spoken word recognition.     

Temporal encoding of the voice onset time phonetic parameter by field potentials recorded directly from human auditory cortex

Voice onset time (VOT) is an important parameter of speech that denotes the time interval between consonant onset and the onset of low-frequency periodicity generated by rhythmic vocal cord vibration. Voiced stop consonants (/b/, /g/, and /d/) in syllable initial position are characterized by short VOTs, whereas unvoiced stop consonants (/p/, /k/, and t/) contain prolonged VOTs. As the VOT is increased in incremental steps, perception rapidly changes from a voiced stop consonant to an unvoiced consonant at an interval of 20-40 ms. This abrupt change in consonant identification is an example of categorical speech perception and is a central feature of phonetic discrimination. This study tested the hypothesis that VOT is represented within auditory cortex by transient responses time-locked to consonant and voicing onset. Auditory evoked potentials (AEPs) elicited by stop consonant-vowel (CV) syllables were recorded directly from Heschl's gyrus, the planum temporale, and the superior temporal gyrus in three patients undergoing evaluation for surgical remediation of medically intractable epilepsy. Voiced CV syllables elicited a triphasic sequence of field potentials within Heschl's gyrus. AEPs evoked by unvoiced CV syllables contained additional response components time-locked to voicing onset. Syllables with a VOT of 40, 60, or 80 ms evoked components time-locked to consonant release and voicing onset. In contrast, the syllable with a VOT of 20 ms evoked a markedly diminished response to voicing onset and elicited an AEP very similar in morphology to that evoked by the syllable with a 0-ms VOT. Similar response features were observed in the AEPs evoked by click trains. In this case, there was a marked decrease in amplitude of the transient response to the second click in trains with interpulse intervals of 20-25 ms. Speech-evoked AEPs recorded from the posterior superior temporal gyrus lateral to Heschl's gyrus displayed comparable response features, whereas field potentials recorded from three locations in the planum temporale did not contain components time-locked to voicing onset. This study demonstrates that VOT at least partially is represented in primary and specific secondary auditory cortical fields by synchronized activity time-locked to consonant release and voicing onset. Furthermore, AEPs exhibit features that may facilitate categorical perception of stop consonants, and these response patterns appear to be based on temporal processing limitations within auditory cortex. Demonstrations of similar speech-evoked response patterns in animals support a role for these experimental models in clarifying selected features of speech encoding.     

Suprasegmental speech cues are automatically processed by the human brain: a mismatch negativity study

This study investigates the electrical brain activity correlates of the automatic detection of suprasegmental and local speech cues by using a passive oddball paradigm, in which the standard Hungarian word 'banán' ('banana' in English) was contrasted with two deviants: a voiceless phoneme deviant ('panán'), and a stress deviant, where the stress was on the second syllable, instead of the obligatory first one. As a result, we obtained the mismatch negativity component (MMN) of event-related brain potentials in each condition. The stress deviant elicited two MMNs: one as a response to the lack of stress as compared to the standard stimulus, and another to the additional stress. Our results support that the MMN is as valuable in investigating processing characteristics of suprasegmental features as in that of phonemic features. MMN data may provide further insight into pre-attentive processes contributing to spoken word recognition.     

ERP correlates of pre-attentive processing of Cantonese lexical tones: The effects of pitch contour and pitch height

The pre-attentive processing of Cantonese tones was studied with an auditory passive oddball paradigm. Event-related potentials to standard and deviant auditory stimuli were recorded as participants watched a silent movie attentively. The standards and deviants differed in either pitch level or pitch contour. Mismatch negativity (MMN) and P3a were elicited by all types of deviant tones, suggesting that lexical tone was processed pre-attentively. In addition, the size and latency of MMN were sensitive to the size of pitch level change, while the latency of P3a captured the presence of pitch contour change. These results indicate that pitch contour and pitch height are two important dimensions in sensory processing of lexical tones.     

Differential processing of terminal tone parts within structured and non-structured tones

Recent studies utilizing the mismatch negativity (MMN) event-related potential (ERP) revealed that when a repetitive sequence of sinusoidal tones is presented, the occasional insertion of a short deviation into some of the tones leads to the elicitation of an MMN only if it occurs during the initial 300 ms, but not beyond. In contrast, deviations occurring in speech sounds elicit MMN even beyond 300 ms. We conducted two experiments to resolve this conflict. We hypothesised that an additional transient within an otherwise unstructured tone may overcome this limitation. First, we tested for MMN to a deviance at the terminal part of a 650 ms tone which did or did not contain a gap. Only when the tone included the gap, MMN was obtained. Second, we compared the gap condition with two noise conditions, in which the gap was replaced by modulated white noise. The noise conditions differed with respect to the saliency of the perceived interruption of the tone. In all three conditions, MMN was elicited. These results demonstrate that structuring a sinusoidal tone by a gap or a noise interval is sufficient to regain MMN. It is suggested that the introduction of an additional transient triggers a new integration window overcoming the temporal constraints of automatic tone representation. This resolves the seeming contradiction between MMN studies using tonal and speech sounds.     

The temporal window of integration in elderly and young adults

Integration of information across time is an essential part of auditory processing. Evidence from a variety of experiments support the notion of an approximately 200-ms long time window following the onset of a sound, during which a unitary sound representation is formed (the temporal window of integration, TWI). The temporal resolution in the auditory system is assumed to decrease with aging suggesting that the duration of the TWI may be longer in elderly than young adults. The TWI duration was assessed in young and elderly adults using the oddball paradigm in which a regular auditory event (standard) is occasionally exchanged for a different event (deviant). Previous studies showed that when the stimulus onset asynchrony (SOA) exceeds the duration of the TWI, two successive deviations occurring infrequently in a repetitive sound sequence elicit two separate mismatch negativity (MMN) event-related brain potentials. However, only one MMN is elicited when the SOA is shorter than the TWI. Experiment 1 tested MMN elicitation for the second of two successive deviant sounds as a function of the SOA. Experiment 2 used the sound omission paradigm, in which MMN is only elicited by omissions when the SOA is shorter than the TWI. Again, MMN elicitation was tested by infrequent tone omissions as a function of the SOA. Results showed no significant differences between elderly and younger participants as a function of SOA. This suggests that the duration of the TWI is approximately between 200 and 250 ms in both groups of subjects. On the other hand, the lower MMN amplitudes elicited by frequency deviation in the elderly compared with the younger participants suggest that the specificity of frequency representation deteriorates with aging.     

Event-Related Potentials and Autonomic Responses to a Change in Unattended Auditory Stimuli

Event-related brain potentials (ERPs) and autonomic nervous system (ANS) responses to occasional pitch and rise-time changes in a task-irrelevant auditory stimulus repeating at short intervals were measured while the subject performed a difficult intellectual task (Raven Matrices). It was found that deviant stimuli elicited the mismatch negativity (MMN) component of the ERP even when they elicited no ANS response. There was no significant difference in the mismatch negativity between trials in which the skin conductance response was or was not elicited. The pitch deviant tone also elicited heart rate deceleration, whereas the rise-time deviant tone tended to elicit a later heart rate acceleration. Neither heart rate change correlated with the mismatch negativity. The pattern of results obtained suggests that the mismatch negativity is generated by an automatic discrimination process associated with the cerebral events initiating the orienting response to stimulus change, but does not necessarily lead to the orienting response elicitation. Longer-latency ERP components tended to show slight covariation with ANS responses. The P3 was larger when a skin conductance response was elicited than when it was not elicited. Further, heart rate change trials tended to be accompanied by larger slow waves than trials with no heart rate response. Heart rate acceleration trials were accompanied by a larger slow parietal positivity and a smaller frontal negativity than were heart rate deceleration trials.     

The elicitation of phonological and semantic neuromagnetic field components by non-words in human auditory sentence comprehension

The current research examined whether neuromagnetic field components relating to pre-lexical and semantic analysis would be evoked by non-word violations in Japanese auditory sentence comprehension. Stimuli contained semantically congruent short vowel-duration words, long vowel-duration non-words, and short-duration non-words with a deviant second syllable. Native speakers listened to sentences, while neuromagnetic fields were recorded with a twin 37-channel gradiometer system. The results in the 200-400 ms time window showed that at a peak latency of approximately 300 ms, vowel-lengthening and deviant-syllable violations produced larger magnetic fields than congruent words. In the 450-600 ms time range, the magnetic fields in response to deviant-syllable violations, but not vowel-lengthening violations, were larger than congruent words, with the peak latency at approximately 500 ms. The elicitations of M300 and M500 components in this study support the biphasic hypothesis where a pre-lexical phonological analysis stage precedes a post-lexical semantic integration stage in lexical recognition of a native language.     

Early emotion word processing: evidence from event-related potentials

Behavioral and electrophysiological responses were monitored to 80 controlled sets of emotionally positive, negative, and neutral words presented randomly in a lexical decision paradigm. Half of the words were low frequency and half were high frequency. Behavioral results showed significant effects of frequency and emotion as well as an interaction. Prior research has demonstrated sensitivity to lexical processing in the N1 component of the event-related brain potential (ERP). In this study, the N1 (135-180 ms) showed a significant emotion by frequency interaction. The P1 window (80-120 ms) preceding the N1 as well as post-N1 time windows, including the Early Posterior Negativity (200-300 ms) and P300 (300-450 ms), were examined. The ERP data suggest an early identification of the emotional tone of words leading to differential processing. Specifically, high frequency negative words seem to attract additional cognitive resources. The overall pattern of results is consistent with a time line of word recognition in which semantic analysis, including the evaluation of emotional quality, occurs at an early, lexical stage of processing.     

Automatic time perception in the human brain for intervals ranging from milliseconds to seconds

Time perception in everyday life deals with various intervals. Here we investigated whether an automatic duration-discrimination mechanism in audition operates even for intervals of an order of seconds, by using the mismatch negativity (MMN), an index of automatic change detection in audition. In Experiment 1, occasional decrements of the duration of a repetitive "standard" tone elicited an MMN in subjects ignoring auditory stimulation, even with the standard-stimulus durations over a second. Nevertheless, the MMN amplitude was significantly diminished with standard-stimulus durations of 800 ms and above, despite the fact that a constant deviant versus standard duration ratio was used. Complementary experiments varying the interstimulus interval (Experiment 2) and the magnitude of duration change (Experiment 3) yielded corroborating results. The present results suggest that automatic duration discrimination in audition operates even for durations of the order of seconds; yet its optimum time scale might be of the order of milliseconds.     

Hydrogen-rich saline reduces oxidative stress and inflammation by inhibit of JNK and NF-κB activation in a rat model of amyloid-beta-induced Alzheimer's disease

Dyslexia is characterized by deficits in phonological processing abilities. However, it is unclear what the underlying factors for poor phonological abilities or speech sound representations are. One hypothesis suggests that individuals with dyslexia have problems in basic acoustic perception which in turn can also cause problems in speech perception. Here basic auditory processing was assessed by auditory event-related potentials recorded for paired tones presented in an oddball paradigm in 9-year-old children with dyslexia and a familial background of dyslexia, typically reading children at familial risk for dyslexia and control children without risk for dyslexia. The tone pairs elicited a P1-N250 complex with emerging N1-P2 complex. Control children showed larger responses over the left-than-right hemisphere at the P1 and P2 time windows for both short and long within-pair intervals (WPI; 10 and 255ms) whereas children with dyslexia showed this pattern only for the tone pairs with the long WPI. The response for the pairs with the short WPI showed equal amplitudes over both hemispheres in children with dyslexia. The findings indicate that individuals with dyslexia process basic auditory information differently when the tones are within the temporal window of integration.     

Temporal grouping affects the automatic processing of deviant sounds

The present study investigates the influence of auditory temporal grouping on automatic sound processing. We compared the mismatch negativity (MMN) event-related potential elicited by successive deviant tones in a condition in which sounds were organized in tone pairs with respective MMN obtained in a non-paired sequence. When successive deviants belonged to different tone pairs the second deviant elicited a higher MMN amplitude than the corresponding deviant in the non-paired condition. Moreover, this temporal grouping had immediate effects on the extraction of rules as revealed by the finding that first and single deviants at the second position of a tone pair elicited larger MMNs than corresponding deviants in the non-paired condition or first and single deviants at the first position of a tone pair. Results demonstrate that auditory objects generated by temporal proximity are treated as relatively encapsulated units and that automatic deviance-detection may rely on multiple hierarchically organized representations of sound sequences.     

Automatic integration of auditory and visual information is not simultaneous in Chinese

ERP studies have revealed that for alphabetic languages letter/speech-sound integration develops with brain maturation and reading instruction over a relatively long period of time. Experienced adult readers associate letters and speech sounds automatically, as indexed by enhanced mismatch negativity (MMN) to simultaneously presented stimuli, but reveal attenuated MMN when the speech sound stimuli are presented with a delay. Chinese as a logographic language differs substantially from alphabetic languages and therefore integration processes might be characterized by unique timing mechanisms. In the present study, MMN was used to investigate the timing and automaticity of association between characters and lexical tones in adult native Chinese speakers. A character was presented simultaneously with a lexical tone, or with either a 100 ms stimulus onset asynchrony (SOA) or a 200 ms SOA in separate conditions. MMN was enhanced when the character and the lexical tone were presented with 100 ms SOA, while no significant MMN enhancement was observed with simultaneous presentation or with 200 ms SOA. These results suggest that the automatic association of characters and lexical tones in experienced Chinese adult readers requires more processing time than for alphabetic languages. These results highlight critical differences between fundamental reading processes across different writing systems. The neural differences between alphabetic and logographic languages for letter/character and speech-sound/tone integration need to be taken into consideration when considering past and future research on reading processes in these languages and especially for investigations of reading disorders, such as developmental dyslexia.     

Functional features of crossmodal mismatch responses

Research on brain mechanisms of deviance detection and sensory memory trace formation, best indexed by the mismatch negativity, mainly relied on the investigation of responses elicited by auditory stimuli. However, comparable less research reported the mismatch negativity elicited by somatosensory stimuli. More importantly, little is known on the functional features of mismatch deviant and standard responses across different sensory modalities. To directly compare different sensory modalities, we adopted a crossmodal roving paradigm and collected event-related potentials elicited by auditory, non-nociceptive somatosensory, and nociceptive trains of stimuli, during Active and Passive attentional conditions. We applied a topographical segmentation analysis to cluster successive scalp topographies with quasi-stable landscape of significant differences to extract crossmodal mismatch responses. We obtained three main findings. First, across different sensory modalities and attentional conditions, the formation of a standard sensory trace became robust mainly after the second stimulus repetition. Second, the neural representation of a modality deviant stimulus was influenced by the preceding sensory modality. Third, the mismatch negativity significantly covaried between Active and Passive attentional conditions within the same sensory modality, but not between different sensory modalities. These findings provide robust evidence that, while different modalities share a similar process of standard trace formation, the process of deviance detection is largely modality dependent.     

Cortical Activity Elicited by Changes in Auditory Stimuli: Different Sources for the Magnetic N1OOm and Mismatch Responses

Magnetic responses to frequent and infrequent auditory stimuli, all presented in the same stimulus block in randomized order, were recorded. The standard stimuli, comprising 90% of all the stimuli, were 100-ms, 1000 Hz, 90dB sinusoidal tone bursts. There were three deviant tones, each presented at a probability of 3.3%, which differed from the standard tone on one dimension only: frequency deviant (1500 Hz), intensity deviant (67dB SPL), or duration deviant (50 ms). All mismatch fields, i.e., responses elicited by different deviants, as well as N100m to the standards and deviants, could be explained by neural activity in the supratemporal auditory cortex. The source of N100m to standards and deviants was significantly posterior to the sources for the three different mismatch fields. The mean locations of the equivalent dipoles for the different mismatch fields did not differ significantly from each other, but some differences were found for individual subjects.     

ERPs for infrequent omissions and inclusions of stimulus elements

A negative event-related potential (ERP) wave called mismatch negativity (MMN) is elicited by an infrequent deviant stimulus in a sequence of frequent standard stimuli. Omission of a stimulus in a sequence of stimuli, however, has been considered to elicit a negativity different from MMN. The present study addressed this issue by examining ERPs for infrequent omissions and inclusions of compound stimuli or their elements. Three kinds of stimuli were presented: a 1000-Hz sine wave tone (Sine), white noise with the 1000-Hz frequency sharply filtered out (Noise), and a composite of the pure tone and the filtered white noise (SiNoise). All stimuli had 50 ms duration and were presented with a regular interstimulus interval of 650 ms. Intensities were 75 dB SPL for the tone and noise stimuli and slightly higher for the composite stimulus. The three kinds of stimuli were presented on separate runs, either as the frequent stimulus or one of two infrequent stimuli, each with 10% probability. Infrequent omission of the large stimulus element (Sine deviant to SiNoise) tended to elicit later MMN than inclusion of the same element (SiNoise deviant to Sine). Omission of the small stimulus element (Noise deviant to SiNoise) elicited a smaller and later MMN than did inclusion of the same element (SiNoise deviant to Noise). These data suggest that MMNs are also elicited by partial stimulus omissions, although they seem to be more sensitive to other kinds of stimulus deviances.     

The Development of Mismatch Responses to Mandarin Lexical Tones in Early Infancy

This study examined how maturation and the size of deviance affect the development of mismatch responses to Mandarin lexical tones by a multi-deviant oddball paradigm with both large deviant T1/T3 and small deviant T2/T3 pairs in newborns and 6-month-olds. The T1/T3 pair elicited a positive mismatch response (P-MMR) at birth but an adult-like mismatch negativity (MMN) at 6 months of age. For the T2/T3 pair, no significant MMR was seen in newborns, whereas a P-MMR was found when infants are 6 months old. Results suggest that the developmental trajectories of MMRs are dependent on the neural maturation and the discriminability of tonal changes.     

Auditory sensory memory and the aging brain: A mismatch negativity study

The mismatch negativity (MMN) component of the auditory event-related potential has been used in the past to study between group differences in the accuracy and retention of information in auditory sensory memory (ASM). The MMN is elicited by infrequent 'deviant' tones that differ from a repeating 'standard' tone. In the present study, the type of deviant and the time interval between tones (stimulus-onset asynchrony: SOA) were manipulated in a study of normal aging. MMN responses of an elderly (mean age = 69) and a young group (mean age = 21) to both a duration and a frequency deviant tone were measured at a short (450 ms) and long (3 s) SOA. A smaller and later MMN (recorded at Fz) was observed in the elderly relative to the young group across SOA and Deviant conditions. The results are consistent with an age-related deficit in the encoding of sound properties in ASM. However, analysis of the MMN reversal at the mastoids provides some support for the proposal that the elderly have an additional deficit related to the retention of information in ASM.     

Short‐term trained lexical categories affect preattentive shape perception: Evidence from vMMN

Perceptual processing of colors and shapes in the right visual field is modulated by the lexical category information of the stimuli, a phenomenon known as the lateralized Whorfian effect. For color stimuli, lateralized Whorfian effect is characterized by preattentive occurrence and dependency on acquired lexical information, but it remains unknown whether these key features are generalizable to other domains of perceptual processing. Here, we investigated whether lateralized Whorfian effect in the shape perception domain also depends on acquired lexical category and occurs preattentively using ERPs. Participants were trained to associate novel, irregular polygons with lexical category labels via short‐term intensive training. Using the visual oddball paradigm, we found stronger visual mismatch negativity (vMMN) component elicited by the deviant stimuli whose lexical category differed from the standard stimuli when the deviant was presented in the right visual field, indicating higher perceptual conspicuity for between‐category stimuli. These findings provide direct evidence of similar preattentive lexical category‐contingent modulation on shape perception akin to color perception, suggesting that the lateralized Whorfian effect is not epiphenomenal but rather might reflect the interaction between higher‐level lexical processing and the lower‐level perceptual processing more broadly.