Brain responses reveal hardwired detection of native-language rule violations

Mismatch negativity (MMN) is a neural correlate of the preattentive detection of any change in the acoustic characteristics of sounds. Here we provide evidence that violations of a purely phonological constraint in a listener's native language can also elicit the brain's automatic change-detection response. The MMN differed between Finnish and Estonian listeners, conditions being equal except for the native language of the listeners. We used two experimental conditions: synthetic vowels in isolation and the same vowels embedded in a pseudo-word context. MMN responses to isolated vowels were similar for Finns and Estonians, while the same vowels in a pseudoword context elicited different MMN patterns depending on the listener's mother tongue.     

Sound localization under perturbed binaural hearing

This paper reports on the acute effects of a monaural plug on directional hearing in the horizontal (azimuth) and vertical (elevation) planes of human listeners. Sound localization behavior was tested with rapid head-orienting responses toward brief high-pass filtered (>3 kHz; HP) and broadband (0.5-20 kHz; BB) noises, with sound levels between 30 and 60 dB, A-weighted (dBA). To deny listeners any consistent azimuth-related head-shadow cues, stimuli were randomly interleaved. A plug immediately degraded azimuth performance, as evidenced by a sound level-dependent shift ("bias") of responses contralateral to the plug, and a level-dependent change in the slope of the stimulus-response relation ("gain"). Although the azimuth bias and gain were highly correlated, they could not be predicted from the plug's acoustic attenuation. Interestingly, listeners performed best for low-intensity stimuli at their normal-hearing side. These data demonstrate that listeners rely on monaural spectral cues for sound-source azimuth localization as soon as the binaural difference cues break down. Also the elevation response components were affected by the plug: elevation gain depended on both stimulus azimuth and on sound level and, as for azimuth, localization was best for low-intensity stimuli at the hearing side. Our results show that the neural computation of elevation incorporates a binaural weighting process that relies on the perceived, rather than the actual, sound-source azimuth. It is our conjecture that sound localization ensues from a weighting of all acoustic cues for both azimuth and elevation, in which the weights may be partially determined, and rapidly updated, by the reliability of the particular cue.     

The detection of constancy amidst change in children: a dissociation of preattentive and intentional processing

This study examined whether 7-9-year-old children preattentively build memories of constancy for individual stimulus features, and if these representations are affected by variability of other stimulus features. This was achieved by looking at the mismatch negativity (MMN) event-related potential to a duration deviant occurring in a stimulus environment in which one or two other features constantly changed. Performance data were also collected, to look at the correspondence between the effects of this manipulation on preattentive and intentional deviance detection. MMN data indicated that the children built a preattentive feature-based memory of constancy that was not affected by the number of varying features. In contrast, intentional deviance detection was considerably impaired by the introduction of feature variability. This dissociation is at variance with previous studies that usually report close association between MMN and behavior.     

An investigation of the auditory streaming effect using event-related brain potentials

There is uncertainty concerning the extent to which the auditory streaming effect is a function of attentive or preattentive mechanisms. The mismatch negativity (MMN), which indexes preattentive acoustic processing, was used to probe whether the segregation associated with the streaming effect occurs preattentively. In Experiment 1, alternating high and low those were presented at fast and slow paces while subjects ignored the stimuli. At the slow pace, tones were heard as alternating high and low pitches, and no MMN was elicited. At the fast pace a streaming effect was induced and an MMN was observed for the low stream, indicating a preattentive locus for the streaming effect. The high deviant did not elicit an MMN. MMNs were obtained to both the high and low deviants when the interval between the across-stream deviance was lengthened to more than 250 ms in Experiment 2, indicating that the MMN system is susceptible to processing constraints.     

Preattentive timing of empty intervals is from marker offset to onset

The internal marker hypothesis explains the superior timing performance for empty intervals over filled intervals by assuming that timing an empty interval starts from the offset of the first marker stimulus and stops at the onset of the second marker stimulus. Other models suggest that timing an empty interval is from first marker onset to second marker onset. We used an electrophysiological measure of preattentive change detection, the mismatch negativity (MMN), to examine processing of empty intervals. Participants watched a silent movie while a stream of auditory stimuli demarcating empty intervals was presented in the background. Most intervals were of the same duration (standards), but shorter intervals (deviants) were presented occasionally also. The pattern of MMN amplitudes obtained across five deviant conditions indicated that preattentive timing of empty intervals occurred from marker offset to onset.     

Critical spectral regions for vowel identification

The first two formant frequencies (F1 and F2) are the cues important for vowel identification. In the categorization of the naturally spoken vowels, however, there are overlaps among the vowels in the F1 and F2 plane. The fundamental frequency (F0), the third formant frequency (F3) and the spectral envelope have been proposed as additional cues. In the present study, to investigate the spectral regions essential for the vowel identification, untrained subjects performed the forced-choice identification task in response to Japanese isolated vowels (/a, o, u, e, i/), in which some spectral regions were deleted. Minimum spectral regions needed for correct vowel identification were the two regions including F1 and F2 (the first and fourth in the quadrisected F1-F2 regions in Bark scale). This was true even when phonetically different vowels had a similar combination of F1 and F2 frequency components. F0 and F3 cues were not necessarily needed. It is concluded that the relative importance in the spectral region is not equivalent, but weighted on the two critical spectral regions. The auditory system may identify the vowels by analyzing the information of the spectral shapes and the formant frequencies (F1 and F2) in these critical spectral regions.     

Preattentive processing of spectral, temporal, and structural characteristics of acoustic regularities: a mismatch negativity study

In the present study we investigated the relationship between detecting violations of structural regularities of tone sequences and detecting deviations from temporal regularities or repetitive spectral auditory stimulus features. Twelve subjects were presented with randomized sequences of two tones (differing both in frequency and intensity) delivered alternately to the left and right ears at a constant stimulus onset asynchrony (SOA). In separate blocks, occasional deviant stimuli broke one, two, or three of the following regularities: spatial alternation, the constancy of SOA, or the dominant frequency-intensity conjunctions. Unlike the mismatch negativity (MMN) elicited by alternation-plus-SOA deviants, the MMN elicited by alternation-plus-conjunction deviants was approximately equal to the sum of the two corresponding single-deviant MMNs. These results suggest that the preattentive change-detection system processes infrequent violations of the structural regularities of sound sequences together with changes in temporal regularities, but separately from changes in repetitive spectral sound features. The MMN elicited by the triple-deviant stimuli corroborated these conclusions.     

Comparison between mismatch negativity amplitude and magnetic mismatch field strength in normal adults

The auditory mismatch negativity (MMN) or its magnetic counterpart (magnetic mismatch field, MMF) has been widely used to assess the ability of stimulus-driven change detection process in humans. The authors evaluated the similarity of inter-individual variation of the response strength between MMN and MMF recordings. Three types of MMN or MMF were recorded in ten healthy subjects: change in duration of pure-tone stimuli, change in duration of the Japanese vowel /a/, and difference between the Japanese vowels /a/ and /o/. There was no significant correlation between MMN amplitude and MMF strength under any condition and in either hemisphere. These results suggest that widely used indices of MMN in the two technologies, i.e., EEG-amplitude and MEG-ECD may not be proportional in an individual. To further clarify the differential significance of recording MMN/MMF may be important to establish MMN/MMF as clinical indices of individual ability of preattentive stage of auditory processing.     

Feature versus gestalt representation of stimuli in the mismatch negativity system of 7- to 9-year-old children

We examined preattentive auditory change detection in 7- to 9-year-old children. The question of interest was whether the preattentive comparison of stimuli indexed by the scalp-recorded mismatch negativity (MMN) was performed on representations of individual stimulus features or on gestalt representations of their combined attributes. The design of the study, based on a work by D. Deacon, J. Nousak, M. Pilotti, W. Ritter, and C. Yang (Psychophysiology, 1998), was such that both feature and gestalt representations could have been available to the comparator mechanism generating the MMN. The data indicated that for the majority of the children-those that exhibited an inverse relationship between the amplitude of the MMN and the probability of the deviant-the MMN was based on feature-specific information. This study also provides a method to obtain MMNs to deviants in three different features in the time usually required to obtain an MMN to a single acoustic feature.     

Sex differences in cue perception in a visual scene: investigation of cue type

Sex differences in spatial navigation indicate that women may focus on positional, landmark cues whereas men favor Euclidean, directional cues. Some studies have investigated sex differences in proximal and distal cue use; however, sex differences in gradient (i.e., graded features) and pinpoint (i.e., single, defined) cue perception remain unexamined. In the current experiments, paired photographs were presented in which the 2nd photograph showed the same scene with cues removed (Experiment 1) or isolated (Experiment 2) from the 1st photograph. In Experiment 1, women showed less disruption of task performance than men showed following cue removal but were slowest after proximal pinpoint cue removal. Male performance was slowed by distal gradient and proximal pinpoint cue removal. In Experiment 2, women were faster than men at identifying isolated proximal and distal pinpoint cues and were more accurate at identifying isolated distal gradient and distal pinpoint cues. Better pinpoint cue perception and memory in women indicates one possible mechanism underlying female preference for landmark-based navigation strategies. Findings also show that whereas men may preferentially rely on distal gradient cues they are not better at perceiving those cues than are women.     

The effects of interstimulus interval on sensory gating and on preattentive auditory memory in the oddball paradigm: Can magnitude of the sensory gating affect preattentive auditory comparison process?

P50, and mismatch negativity (MMN) are components of event-related potentials (ERP) reflecting sensory gating and preattentive auditory memory, respectively. Interstimulus interval (ISI) is an important determinant of the amplitudes of these components and N1. In the present study the interrelation between stimulus gating and preattentive auditory sensory memory were investigated as a function of ISI in 1.5, 2.5 and 3.5 s in 15 healthy volunteered participants. ISI factor affected the N1 peak amplitude significantly. MMN amplitude in 2.5 s ISI was significantly smaller compared to 1.5 and 3.5 s ISI. ISI X stimuli interaction on P50 amplitude was statistically significant. P50 amplitudes to deviant stimuli in 2.5 s ISI were larger than the P50 amplitudes in other ISIs. P50 difference (P50d) waveform amplitude correlated significantly with MMN amplitude. The results suggest that: (i) auditory sensory gating could affect preattentive auditory sensory memory by supplying input to the comparator mechanism; (ii) 2.5 s ISI is important in displaying the sensory gating and preattentive auditory sensory memory relation.     

Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN)

Brain mechanisms extracting invariant information from varying auditory inputs were studied using the mismatch-negativity (MMN) brain response. We wished to determine whether the preattentive sound-analysis mechanisms, reflected by MMN, are capable of extracting invariant relationships based on abstract conjunctions between two sound features. The standard stimuli varied over a large range in frequency and intensity dimensions following the rule that the higher the frequency, the louder the intensity. The occasional deviant stimuli violated this frequency–intensity relationship and elicited an MMN. The results demonstrate that preattentive processing of auditory stimuli extends to unexpectedly complex relationships between the stimulus features.     

Impulsivity affects mismatch negativity (MMN) measures of preattentive auditory processing

The current study addresses the relation between impulsive personality and mismatch negativity (MMN) as measure of auditory processing. In a sample of 33 normals, MMN was measured and related to self-reported measures of impulsive behavior. Participants were tested using a passive auditory oddball paradigm while EEG recordings were obtained. It was found that the negative MMN amplitude at the left lateral cluster was negatively correlated with self-reported impulsivity, with high impulsive individuals showing larger MMN amplitudes than low impulsive individuals. This indicates that impulsivity is related to preattentive auditory processing, a process that is not dependent on response execution. In addition to the well-known involvement of top–down control in impulsivity, these findings implicate that the cognitive bottom–up processing of incoming stimuli is associated with individual differences in impulsivity. Since the source of the MMN is thought to be located in the auditory cortex, this suggests involvement of “lower order” temporal lobe processes in impulsive behaviors.     

Impulsivity affects mismatch negativity (MMN) measures of preattentive auditory processing

The current study addresses the relation between impulsive personality and mismatch negativity (MMN) as measure of auditory processing. In a sample of 33 normals, MMN was measured and related to self-reported measures of impulsive behavior. Participants were tested using a passive auditory oddball paradigm while EEG recordings were obtained. It was found that the negative MMN amplitude at the left lateral cluster was negatively correlated with self-reported impulsivity, with high impulsive individuals showing larger MMN amplitudes than low impulsive individuals. This indicates that impulsivity is related to preattentive auditory processing, a process that is not dependent on response execution. In addition to the well-known involvement of top–down control in impulsivity, these findings implicate that the cognitive bottom–up processing of incoming stimuli is associated with individual differences in impulsivity. Since the source of the MMN is thought to be located in the auditory cortex, this suggests involvement of “lower order” temporal lobe processes in impulsive behaviors.     

Two cognitive systems simultaneously prepared for opposite events.

Event-related potentials (ERPs) were recorded during a go/no-go reaction time (RT) task in which subjects responded to rare target tones and withheld response to frequent tones. In a predictable condition, a rare visual stimulus signalled the impending occurrence of a rare tone, whereas a frequent visual stimulus signalled that a frequent tone would be presented. The rare visual stimuli elicited P3, associated with violations of expectations, whereas the rare tones, being predictable, did not. The rare tones elicited the mismatch negativity (MMN), a component associated with preattentive deviance detection, despite the fact that they were expected. RT was faster in the predictable condition than in another condition in which the tones were not predictable. The P3 and RT data indicate, respectively, that subjects anticipated and were ready to respond to the target tones. The MMN result indicates that immediately before target tones, the preattentive system underlying the MMN was set for frequent tones, being unaffected by the information available to the higher order system. Thus, the higher order cognitive system associated with P3 and the lower order cognitive system associated with the MMN were prepared simultaneously for opposite events.     

Modulation of the mismatch negativity (MMN) to vowel duration changes in native speakers of Finnish and German as a result of language experience.

While crucial for phoneme distinctions in the Finnish language, mere vowel duration is of lower relevance as a phonetically distinctive cue in the German language. To investigate the pre-attentive processing of vowel duration between these two languages, the mismatch negativity (MMN), a component of the auditory event-related potential (ERP) that is an index of automatic auditory change detection, was measured in Finnish and German native speakers for vowel duration changes embedded in the pseudoword sasa. Vowel duration changes thereby were presented as a shortening or a lengthening of either the first- or second-syllable vowel. An additional non-speech condition measured the MMN to duration and frequency changes in tones. In both language groups, diminished MMN amplitudes for the shortening of vowel duration in the word-final syllable suggested a generally more difficult discrimination of vowel duration in a word-final position. Further, shorter MMN latencies for the Finns than the Germans for vowel duration as well as tone duration deviants suggested a generally higher sensitivity to duration contrasts in the Finnish language group. No latency difference between the groups was found for tone frequency processing. Moreover, the Finns, but not the Germans, showed a leftward shift of the MMN scalp distribution for changes in vowel duration, whereas the MMN topography was highly similar between both groups in the tone condition. An enhanced phonetic processing of vowel duration changes and possibly an enhanced processing of sound duration in general is thus indicated for the Finns as a result of their extensive linguistic experience with phonetically distinctive vowel duration contrasts in the native language.     

Within- and between-subject consistency of perceptual segmentation in periodic noise: A combined behavioral tapping and EEG study

It is remarkable that human listeners can perceive periodicity in noise, as the isochronous repetition of a particular noise segment is not accompanied by salient physical cues in the acoustic signal. Previous research suggested that listeners rely on short temporally local and idiosyncratic features to perceptually segment periodic noise sequences. The present study sought to test this assumption by disentangling consistency of perceptual segmentation within and between listeners. Presented periodic noise sequences either consisted of seamless repetitions of a 500-ms segment or of repetitions of a 200-ms segment that were interleaved with 300-ms portions of random noise. Both within- and between-subject consistency was stronger for interleaved (compared with seamless) periodic sequences. The increased consistency likely resulted from reduced temporal jitter of potential features used for perceptual segmentation when the recurring segment was shorter and occurred interleaved with random noise. These results support the notion that perceptual segmentation of periodic noise relies on subtle temporally local features. However, the finding that some specific noise sequences were segmented more consistently across listeners than others challenges the assumption that the features are necessarily idiosyncratic. Instead, in some specific noise samples, a preference for certain spectral features is shared between individuals.     

Neural correlates of reliability-based cue weighting during multisensory integration

Integration of multiple sensory cues is essential for precise and accurate perception and behavioral performance, yet the reliability of sensory signals can vary across modalities and viewing conditions. Human observers typically employ the optimal strategy of weighting each cue in proportion to its reliability, but the neural basis of this computation remains poorly understood. We trained monkeys to perform a heading discrimination task from visual and vestibular cues, varying cue reliability randomly. The monkeys appropriately placed greater weight on the more reliable cue, and population decoding of neural responses in the dorsal medial superior temporal area closely predicted behavioral cue weighting, including modest deviations from optimality. We found that the mathematical combination of visual and vestibular inputs by single neurons is generally consistent with recent theories of optimal probabilistic computation in neural circuits. These results provide direct evidence for a neural mechanism mediating a simple and widespread form of statistical inference.     

Spectral cues explain illusory elevation effects with stereo sounds in cats

Mammals localize sound sources in azimuth based on two binaural cues, interaural differences in the time of arrival and level of the sounds at the ears. In contrast, the cue for elevation is based on patterns of the broadband power spectra at each ear that result from the direction-dependent acoustic filtering properties of the head and pinnae. Although the exact form of this "spectral shape" cue is unknown, most attention has been directed toward a prominent direction-dependent energy minimum, or "notch," because its location in frequency, for both humans and cats, moves predictably from low to high as a source is moved from low to high elevations. However, there is little direct evidence that these spectral notches are important elevational cues in animals other than humans. Here we demonstrate a striking illusion in the localization of sounds in elevation by cats using stimulus configurations that elicit summing localization and the precedence effect that can be explained by spectral shape cues.     

Musical training facilitates the neural discrimination of major versus minor chords in 13-year-old children

Music practice since childhood affects the development of hearing skills. An important classification in Western music is the chords' major-minor dichotomy. Its preattentive auditory discrimination was studied here using a mismatch negativity (MMN) paradigm in 13-year-olds with active hobbies, music-related (music group) or other (control group). In a context of root major chords, root minor chords and inverted major chords were presented infrequently. The interval structure of inverted majors differs more from root majors than the interval structure of root minors. However, the identity of the chords is the same in inverted and root majors (major), but different in root minors. The deviant chords introduced no new frequencies to the paradigm. Hence, an MMN caused by physical deviance was prevented. An MMN was elicited by the minor chords but not by the inverted majors. The MMN amplitude in the music group was larger than in the control group. Thus, the conceptual discrimination skills are present already in the preattentive processing level of the auditory cortex, and musical training can advance these skills.