Conjoint and extended neural networks for the computation of speech codes: the neural basis of selective impairment in reading words and pseudowords

The computation of speech codes (i.e. phonology) is an important aspect of word reading. Understanding the neural systems and mech- anisms underlying phonological processes provides a foundation for the investigation of language in the brain. We used high-resolution three-dimensional positron emission tomography (PET) to investigate neural systems essential for phonological processes. The burden of neural activities on the computation of speech codes was maximized by three rhyming tasks (rhyming words, pseudowords and words printed in mixed letter cases). Brain activation patterns associated with these tasks were compared with those of two baseline tasks involving visual feature detection. Results suggest strong left lateralized epicenters of neural activity in rhyming irrespective of gender. Word rhyming activated the same brain regions engaged in pseudoword rhyming, suggesting conjoint neural networks for phonological processing of words and pseudowords. However, pseudoword rhyming induced the largest change in cerebral blood flow and activated more voxels in the left posterior prefrontal regions and the left inferior occipital-temporal junction. In addition, pseudoword rhyming activated the left supramarginal gyrus, which was not apparent in word rhyming. These results suggest that rhyming pseudowords requires active participation of extended neural systems and networks not observed for rhyming words. The implications of the results on theories and models of visual word reading and on selective reading dysfunctions after brain lesions are discussed.     

A developmental fMRI study of reading and repetition reveals changes in phonological and visual mechanisms over age

In this study of reading development, children (ages 7-10) and adults (ages 18-32) performed overt single-word reading and aural repetition tasks on high-frequency word stimuli during functional magnetic resonance imaging. Most regions showed similar activity across age groups. These widespread regions of similarity indicate that children and adults use largely overlapping mechanisms when processing high-frequency words. Significant task-related differences included greater activity in occipital cortex for the read task, and greater activity in temporal cortex for the repeat task; activity levels in these regions were similar for adults and children. However, age group differences were found in several posterior regions, including a set of regions implicated in adult reading: the left supramarginal gyrus, the left angular gyrus, and bilateral anterior extrastriate cortex. The angular and supramarginal gyrus regions, hypothesized to play a role in phonology, showed decreased activity in adults relative to children for high-frequency words. The extrastriate regions had significant activity for both the visual read task and auditory repeat task in children, but just for the read task in adults, showing significant task and age interactions. These results are consistent with decreasing reliance on phonological processing, and increasing tuning of visual mechanisms, with age.     

Sound to language: different cortical processing for first and second languages in elementary school children as revealed by a large-scale study using fNIRS

A large-scale study of 484 elementary school children (6-10 years) performing word repetition tasks in their native language (L1-Japanese) and a second language (L2-English) was conducted using functional near-infrared spectroscopy. Three factors presumably associated with cortical activation, language (L1/L2), word frequency (high/low), and hemisphere (left/right), were investigated. L1 words elicited significantly greater brain activation than L2 words, regardless of semantic knowledge, particularly in the superior/middle temporal and inferior parietal regions (angular/supramarginal gyri). The greater L1-elicited activation in these regions suggests that they are phonological loci, reflecting processes tuned to the phonology of the native language, while phonologically unfamiliar L2 words were processed like nonword auditory stimuli. The activation was bilateral in the auditory and superior/middle temporal regions. Hemispheric asymmetry was observed in the inferior frontal region (right dominant), and in the inferior parietal region with interactions: low-frequency words elicited more right-hemispheric activation (particularly in the supramarginal gyrus), while high-frequency words elicited more left-hemispheric activation (particularly in the angular gyrus). The present results reveal the strong involvement of a bilateral language network in children's brains depending more on right-hemispheric processing while acquiring unfamiliar/low-frequency words. A right-to-left shift in laterality should occur in the inferior parietal region, as lexical knowledge increases irrespective of language.     

The functional neuroanatomy of metrical stress evaluation of perceived and imagined spoken words

We hypothesized that areas in the temporal lobe that have been implicated in the phonological processing of spoken words would also be activated during the generation and phonological processing of imagined speech. We tested this hypothesis using functional magnetic resonance imaging during a behaviorally controlled task of metrical stress evaluation. Subjects were presented with bisyllabic words and had to determine the alternation of strong and weak syllables. Thus, they were required to discriminate between weak-initial words and strong-initial words. In one condition, the stimuli were presented auditorily to the subjects (by headphones). In the other condition the stimuli were presented visually on a screen and subjects were asked to imagine hearing the word. Results showed activation of the supplementary motor area, inferior frontal gyrus (Broca's area) and insula in both conditions. In the superior temporal gyrus (STG) and in the superior temporal sulcus (STS) strong activation was observed during the auditory (perceptual) condition. However, a region located in the posterior part of the STS/STG also responded during the imagery condition. No activation of this same region of the STS was observed during a control condition which also involved processing of visually presented words, but which required a semantic decision from the subject. We suggest that processing of metrical stress, with or without auditory input, relies in part on cortical interface systems located in the posterior part of STS/STG. These results corroborate behavioral evidence regarding phonological loop involvement in auditory-verbal imagery.     

DTI tractography of the human brain's language pathways

Diffusion Tensor Imaging (DTI) tractography has been used to detect leftward asymmetries in the arcuate fasciculus, a pathway that links temporal and inferior frontal language cortices. In this study, we more specifically define this asymmetry with respect to both anatomy and function. Twenty right-handed male subjects were scanned with DTI, and the arcuate fasciculus was reconstructed using deterministic tractography. The arcuate was divided into 2 segments with different hypothesized functions, one terminating in the posterior superior temporal gyrus (STG) and another terminating in the middle temporal gyrus (MTG). Tractography results were compared with peak activation coordinates from prior functional neuroimaging studies of phonology, lexical-semantic processing, and prosodic processing to assign putative functions to these pathways. STG terminations were strongly left lateralized and overlapped with phonological activations in the left but not the right hemisphere, suggesting that only the left hemisphere phonological cortex is directly connected with the frontal lobe via the arcuate fasciculus. MTG terminations were also strongly left lateralized, overlapping with left lateralized lexical-semantic activations. Smaller right hemisphere MTG terminations overlapped with right lateralized prosodic activations. We combine our findings with a recent model of brain language processing to explain 6 aphasia syndromes.     

Brain activation during sentence comprehension among good and poor readers

This study sought to increase current understanding of the neuropsychological basis of poor reading ability by using fMRI to examine brain activation during a visual sentence comprehension task among good and poor readers in the third (n = 32) and fifth (n = 35) grades. Reading ability, age, and the combination of both factors made unique contributions to cortical activation. The main finding was of parietotemporal underactivation (less activation than controls) among poor readers at the 2 grade levels. A positive linear relationship (spanning both the poor and good readers) was found between reading ability and activation in the left posterior middle temporal and postcentral gyri and in the right inferior parietal lobule such that activation increased with reading ability. Different developmental trajectories characterized good and poor readers in the left angular gyrus: activation increased with age among good readers, a change that failed to occur among poor readers. The parietotemporal cortex is discussed in terms of its role in reading acquisition, with the left angular gyrus playing a key role. It is proposed that the functioning of the cortical network underlying reading is dependent on a combination of interacting factors, including physiological maturation, neural integrity, skill level, and the nature of the task.     

Reading salt activates gustatory brain regions: FMRI evidence for semantic grounding in a novel sensory modality

Because many words are typically used in the context of their referent objects and actions, distributed cortical circuits for these words may bind information about their form with perceptual and motor aspects of their meaning. Previous work has demonstrated such semantic grounding for sensorimotor, visual, auditory, and olfactory knowledge linked to words, which is manifest in activation of the corresponding areas of the cortex. Here, we explore the brain basis of gustatory semantic links of words whose meaning is primarily related to taste. In a blocked functional magnetic resonance imaging design, Spanish taste words and control words matched for a range of factors (including valence, arousal, imageability, frequency of use, number of letters and syllables) were presented to 59 right-handed participants in a passive reading task. Whereas all the words activated the left inferior frontal (BA44/45) and the posterior middle and superior temporal gyri (BA21/22), taste-related words produced a significantly stronger activation in these same areas and also in the anterior insula, frontal operculum, lateral orbitofrontal gyrus, and thalamus among others. As these areas comprise primary and secondary gustatory cortices, we conclude that the meaning of taste words is grounded in distributed cortical circuits reaching into areas that process taste sensations.     

Functional MRI of sentence comprehension in children with dyslexia: beyond word recognition

Sentence comprehension (SC) studies in typical and impaired readers suggest that reading for meaning involves more extensive brain activation than reading isolated words. Thus far, no reading disability/dyslexia (RD) studies have directly controlled for the word recognition (WR) components of SC tasks, which is central for understanding comprehension processes beyond WR. This experiment compared SC to WR in 29, 9-14 year olds (15 typical and 14 impaired readers). The SC-WR contrast for each group showed activation in left inferior frontal and extrastriate regions, but the RD group showed significantly more activation than Controls in areas associated with linguistic processing (left middle/superior temporal gyri), and attention and response selection (bilateral insula, right cingulate gyrus, right superior frontal gyrus, and right parietal lobe). Further analyses revealed this overactivation was driven by the RD group's response to incongruous sentences. Correlations with out-of-scanner measures showed that better word- and text-level reading fluency was associated with greater left occipitotemporal activation, whereas worse performance on WR, fluency, and comprehension (reading and oral) were associated with greater right hemisphere activation in a variety of areas, including supramarginal and superior temporal gyri. Results provide initial foundations for understanding the neurobiological correlates of higher-level processes associated with reading comprehension.     

Human temporal lobe activation by speech and nonspeech sounds

Functional organization of the lateral temporal cortex in humans is not well understood. We recorded blood oxygenation signals from the temporal lobes of normal volunteers using functional magnetic resonance imaging during stimulation with unstructured noise, frequency-modulated (FM) tones, reversed speech, pseudowords and words. For all conditions, subjects performed a material-nonspecific detection response when a train of stimuli began or ceased. Dorsal areas surrounding Heschl's gyrus bilaterally, particularly the planum temporale and dorsolateral superior temporal gyrus, were more strongly activated by FM tones than by noise, suggesting a role in processing simple temporally encoded auditory information. Distinct from these dorsolateral areas, regions centered in the superior temporal sulcus bilaterally were more activated by speech stimuli than by FM tones. Identical results were obtained in this region using words, pseudowords and reversed speech, suggesting that the speech-tones activation difference is due to acoustic rather than linguistic factors. In contrast, previous comparisons between word and nonword speech sounds showed left-lateralized activation differences in more ventral temporal and temporoparietal regions that are likely involved in processing lexical-semantic or syntactic information associated with words. The results indicate functional subdivision of the human lateral temporal cortex and provide a preliminary framework for understanding the cortical processing of speech sounds.     

Cerebral mechanisms involved in word reading in dyslexic children: a magnetic source imaging approach

The purpose of the present investigation was to describe spatiotemporal brain activation profiles during word reading using magnetic source imaging (MSI). Ten right-handed dyslexic children with severe phonological decoding problems and eight age-matched non-impaired readers were tested in two recognition tasks, one involving spoken and the other printed words. Dyslexic children's activation profiles during the printed word recognition task consistently featured activation of the left basal temporal cortices followed by activation of the right temporoparietal areas (including the angular gyrus). Non-impaired readers showed predominant activation of left basal followed by left temporoparietal activation. In addition, we were able to rule out the hypothesis that hypoactivation of left temporoparietal areas in dyslexics was due to a more general cerebral dysfunction in these areas. Rather, it seems likely that reading difficulties in developmental dyslexia are associated with an aberrant pattern of functional connectivity between brain areas normally involved in reading, namely ventral visual association cortex and temporoparietal areas in the left hemisphere. The interindividual consistency of activation profiles characteristic of children with dyslexia underlines the potential utility of this technique for examining neurophysiological changes in response to specific educational intervention approaches.     

The role of semantics and grammatical class in the neural representation of words

On the basis of neuropsychological and functional imaging evidence, meaning and grammatical class (particularly the verb-noun distinction) have been proposed as organizational principles of linguistic knowledge in the brain. However, previous studies investigating verb and noun processing have been confounded by the presence of systematic correlations between word meaning and grammatical class. In this positron emission tomography study, we investigated implicit word processing using stimuli that allowed the effects of semantic and grammatical properties to be examined independently, without grammatical-semantic confounds. We found that left hemisphere cortical activation during single-word processing was modulated by word meaning, but not by grammatical class. Motor word processing produced significant activation in left precentral gyrus, whereas sensory word processing produced significant activation in left inferior temporal and inferior frontal regions. In contrast to previous studies, there were no effects of grammatical class in left inferior frontal gyrus (IFG). Instead, we found semantic-based differences within left IFG: anterior, but not posterior, left IFG regions responded preferentially to sensory words. These findings demonstrate that the neural substrates of implicit word processing are determined by semantic rather than grammatical properties and suggest that word comprehension involves the activation of modality-specific representations linked to word meaning.     

Watching the brain during meaning acquisition

Acquiring the meaning of a new word in a foreign language can be achieved either by rote memorizing or, similar to meaning acquisition during infancy, by extracting it from context. Little is known about the brain mechanisms involved in word learning. Here we demonstrate, using event-related brain potentials, the rapid development of a brain signature related to lexical and semantic processing during contextual word learning. Healthy volunteers engaged in a simple word-learning task were required to discover the meaning of a novel word from a context during silent reading. After 3 exposures, brain potentials to novel words in meaningful contexts were indistinguishable from real words, although this acquisition effect was not observed for novel words, for which sentence contexts allowed no meaning derivation. Furthermore, when the learned novel words were presented in isolation, an activation of their corresponding meaning was observed, although this process was slower than for real words.     

Memory traces for spoken words in the brain as revealed by the hemodynamic correlate of the mismatch negativity

The mismatch negativity response, considered a brain correlate of automatic preattentive auditory processing, is enhanced for word stimuli as compared with acoustically matched pseudowords. This lexical enhancement, taken as a signature of activation of language-specific long-term memory traces, was investigated here using functional magnetic resonance imaging to complement the previous electrophysiological studies. In passive oddball paradigm, word stimuli were randomly presented as rare deviants among frequent pseudowords; the reverse conditions employed infrequent pseudowords among word stimuli. Random-effect analysis indicated clearly distinct patterns for the different lexical types. Whereas the hemodynamic mismatch response was significant for the word deviants, it did not reach significance for the pseudoword conditions. This difference, more pronounced in the left than right hemisphere, was also assessed by analyzing average parameter estimates in regions of interests within both temporal lobes. A significant hemisphere-by-lexicality interaction confirmed stronger blood oxygenation level-dependent mismatch responses to words than pseudowords in the left but not in the right superior temporal cortex. The increased left superior temporal activation and the laterality of cortical sources elicited by spoken words compared with pseudowords may indicate the activation of cortical circuits for lexical material even in passive oddball conditions and suggest involvement of the left superior temporal areas in housing such word-processing neuronal circuits.     

Word reading and posterior temporal dysfunction in amnestic mild cognitive impairment

Patient studies that combine functional magnetic resonance imaging with chronometric analysis of language dysfunction may reveal the critical contribution of brain areas to language processes as well as shed light on disease pathogenesis. In amnestic mild cognitive impairment (MCI), a prodromal stage of Alzheimer's disease, we examined whether the brain system for associative-semantic judgments with words or with pictures is affected and how this relates to off-line chronometric analysis of word reading and picture naming. A consecutive memory clinic-based series of 13 amnestic MCI patients as well as 13 matched controls participated. One area, the lower bank of the posterior third of the left superior temporal sulcus (STS), showed a significant group-by-task interaction: In controls, it was activated during the associative-semantic condition with words compared with the visuoperceptual control condition but not when the same tasks were compared with pictures as input. In MCI, this word-specific activation was significantly reduced. Response amplitude correlated (r = 0.90) with the steepness of the slope of the time-accuracy curve for word reading. Our data provide converging evidence for a critical contribution of the lower bank of the left posterior STS to mapping word form onto word meaning (lexical-semantic retrieval).     

Language localization with activation positron emission tomography scanning.

We report the first instance of the use of 3-dimensional magnetic resonance imaging anatomically correlated to positron emission tomography (PET) scanning to identify language areas in a patient with an arteriovenous malformation (AVM) in the posterior speech region. The patient was a 24-year-old right-handed woman with an angiographically proven AVM (3-4 cm) in the left mid-posterior second temporal convolution in whom a left intracarotid injection of sodium Amytal produced significant language disruption. A baseline PET cerebral blood flow study identified the AVM, and an activation PET scan performed during the reading and speaking of simple words showed increased activity in the left parastriate cortex (the second visual area), in the left posterior third frontal convolution (Broca's area), and in the left inferior and midtemporal gyri (Wernicke's area). Increased activity was also noted in the right and left transverse temporal (Heschl's) gyri, in the left precentral gyrus, in the left medial superior frontal gyrus (the supplementary motor area), and in the right cerebellum. We conclude that activation PET scanning is useful in the preoperative assessment of patients who harbor cerebral AVMs in classically described speech regions.     

Common and dissociable activation patterns associated with controlled semantic and phonological processing: evidence from FMRI adaptation

Recent evidence suggests specialization of anterior left inferior prefrontal cortex (aLIPC; approximately BA 45/47) for controlled semantics and of posterior LIPC (pLIPC; approximately BA 44/6) for controlled phonology. However, the more automated phonological tasks commonly used raise the possibility that some of the typically extensive aLIPC activation during semantic tasks may relate to controlled language processing beyond the semantic domain. In the present study, an event-related fMRI adaptation paradigm was employed that used a standard controlled semantic task and a phonological task that also emphasized controlled processing. When compared with letter (baseline) processing, significant fMRI task and adaptation effects in the aLIPC and pLIPC regions ( approximately BA 45/47, approximately BA 44) were observed during both semantic and phonological processing, with aLIPC showing the strongest effects during semantic processing. A left frontal region ( approximately BA 6) showed task and relative adaptation effects preferential for phonological processing, and a left temporal region ( approximately BA 21) showed task and relative adaptation effects preferential for semantic processing. Our results demonstrate that aLIPC and pLIPC regions are involved in controlled processing across multiple language domains, arguing against a domain-specific LIPC model and for domain-preferentiality in left posterior frontal and temporal regions.     

The effect of prior visual information on recognition of speech and sounds

To identify and categorize complex stimuli such as familiar objects or speech, the human brain integrates information that is abstracted at multiple levels from its sensory inputs. Using cross-modal priming for spoken words and sounds, this functional magnetic resonance imaging study identified 3 distinct classes of visuoauditory incongruency effects: visuoauditory incongruency effects were selective for 1) spoken words in the left superior temporal sulcus (STS), 2) environmental sounds in the left angular gyrus (AG), and 3) both words and sounds in the lateral and medial prefrontal cortices (IFS/mPFC). From a cognitive perspective, these incongruency effects suggest that prior visual information influences the neural processes underlying speech and sound recognition at multiple levels, with the STS being involved in phonological, AG in semantic, and mPFC/IFS in higher conceptual processing. In terms of neural mechanisms, effective connectivity analyses (dynamic causal modeling) suggest that these incongruency effects may emerge via greater bottom-up effects from early auditory regions to intermediate multisensory integration areas (i.e., STS and AG). This is consistent with a predictive coding perspective on hierarchical Bayesian inference in the cortex where the domain of the prediction error (phonological vs. semantic) determines its regional expression (middle temporal gyrus/STS vs. AG/intraparietal sulcus).     

The neural basis of visual skill learning: an fMRI study of mirror reading

The learning of perceptual skills is thought to rely upon multiple regions in the cerebral cortex, but imaging studies have not yet provided evidence about the changes in neural activity that accompany visual skill learning. Functional magnetic resonance imaging (fMRI) was used to examine changes in activation of posterior brain regions associated with the acquisition of mirror-reading skill for novel and practiced stimuli. Multiple regions in the occipital lobe, inferior temporal cortex, superior parietal cortex and cerebellum were involved in the reading of mirror-reversed compared to normally oriented text. For novel stimuli, skilled mirror-reading was associated with decreased activation in the right superior parietal cortex and posterior occipital regions and increased activation in the left inferior temporal lobe. These results suggest that learning to read mirror- reversed text involves a progression from visuospatial transformation to direct recognition of transformed letters. Reading practiced, relative to unpracticed, stimuli was associated with decreased activation in occipital visual cortices, inferior temporal cortex and superior parietal cortex and increased activation in occipito-parietal and lateral temporal regions. By examining skill learning and item- specific repetition priming in the same task, this study demonstrates that both of these forms of learning exhibit shifts in the set of neural structures that contribute to performance.      

Spatiotemporal interaction between sound form and meaning during spoken word perception

Cortical dynamics of spoken word perception is not well understood. The possible interplay between analysis of sound form and meaning, in particular, remains elusive. We used magnetoencephalography to study cortical manifestation of phonological and semantic priming. Ten subjects listened to lists of 4 words. The first 3 words set a semantic or phonological context, and the list-final word was congruent or incongruent with this context. Attenuation of activation by priming during the first 3 words and increase of activation to semantic or phonological mismatch in the list-final word provided converging evidence: The superior temporal cortex bilaterally was involved in both analysis of sound form and meaning but the role of each hemisphere varied over time. Sensitivity to sound form was observed at approximately 100 ms after word onset, followed by sensitivity to semantic aspects from approximately 250 ms onwards, in the left hemisphere. From approximately 450 ms onwards, the picture was changed, with semantic effects now present bilaterally, accompanied by a subtle late effect of sound form in the right hemisphere. Present MEG data provide a detailed spatiotemporal account of neural mechanisms during speech perception that may underlie characterizations obtained with other neuroimaging methods less sensitive in temporal or spatial domain.     

The potato chip really does look like Elvis! Neural hallmarks of conceptual processing associated with finding novel shapes subjectively meaningful

Clouds and inkblots often compellingly resemble something else--faces, animals, or other identifiable objects. Here, we investigated illusions of meaning produced by novel visual shapes. Individuals found some shapes meaningful and others meaningless, with considerable variability among individuals in these subjective categorizations. Repetition for shapes endorsed as meaningful produced conceptual priming in a priming test along with concurrent activity reductions in cortical regions associated with conceptual processing of real objects. Subjectively meaningless shapes elicited robust activity in the same brain areas, but activity was not influenced by repetition. Thus, all shapes were conceptually evaluated, but stable conceptual representations supported neural priming for meaningful shapes only. During a recognition memory test, performance was associated with increased frontoparietal activity, regardless of meaningfulness. In contrast, neural conceptual priming effects for meaningful shapes occurred during both priming and recognition testing. These different patterns of brain activation as a function of stimulus repetition, type of memory test, and subjective meaningfulness underscore the distinctive neural bases of conceptual fluency versus episodic memory retrieval. Finding meaning in ambiguous stimuli appears to depend on conceptual evaluation and cortical processing events similar to those typically observed for known objects. To the brain, the vaguely Elvis-like potato chip truly can provide a substitute for the King himself.