Selective visuo-haptic processing of shape and texture

Previous functional neuroimaging studies have described shape-selectivity for haptic stimuli in many cerebral cortical regions, of which some are also visually shape-selective. However, the literature is equivocal on the existence of haptic or visuo-haptic texture-selectivity. We report here on a human functional magnetic resonance imaging (fMRI) study in which shape and texture perception were contrasted using haptic stimuli presented to the right hand, and visual stimuli presented centrally. Bilateral selectivity for shape, with overlap between modalities, was found in a dorsal set of parietal areas: the postcentral sulcus and anterior, posterior and ventral parts of the intraparietal sulcus (IPS); as well as ventrally in the lateral occipital complex. The magnitude of visually- and haptically-evoked activity was significantly correlated across subjects in the left posterior IPS and right lateral occipital complex, suggesting that these areas specifically house representations of object shape. Haptic shape-selectivity was also found in the left postcentral gyrus, the left lingual gyrus, and a number of frontal cortical sites. Haptic texture-selectivity was found in ventral somatosensory areas: the parietal operculum and posterior insula bilaterally, as well as in the right medial occipital cortex, overlapping with a medial occipital cortical region, which was texture-selective for visual stimuli. The present report corroborates and elaborates previous suggestions of specialized visuo-haptic processing of texture and shape.     

Dissociable effects of top-down and bottom-up attention during episodic encoding

It is well established that the formation of memories for life's experiences-episodic memory-is influenced by how we attend to those experiences, yet the neural mechanisms by which attention shapes episodic encoding are still unclear. We investigated how top-down and bottom-up attention contribute to memory encoding of visual objects in humans by manipulating both types of attention during fMRI of episodic memory formation. We show that dorsal parietal cortex-specifically, intraparietal sulcus (IPS)-was engaged during top-down attention and was also recruited during the successful formation of episodic memories. By contrast, bottom-up attention engaged ventral parietal cortex-specifically, temporoparietal junction (TPJ)-and was also more active during encoding failure. Functional connectivity analyses revealed further dissociations in how top-down and bottom-up attention influenced encoding: while both IPS and TPJ influenced activity in perceptual cortices thought to represent the information being encoded (fusiform/lateral occipital cortex), they each exerted opposite effects on memory encoding. Specifically, during a preparatory period preceding stimulus presentation, a stronger drive from IPS was associated with a higher likelihood that the subsequently attended stimulus would be encoded. By contrast, during stimulus processing, stronger connectivity with TPJ was associated with a lower likelihood the stimulus would be successfully encoded. These findings suggest that during encoding of visual objects into episodic memory, top-down and bottom-up attention can have opposite influences on perceptual areas that subserve visual object representation, suggesting that one manner in which attention modulates memory is by altering the perceptual processing of to-be-encoded stimuli.     

Distinctive neural mechanisms supporting visual object individuation and identification

Many everyday activities, such as driving on a busy street, require the encoding of distinctive visual objects from crowded scenes. Given resource limitations of our visual system, one solution to this difficult and challenging task is to first select individual objects from a crowded scene (object individuation) and then encode their details (object identification). Using functional magnetic resonance imaging, two distinctive brain mechanisms were recently identified that support these two stages of visual object processing. While the inferior intraparietal sulcus (IPS) selects a fixed number of about four objects via their spatial locations, the superior IPS and the lateral occipital complex (LOC) encode the features of a subset of the selected objects in great detail (object shapes in this case). Thus, the inferior IPS individuates visual objects from a crowded display and the superior IPS and higher visual areas participate in subsequent object identification. Consistent with the prediction of this theory, even when only object shape identity but not its location is task relevant, this study shows that object individuation in the inferior IPS treats four identical objects similarly as four objects that are all different, whereas object shape identification in the superior IPS and the LOC treat four identical objects as a single unique object. These results provide independent confirmation supporting the dissociation between visual object individuation and identification in the brain.     

Visuo-motor integration in humans: Cortical patterns of response lateralisation and functional connectivity

Purpose

We assessed response and functional connectivity patterns of different parts of the visual and motor cortices during visuo-motor integration with particular focus on the intraparietal sulcus (IPS).

Methods

Brain activity was measured during a visuo-motor task in 14 subjects using event-related fMRI. During central fixation, a blue or red target embedded in an array of grey distractors was presented for 250 ms in either the left or right visual hemifield. After a delay, the subjects were prompted to press the upper or lower response button for targets in the upper and lower hemifield with the left or right thumb for blue and red targets, respectively. The fMRI responses were evaluated for different regions of interests (ROIs), and the functional connectivity of the IPS subregions with these ROIs was quantified.

Results

In an anterior IPS region and a region in the anterior premotor cortex, presumably the frontal eye fields (FEF), visually driven responses were dominant contralateral to both visual stimulus and effector. Thus, the anterior IPS combines, in contrast to the posterior IPS and the occipital cortex, response properties of cortex activated by visual input and by motor output. Further, functional connectivity with the motor areas was stronger for the anterior than for the posterior IPS regions.

Discussion

Anterior IPS and FEF appear to be of major relevance for relating visual and effector information during visuo-motor integration. Patient studies with the devised paradigm are expected to uncover the impact of pathophysiologies and plasticity on the observed cortical lateralisation patterns.     

Deconstructing the architecture of dorsal and ventral attention systems with dynamic causal modeling

Attentional orientation to a spatial cue and reorientation-after invalid cueing-are mediated by two distinct networks in the human brain. A bilateral dorsal frontoparietal network, comprising the intraparietal sulcus (IPS) and the frontal eye fields (FEF), controls the voluntary deployment of attention and may modulate visual cortex in preparation for upcoming stimulation. In contrast, reorienting attention to invalidly cued targets engages a right-lateralized ventral frontoparietal network comprising the temporoparietal junction (TPJ) and ventral frontal cortex. The present fMRI study investigated the functional architecture of these two attentional systems by characterizing effective connectivity during lateralized orienting and reorienting of attention, respectively. Subjects performed a modified version of Posner's location-cueing paradigm. Dynamic causal modeling (DCM) of regional responses in the dorsal and ventral network, identified in a conventional (SPM) whole-brain analysis, was used to compare different functional architectures. Bayesian model selection showed that top-down connections from left and right IPS to left and right visual cortex, respectively, were modulated by the direction of attention. Moreover, model evidence was highest for a model with directed influences from bilateral IPS to FEF, and reciprocal coupling between right and left FEF. Invalid cueing enhanced forward connections from visual areas to right TPJ, and directed influences from right TPJ to right IPS and IFG (inferior frontal gyrus). These findings shed further light on the functional organization of the dorsal and ventral attentional network and support a context-sensitive lateralization in the top-down (backward) mediation of attentional orienting and the bottom-up (forward) effects of invalid cueing.     

Shape saliency modulates contextual processing in the human lateral occipital complex

Visual context influences our perception of target objects in natural scenes. However, little is known about the analysis of context information and its role in shape perception in the human brain. We investigated whether the human lateral occipital complex (LOC), known to be involved in the visual analysis of shapes, also processes information about the context of shapes within cluttered scenes. We employed an fMRI adaptation paradigm in which fMRI responses are lower for two identical than for two different stimuli presented consecutively. The stimuli consisted of closed target contours defined by aligned Gabor elements embedded in a background of randomly oriented Gabors. We measured fMRI adaptation in the LOC across changes in the context of the target shapes by manipulating the position and orientation of the background elements. No adaptation was observed across context changes when the background elements were presented in the same plane as the target elements. However, adaptation was observed when the grouping of the target elements was enhanced in a bottom-up (i.e., grouping by disparity or motion) or top-down (i.e., shape priming) manner and thus the saliency of the target shape increased. These findings suggest that the LOC processes information not only about shapes, but also about their context. This processing of context information in the LOC is modulated by figure-ground segmentation and grouping processes. That is, neural populations in the LOC encode context information when relevant to the perception of target shapes, but represent salient targets independent of context changes.     

Network activity underlying the illusory self‐attribution of a dummy arm

Neuroimaging has demonstrated that the illusory self‐attribution of body parts engages frontal and intraparietal brain areas, and recent evidence further suggests an involvement of visual body‐selective regions in the occipitotemporal cortex. However, little is known about the principles of information exchange within this network. Here, using automated congruent versus incongruent visuotactile stimulation of distinct anatomical locations on the participant's right arm and a realistic dummy counterpart in an fMRI scanner, we induced an illusory self‐attribution of the dummy arm. The illusion consistently activated a left‐hemispheric network comprising ventral premotor cortex (PMv), intraparietal sulcus (IPS), and body‐selective regions of the lateral occipitotemporal cortex (LOC). Importantly, during the illusion, the functional coupling of the PMv and the IPS with the LOC increased substantially, and dynamic causal modeling revealed a significant enhancement of connections from the LOC and the secondary somatosensory cortex to the IPS. These results comply with the idea that the brain's inference mechanisms rely on the hierarchical propagation of prediction error. During illusory self‐attribution, unpredicted ambiguous sensory input about one's body configuration may result in the generation of such prediction errors in visual and somatosensory areas, which may be conveyed to parietal integrative areas. Hum Brain Mapp 36:2284–2304, 2015. © 2015 Wiley Periodicals, Inc.     

Developmental increase in top-down and bottom-up processing in a phonological task: an effective connectivity, fMRI study

We examined age-related changes in the interactions among brain regions in children performing rhyming judgments on visually presented words. The difficulty of the task was manipulated by including a conflict between task-relevant (phonological) information and task-irrelevant (orthographic) information. The conflicting conditions included pairs of words that rhyme despite having different spelling patterns (jazz-has), or words that do not rhyme despite having similar spelling patterns (pint-mint). These were contrasted with nonconflicting pairs that have similar orthography and phonology (dime-lime) or different orthography and phonology (press-list). Using fMRI, we examined effective connectivity among five left hemisphere regions of interest: fusiform gyrus (FG), inferior frontal gyrus (IFG), intraparietal sulcus (IPS), lateral temporal cortex (LTC), and medial frontal gyrus (MeFG). Age-related increases were observed in the influence of the IFG and FG on the LTC, but only in conflicting conditions. These results reflect a developmental increase in the convergence of bottom-up and top-down information on the LTC. In older children, top-down control process may selectively enhance the sensitivity of the LTC to bottom-up information from the FG. This may be evident especially in situations that require selective enhancement of task-relevant versus task-irrelevant information. Altogether these results provide a direct evidence for a developmental increase in top-down control processes in language processing. The developmental increase in bottom-up processing may be secondary to the enhancement of top-down processes.     

Retinotopic effects during spatial audio-visual integration

The successful integration of visual and auditory stimuli requires information about whether visual and auditory signals originate from corresponding places in the external world. Here we report crossmodal effects of spatially congruent and incongruent audio-visual (AV) stimulation. Visual and auditory stimuli were presented from one of four horizontal locations in external space. Seven healthy human subjects had to assess the spatial fit of a visual stimulus (i.e. a gray-scaled picture of a cartoon dog) and a simultaneously presented auditory stimulus (i.e. a barking sound). Functional magnetic resonance imaging (fMRI) revealed two distinct networks of cortical regions that processed preferentially either spatially congruent or spatially incongruent AV stimuli. Whereas earlier visual areas responded preferentially to incongruent AV stimulation, higher visual areas of the temporal and parietal cortex (left inferior temporal gyrus [ITG], right posterior superior temporal gyrus/sulcus [pSTG/STS], left intra-parietal sulcus [IPS]) and frontal regions (left pre-central gyrus [PreCG], left dorsolateral pre-frontal cortex [DLPFC]) responded preferentially to congruent AV stimulation. A position-resolved analysis revealed three robust cortical representations for each of the four visual stimulus locations in retinotopic visual regions corresponding to the representation of the horizontal meridian in area V1 and at the dorsal and ventral borders between areas V2 and V3. While these regions of interest (ROIs) did not show any significant effect of spatial congruency, we found subregions within ROIs in the right hemisphere that showed an incongruency effect (i.e. an increased fMRI signal during spatially incongruent compared to congruent AV stimulation). We interpret this finding as a correlate of spatially distributed recurrent feedback during mismatch processing: whenever a spatial mismatch is detected in multisensory regions (such as the IPS), processing resources are re-directed to low-level visual areas.     

Shape-selective stereo processing in human object-related visual areas

Object related areas in the human ventral stream were previously shown to be activated, in a shape-selective manner, by luminance, motion, and texture cues. We report on the preferential activation of these areas by stereo cues defining shape. To assess the relationship of this activation to object recognition, we employed a perceptual stereo effect, which profoundly affects object recognition. The stimuli consisted of stereo-defined line drawings of objects that either protruded in front of a flat background ("front"), or were sunk into the background ("back"). Despite the similarity in the local feature structure of the two conditions, object recognition was superior in the "front" compared to the "back" configuration. We measured both recognition rates and fMRI signal from the human visual cortex while subjects viewed these stimuli. The results reveal shape selective activation from images of objects defined purely by stereoscopic cues in the human ventral stream. Furthermore, they show a significant correlation between recognition and fMRI signal in the object-related occipito-temporal cortex (lateral occipital complex).