Cortical area MSTd combines visual cues to represent 3-D self-movement

As arboreal primates move through the jungle, they are immersed in visual motion that they must distinguish from the movement of predators and prey. We recorded dorsal medial superior temporal (MSTd) cortical neuronal responses to visual motion stimuli simulating self-movement and object motion. MSTd neurons encode the heading of simulated self-movement in three-dimensional (3-D) space. 3-D heading responses can be evoked either by the large patterns of visual motion in optic flow or by the visual object motion seen when an observer passes an earth-fixed landmark. Responses to naturalistically combined optic flow and object motion depend on their relative directions: an object moving as part of the optic flow field has little effect on neuronal responses. In contrast, an object moving separately from the optic flow field has large effects, decreasing the amplitude of the population response and shifting the population's heading estimate to match the direction of object motion as the object moves toward central vision. These effects parallel those seen in human heading perception with minimal effects of objects moving with the optic flow and substantial effects of objects violating the optic flow. We conclude that MSTd can contribute to navigation by supporting 3-D heading estimation, potentially switching from optic flow to object cues when a moving object passes in front of the observer.     

A neural model of motion processing and visual navigation by cortical area MST

Cells in the dorsal medial superior temporal cortex (MSTd) process optic flow generated by self-motion during visually guided navigation. A neural model shows how interactions between well-known neural mechanisms (log polar cortical magnification, Gaussian motion-sensitive receptive fields, spatial pooling of motion-sensitive signals and subtractive extraretinal eye movement signals) lead to emergent properties that quantitatively simulate neurophysiological data about MSTd cell properties and psychophysical data about human navigation. Model cells match MSTd neuron responses to optic flow stimuli placed in different parts of the visual field, including position invariance, tuning curves, preferred spiral directions, direction reversals, average response curves and preferred locations for stimulus motion centers. The model shows how the preferred motion direction of the most active MSTd cells can explain human judgments of self-motion direction (heading), without using complex heading templates. The model explains when extraretinal eye movement signals are needed for accurate heading perception, and when retinal input is sufficient, and how heading judgments depend on scene layouts and rotation rates.     

Functional sub-regions for optic flow processing in the posteromedial lateral suprasylvian cortex of the cat.

During locomotion, an observer sees a large and complex pattern of visual motion called optic flow. This phenomenon is characterized by elements in the environment accelerating and expanding as they move peripherally. In cats, previous studies have indicated that the posteromedial part of the lateral suprasylvian (PMLS) cortex may be involved in the processing of optic flow fields. We further addressed this issue by studying the importance of specific parameters of the optic flow patterns and investigating whether cell responses to these stimuli depend on receptive field (RF) location in the visual field. Results can be summarized as follows: approximately two-thirds of PMLS cells responded to optic flow fields and a subset of these (84/153) showed a clear direction selectivity for motion along the frontal axis. Of these units, the majority responded preferentially to expansion rather than contraction of the pattern. Cells' responses depend on RF location in the visual field. For centrally located RFs, tested both when the origin of motion was within the RF or at the area centralis, responses were generally comparable whether or not size or speed gradients were removed from the optic flow pattern. A different tendency was observed for peripherally located RFs. In general, these cells exhibited a preferred direction almost exclusively when the origin of motion was placed at the area centralis, and neuronal discharges and direction selectivity for many of them were reduced when the optic flow cues were removed from the pattern. The results of this study suggest that there may be functional differences in response properties between PMLS cells located in the central and peripheral parts of the visual field that may reflect a specialization of the PMLS cortex in optic flow processing.     

Vestibular inputs to human motion-sensitive visual cortex

Two crucial sources of information available to an organism when moving through an environment are visual and vestibular stimuli. Macaque cortical area MSTd processes visual motion, including cues to self-motion arising from optic flow and also receives information about self-motion from the vestibular system. In humans, whether human MST (hMST) receives vestibular afferents is unknown. We have combined 2 techniques, galvanic vestibular stimulation and functional MRI (fMRI), to show that hMST is strongly activated by vestibular stimulation in darkness, whereas adjacent area MT is unaffected. The activity cannot be explained in terms of somatosensory stimulation at the electrode site. Vestibular input appears to be confined to the anterior portion of hMST, suggesting that hMST as conventionally defined may contain 2 subregions. Vestibular activity was also seen in another area previously implicated in processing visual cues to self-motion, namely the cingulate sulcus visual area (CSv), but not in visual area V6. The results suggest that cross-modal convergence of cues to self-motion occurs in both hMST and CSv.     

Neuronal responses to optic flow in the monkey parietal area PEc

Area PEc, a high order association area, is located in the dorsocaudal portion of the superior parietal cortex. PEc neurons encode visual motion signals, especially the direction of stimulus motion. The present study tested if PEc neurons also process visual correlates of self-motion. The extracellular activity of single neurons in response to optic flow stimuli was recorded in two monkeys (Macaca fascicularis) trained in a fixation task. The stimuli were produced by random dots simulating planar motion, radial expansion and radial contraction. A substantial number of PEc neurons were specifically activated by radial optic flow and were selective for the position of the focus of expansion with respect to the fovea. Eccentric positions of the focus of expansion were preferred. Almost all neurons showed opponent excitatory-inhibitory activity to expanding-contracting visual fields. Planar motion elicited very weak responses. Optic flow responsiveness is not entirely explained by classical bar sensitivity in PEc neurons, suggesting that optic flow and classical bar responses could serve different mechanisms in the integration of visuo-motor signals to prepare body movements.     

Visual mechanisms of spatial disorientation in Alzheimer's disease

Impaired optic flow perception may contribute to the visuospatial disorientation of Alzheimer's disease (AD). We find that 36% of AD patients have elevated perceptual thresholds for left/right outward radial optic flow discrimination. This impairment is related to independent visual motion processing deficits affecting the perception of left/right motion-defined boundaries and in/out radial motion. Elevated optic flow thresholds in AD are correlated with greater difficulty in the Road Map test of visuospatial function (r = -0.5) and in on-the-road driving tests (r = -0.83). When local motion cues are removed from optic flow, subjects must rely on the global pattern of motion. This reveals global pattern perceptual deficits that affect most AD patients (85%) and some normal elderly subjects (21%). This deficit might combine with impaired local motion processing to undermine the alternative perceptual strategies for visuospatial orientation. The greater prevalence of global pattern deficits suggests that it might precede local motion processing impairments, possibly relating to the sequence of early hippocampal and later posterior cortical damage that is typical of AD.     

Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain

Visual changes in feature movies, like in real-live, can be partitioned into global flow due to self/camera motion, local/differential flow due to object motion, and residuals, for example, due to illumination changes. We correlated these measures with brain responses of human volunteers viewing movies in an fMRI scanner. Early visual areas responded only to residual changes, thus lacking responses to equally large motion-induced changes, consistent with predictive coding. Motion activated V5+ (MT+), V3A, medial posterior parietal cortex (mPPC) and, weakly, lateral occipital cortex (LOC). V5+ responded to local/differential motion and depended on visual contrast, whereas mPPC responded to global flow spanning the whole visual field and was contrast independent. mPPC thus codes for flow compatible with unbiased heading estimation in natural scenes and for the comparison of visual flow with nonretinal, multimodal motion cues in it or downstream. mPPC was functionally connected to anterior portions of V5+, whereas laterally neighboring putative homologue of lateral intraparietal area (LIP) connected with frontal eye fields. Our results demonstrate a progression of selectivity from local and contrast-dependent motion processing in V5+ toward global and contrast-independent motion processing in mPPC. The function, connectivity, and anatomical neighborhood of mPPC imply several parallels to monkey ventral intraparietal area (VIP).     

Functional MRI studies of human visual motion perception: texture,luminance, attention and after-effects

Motion of an object is thought to be perceived independently of the object's surface properties. However, theoretical, neuropsychological and psychophysical observations have suggested that motion of textures, called 'second-order motion', may be processed by a separate system from luminance-based, or 'first-order', motion. Functional magnetic resonance imaging (fMRI) responses during passive viewing, attentional modulation and post-adaptation motion after-effects (MAE) of these stimuli were measured in seven retinotopic visual areas (labeled V1, V2, V3, VP, V4v, V3A and LO) and the motion-sensitive area MT/MST (V5). In all visual areas, responses were strikingly similar to motion of first- and second-order stimuli. These results differ from a prior investigation, because here the motion-specific responses were isolated. Directing attention towards and away from the motion elicited equivalent response modulation for the two types. Dramatic post-adaptation (MAE) differences in perception of the two stimuli were observed and fMRI activation mimicked perceptual changes, but did not reveal the processing differences. In fact, no visual area was found to respond selectively to the motion of second-order stimuli, suggesting that motion perception arises from a unified motion detection system.     

Driving strategy alters neuronal responses to self-movement: cortical mechanisms of distracted driving

We presented naturalistic combinations of virtual self-movement stimuli while recording neuronal activity in monkey cerebral cortex. Monkeys used a joystick to drive to a straight ahead heading direction guided by either object motion or optic flow. The selected cue dominates neuronal responses, often mimicking responses evoked when that stimulus is presented alone. In some neurons, driving strategy creates selective response additivities. In others, it creates vulnerabilities to the disruptive effects of independently moving objects. Such cue interactions may be related to the disruptive effects of independently moving objects in Alzheimer's disease patients with navigational deficits.     

Visual evoked potentials in tumors from orbita to occipital lobe in childhood

68 infants and children with proven tumours along the visual pathway visually evoked potentials with pattern reversal and flash were investigated. Subdivided in 5 locational groups (orbital, optic nerve, chiasmatic, retrochiasmatic and occipital lobe) best results were obtained by stimulation with pattern reversal using variable checksizes (91.2%) versus 61.8% by using flash evoked responses. Furthermore, using patterned stimuli not only latency shifts are best detected but also hints for visual function correlating to visual acuity could be given also in nonverbal or disabled children. For long term follow-up studies in known space-occupying lesions along the visual pathway, the use of pattern VEP is extraordinary because of its high sensitivity and complete harmlessness. Pattern VEP are even more sensitive than visual acuity testing in cooperative patients. The close interdisciplinary follow-up controls in these children between pediatric neurophysiologists and neurosurgeons are, therefore, strongly recommended.     

Visual motion responses in the posterior cingulate sulcus: a comparison to V5/MT and MST

Motion processing regions apart from V5+/MT+ are still relatively poorly understood. Here, we used functional magnetic resonance imaging to perform a detailed functional analysis of the recently described cingulate sulcus visual area (CSv) in the dorsal posterior cingulate cortex. We used distinct types of visual motion stimuli to compare CSv with V5/MT and MST, including a visual pursuit paradigm. Both V5/MT and MST preferred 3D flow over 2D planar motion, responded less yet substantially to random motion, had a strong preference for contralateral versus ipsilateral stimulation, and responded nearly equally to contralateral and to full-field stimuli. In contrast, CSv had a pronounced preference to 2D planar motion over 3D flow, did not respond to random motion, had a weak and nonsignificant lateralization that was significantly smaller than that of MST, and strongly preferred full-field over contralateral stimuli. In addition, CSv had a better capability to integrate eye movements with retinal motion compared with V5/MT and MST. CSv thus differs from V5+/MT+ by its unique preference to full-field, coherent, and planar motion cues. These results place CSv in a good position to process visual cues related to self-induced motion, in particular those associated to eye or lateral head movements.     

Modulation of responses to optic flow in area 7a by retinotopic and oculomotor cues in monkey

Perception of two- and three-dimensional optic flow critically depends upon extrastriate cortices that are part of the 'dorsal stream' for visual processing. Neurons in area 7a, a sub-region of the posterior parietal cortex, have a dual sensitivity to visual input and to eye position. The sensitivity and selectivity of area 7a neurons to three sensory cues - optic flow, retinotopic stimulus position and eye position - were studied. The visual response to optic flow was modulated by the retinotopic stimulus position and by the eye position in the orbit. The position dependence of the retinal and eye position modulation (i.e. gain field) were quantified by a quadratic regression model that allowed for linear or peaked receptive fields. A local maximum (or minimum) in both the retinotopic fields and the gain fields was observed, suggesting that these sensory qualities are not necessarily linearly represented in area 7a. Neurons were also found that simply encoded the eye position in the absence of optic flow. The spatial tuning for the eye position signals upon stationary stimuli and optic flow was not the same, suggesting multiple anatomical sources of the signals. These neurons can provide a substrate for spatial representation while primates move in the environment.      

Spatiotemporal effects of microsaccades on population activity in the visual cortex of monkeys during fixation

During visual fixation, the eyes make fast involuntary miniature movements known as microsaccades (MSs). When MSs are executed they displace the visual image over the retina and can generate neural modulation along the visual pathway. However, the effects of MSs on neural activity have substantial variability and are not fully understood. By utilizing voltage-sensitive dye imaging, we imaged the spatiotemporal patterns induced by MSs in V1 and V2 areas of behaving monkeys while they were fixating and presented with visual stimuli. We then investigated the neuronal modulation dynamics, induced by MSs, under different visual stimulation. MSs induced monophasic or biphasic neural responses depending on stimulus size. These neural responses were accompanied by different spatiotemporal patterns of synchronization. Finally, we show that a local patch of population response evoked by a small stimulus was clearly shifted over the V1 retinotopic map after each MS. Our results demonstrate the lack of visual stability in V1 following MSs and help clarify the substantial variability reported for MSs effects on neuronal responses. The observed neural effects suggest that MSs are associated with a continuum of neuronal responses in V1 area reflecting diverse spatiotemporal dynamics.     

Signal-, set- and movement-related activity in the human brain: an event-related fMRI study

Electrophysiological studies on monkeys have been able to distinguish sensory and motor signals close in time by pseudorandomly delaying the cue that instructs the movement from the stimulus that triggers the movement. We have used a similar experimental design in functional magnetic resonance imaging (fMRI), scanning subjects while they performed a visuomotor conditional task with instructed delays. One of four shapes was presented briefly. Two shapes instructed the subjects to flex the index finger; the other two shapes coded the flexion of the middle finger. The subjects were told to perform the movement after a tone. We have exploited a novel use of event-related fMRI. By systematically varying the interval between the visual and acoustic stimuli, it has been possible to estimate the significance of the evoked haemodynamic response (EHR) to each of the stimuli, despite their temporal proximity in relation to the time constant of the EHR. Furthermore, by varying the phase between events and image acquisition, we have been able to achieve high temporal resolution while scanning the whole brain. We dissociated sensory and motor components of the sensorimotor transformations elicited by the task, and assessed sustained activity during the instructed delays. In calcarine and occipitotemporal cortex, the responses were exclusively associated with the visual instruction cues. In temporal auditory cortex and in primary motor cortex, they were exclusively associated with the auditory trigger stimulus. In ventral prefrontal cortex there were movement-related responses preceded by preparatory activity and by signal-related activity. Finally, responses associated with the instruction cue and with sustained activity during the delay period were observed in the dorsal premotor cortex and in the dorsal posterior parietal cortex. Where the association between a visual cue and the appropriate movement is arbitrary, the underlying visuomotor transformations are not achieved exclusively through frontoparietal interactions. Rather, these processes seem to rely on the ventral visual stream, the ventral prefrontal cortex and the anterior part of the dorsal premotor cortex.     

Optic nerve decompression for osteopetrosis in early childhood

Visual failure in osteopetrosis may result from retinal degeneration or compression of the optic nerve in the narrowed optic canals. We report the evaluation and treatment of five children with osteopetrosis whose optic nerve dysfunction seems to have been related to the latter etiology. Evaluation of visual function was carried out by means of behavioral observation and flash visual evoked responses. Of six nerves evaluated both pre- and postoperatively, the visual evoked responses seemed to improve in four. Three nerves were serially evaluated without an operation, and one showed changes consistent with maturation. One nerve was evaluated with serial postoperative evoked potentials and showed no change. We conclude that surgical decompression of the optic nerve in patients with documented optic nerve dysfunction and osteopetrosis allows improvement in visual function and is, therefore, an important consideration in the evaluation and management of patients with this disease.     

An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex.

Studies of patients with cerebral achromatopsia have suggested that ventral occipitotemporal cortex is important for color perception. We created a functional magnetic resonance imaging (fMRI) version of a clinical test commonly used to assess achromatopsia, the Farnsworth-Munsell 100-Hue test. The test required normal subjects to use color information in the visual stimulus to perform a color sequencing task. A modification of the test requiring ordering by luminance was used as a control task. Subjects were also imaged as they passively viewed colored stimuli. A limited number of areas responded more to chromatic than achromatic stimulation, including primary visual cortex. Most color-selective activity was concentrated in ventral occipitotemporal cortex. Several areas in ventral cortex were identified. The most posterior, located in posterior fusiform gyrus, corresponded to the area activated by passive viewing of colored stimuli. More anterior and medial color-selective areas were located in the collateral sulcus and fusiform gyrus. These more anterior areas were not identified in previous imaging studies which used passive viewing of colored stimuli, and were most active in our study when visual color information was behaviorally relevant, suggesting that attention influences activity in color-selective areas. The fMRI version of the Farnsworth-Munsell test may be useful in the study of achromatopsia.     

Effects of familiarity on neural activity in monkey inferior temporal lobe

Long-term familiarity facilitates recognition of visual stimuli. To better understand the neural basis for this effect, we measured the local field potential (LFP) and multiunit spiking activity (MUA) from the inferior temporal (IT) lobe of behaving monkeys in response to novel and familiar images. In general, familiar images evoked larger amplitude LFPs whereas MUA responses were greater for novel images. Familiarity effects were attenuated by image rotations in the picture plane of 45 degrees. Decreasing image contrast led to more pronounced decreases in LFP response magnitude for novel, compared with familiar images, and resulted in more selective MUA response profiles for familiar images. The shape of individual LFP traces could be used for stimulus classification, and classification performance was better for the familiar image category. Recording the visual and auditory evoked LFP at multiple depths showed significant alterations in LFP morphology with distance changes of 2 mm. In summary, IT cortex shows local processing differences for familiar and novel images at a time scale and in a manner consistent with the observed behavioral advantage for classifying familiar images and rapidly detecting novel stimuli.     

Monitoring optic nerve function during craniotomy.

During surgical removal of a pituitary adenoma, conduction in the anterior visual pathways was monitored by continuous recording of visual evoked responses (VER). The method employed a scleral contact lens with an embedded flashing diode for delivery of visual stimuli. Evoked potentials of nearly normal latency, amplitude, and form were recorded from occipital scalp electrodes immediately after the optic nerves were decompressed. Restoration of the VER was correlated with restoration of normal vision.     

Top-down modulation of early sensory cortex

Data from nine previous studies of human visual information processing using positron emission tomography were reanalyzed to contrast blood flow responses during passive viewing and active discriminations of the same stimulus array. The analysis examined whether active visual processing (i) increases blood flow in medial visual regions early in the visual hierarchy and (ii) decreases blood flow in auditory and somatosensory cortex. Significant modulation of medial visual regions was observed in six of nine studies, indicating that top-down processes can affect early visual cortex. Modulations showed several task dependencies, suggesting that in some cases the underlying mechanism was selective (e.g. analysis-or feature-specific) rather than non- selective. Replicable decreases at or near auditory Brodmann area (BA) left 41/42 were observed in two of five studies, but in different locations. Analyses that combined data across studies yielded modest but significant decreases. Replicable decreases were not found in primary somatosensory cortex but were observed in an insular region that may be a somatosensory association area. Decreases were also noted in the parietal operculum (perhaps SII) and BA 40. These results are inconsistent with a model in which the precortical input to task- irrelevant sensory cortical areas is broadly suppressed.      

Clinical aspects of the visually evoked potential.

The visually evoked potential (VEP) was studied in normal and abnormal human subjects, and in Rhesus monkeys. A relatively simple protocol for clinical VEP testing is described. The monkeys showed similar but smaller VEP responses compared to those obtained from human subjects. Central, but not paracentral or peripheral photocoagulation retinal lesions were associated with VEP abnormalities. The second, smaller wave of the response complex to 10 Hz flash stimuli corresponds to the primary evoked response, and is closely related to visual acuity. It was possible to recognize visually this VEP waveform and subjectively interpret the record correctly in 85% of eyes with regard to visual acuity. Therefore, the clinician can "read" the VEP record in response to non-patterned flash stimuli. This test was further validated in a series of patients with opacities of the ocular media. VEP promises to become a procedure of diagnostic and prognostic value in ophthalmology.