Eye-hand coordination during reaching. II. An analysis of the relationships between visuomanual signals in parietal cortex and parieto-frontal association projections

The relationships between the distribution of visuomanual signals in parietal cortex and that of parieto-frontal projections are the subject of the present study. Single cell recording was performed in areas PEc and V6A, where different anatomical tracers were also injected. The monkeys performed a variety of behavioral tasks, aimed at studying the visual and motor properties of parietal cells, as well as the potential combination of retinal-, eye- and hand-related signals on cell activity. The activity of most cells was related to the direction of movement and the active position of the hand. Many of these reach-related cells were influenced by eye position information. Fewer cells displayed relationships to saccadic eye movements. The activity of most neurons related to a combination of both hand and eye signals. Many cells were also modulated during preparation for hand movement. Light-dark differences of activity were common and interpreted as related to the sight and monitoring of hand motion and/or position in the visual field. Most cells studied were very sensitive to moving visual stimuli and also responded to optic flow stimulation. Visual receptive fields were generally large and extended to the periphery of the visual field. For most neurons, the orientation of the preferred directions computed across different epochs and tasks conditions clustered within a limited sector of space, the field of global tuning. This can be regarded as an ideal frame to combine spatially congruent eye- and hand-related information for different forms of visuomanual behavior. All these properties were common to both PEc and V6A. Retinal, eye- and hand-related activity types, as well as parieto-frontal association cells, were distributed in a periodic fashion across the tangential domain of areas PEc and V6A. These functional and anatomical distributions were characterized and compared through a spectral and coherency analysis, which revealed the existence of a selective 'match' between activity types and parieto-frontal connections. This match depended on where each individual efferent projection was addressed. The results of the present and of the companion study can be relevant for a re-interpretation of optic ataxia as the consequence of the breakdown of the combination of retinal-, eye- and hand-related directional signals within the global tuning fields of parietal neurons.     

Cortical neuronal responses to optic flow are shaped by visual strategies for steering

We hypothesized that neuronal responses to virtual self-movement would be enhanced during steering tasks. We recorded the activity of medial superior temporal (MSTd) neurons in monkeys trained to steer a straight-ahead course, using optic flow. We found smaller optic flow responses during active steering than during the passive viewing of the same stimuli. Behavioral analysis showed that the monkeys had learned to steer using local motion cues. Retraining the monkeys to use the global pattern of optic flow reversed the effects of the active-steering task: active steering then evoked larger responses than passive viewing. We then compared the responses of neurons during active steering by local motion and by global patterns: Local motion trials promoted the use of local dot movement near the center of the stimulus by occluding the peripheral visual field midway through the trial. Global pattern trials promoted the use of radial pattern movement by occluding the central visual field midway through the trial. In this study, identical full-field optic-flow stimuli evoked larger responses in global-pattern trials than in local motion trials. We conclude that the selection of specific visual cues reflects strategies for active steering and alters MSTd neuronal responses to optic flow.     

Cortical area MSTd combines visual cues to represent 3-D self-movement

As arboreal primates move through the jungle, they are immersed in visual motion that they must distinguish from the movement of predators and prey. We recorded dorsal medial superior temporal (MSTd) cortical neuronal responses to visual motion stimuli simulating self-movement and object motion. MSTd neurons encode the heading of simulated self-movement in three-dimensional (3-D) space. 3-D heading responses can be evoked either by the large patterns of visual motion in optic flow or by the visual object motion seen when an observer passes an earth-fixed landmark. Responses to naturalistically combined optic flow and object motion depend on their relative directions: an object moving as part of the optic flow field has little effect on neuronal responses. In contrast, an object moving separately from the optic flow field has large effects, decreasing the amplitude of the population response and shifting the population's heading estimate to match the direction of object motion as the object moves toward central vision. These effects parallel those seen in human heading perception with minimal effects of objects moving with the optic flow and substantial effects of objects violating the optic flow. We conclude that MSTd can contribute to navigation by supporting 3-D heading estimation, potentially switching from optic flow to object cues when a moving object passes in front of the observer.     

Functional sub-regions for optic flow processing in the posteromedial lateral suprasylvian cortex of the cat.

During locomotion, an observer sees a large and complex pattern of visual motion called optic flow. This phenomenon is characterized by elements in the environment accelerating and expanding as they move peripherally. In cats, previous studies have indicated that the posteromedial part of the lateral suprasylvian (PMLS) cortex may be involved in the processing of optic flow fields. We further addressed this issue by studying the importance of specific parameters of the optic flow patterns and investigating whether cell responses to these stimuli depend on receptive field (RF) location in the visual field. Results can be summarized as follows: approximately two-thirds of PMLS cells responded to optic flow fields and a subset of these (84/153) showed a clear direction selectivity for motion along the frontal axis. Of these units, the majority responded preferentially to expansion rather than contraction of the pattern. Cells' responses depend on RF location in the visual field. For centrally located RFs, tested both when the origin of motion was within the RF or at the area centralis, responses were generally comparable whether or not size or speed gradients were removed from the optic flow pattern. A different tendency was observed for peripherally located RFs. In general, these cells exhibited a preferred direction almost exclusively when the origin of motion was placed at the area centralis, and neuronal discharges and direction selectivity for many of them were reduced when the optic flow cues were removed from the pattern. The results of this study suggest that there may be functional differences in response properties between PMLS cells located in the central and peripheral parts of the visual field that may reflect a specialization of the PMLS cortex in optic flow processing.     

Modulation of responses to optic flow in area 7a by retinotopic and oculomotor cues in monkey

Perception of two- and three-dimensional optic flow critically depends upon extrastriate cortices that are part of the 'dorsal stream' for visual processing. Neurons in area 7a, a sub-region of the posterior parietal cortex, have a dual sensitivity to visual input and to eye position. The sensitivity and selectivity of area 7a neurons to three sensory cues - optic flow, retinotopic stimulus position and eye position - were studied. The visual response to optic flow was modulated by the retinotopic stimulus position and by the eye position in the orbit. The position dependence of the retinal and eye position modulation (i.e. gain field) were quantified by a quadratic regression model that allowed for linear or peaked receptive fields. A local maximum (or minimum) in both the retinotopic fields and the gain fields was observed, suggesting that these sensory qualities are not necessarily linearly represented in area 7a. Neurons were also found that simply encoded the eye position in the absence of optic flow. The spatial tuning for the eye position signals upon stationary stimuli and optic flow was not the same, suggesting multiple anatomical sources of the signals. These neurons can provide a substrate for spatial representation while primates move in the environment.      

Visual, somatosensory, and bimodal activities in the macaque parietal area PEc

Caudal area PE (PEc) of the macaque posterior parietal cortex has been shown to be a crucial node in visuomotor coordination during reaching. The present study was aimed at studying visual and somatosensory organization of this cortical area. Visual stimulations activated 53% of PEc neurons. The overwhelming majority (89%) of these visual cells were best activated by a dark stimulus on a lighter background. Somatosensory stimulations activated 56% of PEc neurons: most were joint neurons (73%); a minority (24%) showed tactile receptive fields, most of them located on the arms. Area PEc has not a clear retinotopy or somatotopy. Among the cells tested for both somatosensory and visual sensitivity, 22% were bimodal, 25% unimodal somatosensory, 34% unimodal visual, and 19% were insensitive to either stimulation. No clear clustering of the different classes of sensory neurons was observed. Visual and somatosensory receptive fields of bimodal cells were not in register. The damage in the human brain of the likely homologous of macaque PEc produces deficits in locomotion and in whole-body interaction with the visual environment. Present data show that macaque PEc has sensory properties and a functional organization in line with the view of an involvement of this area in those processes.     

A neural model of motion processing and visual navigation by cortical area MST

Cells in the dorsal medial superior temporal cortex (MSTd) process optic flow generated by self-motion during visually guided navigation. A neural model shows how interactions between well-known neural mechanisms (log polar cortical magnification, Gaussian motion-sensitive receptive fields, spatial pooling of motion-sensitive signals and subtractive extraretinal eye movement signals) lead to emergent properties that quantitatively simulate neurophysiological data about MSTd cell properties and psychophysical data about human navigation. Model cells match MSTd neuron responses to optic flow stimuli placed in different parts of the visual field, including position invariance, tuning curves, preferred spiral directions, direction reversals, average response curves and preferred locations for stimulus motion centers. The model shows how the preferred motion direction of the most active MSTd cells can explain human judgments of self-motion direction (heading), without using complex heading templates. The model explains when extraretinal eye movement signals are needed for accurate heading perception, and when retinal input is sufficient, and how heading judgments depend on scene layouts and rotation rates.     

Driving strategy alters neuronal responses to self-movement: cortical mechanisms of distracted driving

We presented naturalistic combinations of virtual self-movement stimuli while recording neuronal activity in monkey cerebral cortex. Monkeys used a joystick to drive to a straight ahead heading direction guided by either object motion or optic flow. The selected cue dominates neuronal responses, often mimicking responses evoked when that stimulus is presented alone. In some neurons, driving strategy creates selective response additivities. In others, it creates vulnerabilities to the disruptive effects of independently moving objects. Such cue interactions may be related to the disruptive effects of independently moving objects in Alzheimer's disease patients with navigational deficits.     

Stimulus-dependent modulations of correlated high-frequency oscillations in cat visual cortex

The hypothesis that correlated neural activity is involved in the cortical representation of visual stimuli was examined by recording multi-unit activity and local field potentials from neurons with non- overlapping receptive fields in areas 17 and 18. Using coherence functions, correlations of oscillatory patterns (35-100 Hz) of neural signals were investigated under three stimulus conditions: (i) a whole field grating or a long bar moving across both receptive fields; (ii) masking the region between both receptive fields while stimulating the remaining visual field; and (iii) two separate stimuli simultaneously moving in opposite directions. Coherences of oscillations were found to be significantly higher in the first stimulus condition than in the other two conditions. Since different visual stimuli were reflected in the coherence of neural activity, we concluded that correlated neural activity is a potential candidate for coding of sensory information.      

Physiological responses of New World monkey V1 neurons to stimuli defined by coherent motion

We studied the responses of neurons in area V1 of marmosets to visual stimuli that moved against dynamic textured backgrounds. The stimuli were defined either by a first-order cue ('solid' bars, which were either darker or lighter than the background) or by a second-order cue ('camouflaged' bars, defined only by coherent motion). Forty-two per cent of the neurons demonstrated a similar selectivity for the direction of motion of the solid and camouflaged bars, thereby characterizing a population of cue-invariant (CI) cells. The other cells either showed different selectivity to the movement of solid and camouflaged bars (non-cue-invariant, or NCI cells), or responded equally well to movement in all directions. CI neurons, which were rare in layer 4, tended to have larger receptive fields and to be more strongly direction selective than NCI cells. Although V1 neurons tended to show maximal responses to camouflaged bars that were longer than the 'optimal' solid bars, many CI neurons preferred first- and second-order stimuli of similar lengths. Finally, the activity evoked by the camouflaged bars was delayed in relation to that evoked by solid bars. These results demonstrate that motion CI responses are relatively common in primate V1, especially among a population of strongly direction-selective neurons. They also indicate that this response property may depend on feedback from extrastriate areas, or on complex intrinsic interactions within V1.     

Modulation of visual responses in macaque frontal eye field during covert tracking of invisible targets

The purpose of this study was to investigate the interaction between internal representations of invisible moving targets and visual responses of neurons in frontal eye fields (FEFs). Monkeys were trained to make saccades to the extrapolated position of a target that was temporarily rendered invisible for variable durations as if it had passed behind an occluder. Flashed, task-irrelevant visual probe stimuli were used to study the visual responsiveness of FEF neurons during this task. Probes were flashed at various times and locations during the occlusion interval. Net changes in neuronal activity were obtained by comparing the activity on trials with probes with randomly interleaved trials without any probe. Most neurons showed an increase in firing rate in response to the probe, but some showed a decrease. Both types of responses were enhanced when the invisible target moved toward the receptive field (RF) as compared with trials on which the target moved away from the RF. Some neurons showed a spatial shift in the visual response during the occlusion interval. For cells that were excited by the probe, the shift tended to be correlated with the direction of motion of the target, whereas for cells that were inhibited the shift tended to be in the opposite direction. These results suggest that the role of FEF in predicting invisible target motion includes a sensory/perceptual component.     

Visual mechanisms of spatial disorientation in Alzheimer's disease

Impaired optic flow perception may contribute to the visuospatial disorientation of Alzheimer's disease (AD). We find that 36% of AD patients have elevated perceptual thresholds for left/right outward radial optic flow discrimination. This impairment is related to independent visual motion processing deficits affecting the perception of left/right motion-defined boundaries and in/out radial motion. Elevated optic flow thresholds in AD are correlated with greater difficulty in the Road Map test of visuospatial function (r = -0.5) and in on-the-road driving tests (r = -0.83). When local motion cues are removed from optic flow, subjects must rely on the global pattern of motion. This reveals global pattern perceptual deficits that affect most AD patients (85%) and some normal elderly subjects (21%). This deficit might combine with impaired local motion processing to undermine the alternative perceptual strategies for visuospatial orientation. The greater prevalence of global pattern deficits suggests that it might precede local motion processing impairments, possibly relating to the sequence of early hippocampal and later posterior cortical damage that is typical of AD.     

Maps of complex motion selectivity in the superior temporal cortex of the alert macaque monkey: a double-label 2-deoxyglucose study

The superior temporal sulcus (STS) of the macaque monkey contains multiple visual areas. Many neurons within these regions respond selectively to motion direction and to more complex motion patterns, such as expansion, contraction and rotation. Single-unit recording and optical recording studies in MT/MST suggest that cells with similar tuning properties are clustered into columns extending through multiple cortical layers. In this study, we used a double-label 2-deoxyglucose technique in awake, behaving macaque monkeys to clarify this functional organization. This technique allowed us to label, in a single animal, two populations of neurons responding to two different visual stimuli. In one monkey we compared expansion with contraction; in a second monkey we compared expansion with clockwise rotation. Within the STS we found a patchy arrangement of cortical columns with alternating stimulus selectivity: columns of neurons preferring expansion versus contraction were more widely separated than those selective for expansion versus rotation. This mosaic of interdigitating columns on the floor and posterior bank of the STS included area MT and some neighboring regions of cortex, perhaps including area MST.      

Retinotopy and attention in human occipital, temporal, parietal, and frontal cortex

Novel mapping stimuli composed of biological motion figures were used to study the extent and layout of multiple retinotopic regions in the entire human brain and to examine the independent manipulation of retinotopic responses by visual stimuli and by attention. A number of areas exhibited retinotopic activations, including full or partial visual field representations in occipital cortex, the precuneus, motion-sensitive temporal cortex (extending into the superior temporal sulcus), the intraparietal sulcus, and the vicinity of the frontal eye fields in frontal cortex. Early visual areas showed mainly stimulus-driven retinotopy; parietal and frontal areas were driven primarily by attention; and lateral temporal regions could be driven by both. We found clear spatial specificity of attentional modulation not just in early visual areas but also in classical attentional control areas in parietal and frontal cortex. Indeed, strong spatiotopic activity in these areas could be evoked by directed attention alone. Conversely, motion-sensitive temporal regions, while exhibiting attentional modulation, also responded significantly when attention was directed away from the retinotopic stimuli.     

Posterior cingulate cortex: sensory and oculomotor properties of single neurons in behaving cat.

The posterior cingulate cortex of the cat is strongly linked to cortical areas with sensory and oculomotor functions. We have now recorded from feline posterior cingulate neurons in order to determine whether they are active in conjunction with sensory events and eye movements. The results described here are based on monitoring the electrical activity of 195 single neurons in the posterior cingulate cortex of three cats equipped with surgically implanted scleral search coils and trained to fixate visual targets. Posterior cingulate neurons carry tonic orbital position signals and are phasically active in conjunction with saccadic eye movements. Activity related to eye movements and gaze is attenuated but not abolished by the elimination of visual feedback. Posterior cingulate neurons also are responsive to visual, auditory, and somatosensory stimulation. Systematic testing with visual stimuli revealed that responses are sharply reduced due to refractoriness at rates of stimulation greater than a few per second. These results conform to the theory that posterior cingulate cortex is involved in processes underlying visuospatial cognition.     

Cortical dynamics subserving visual apparent motion

Motion can be perceived when static images are successively presented with a spatial shift. This type of motion is an illusion and is termed apparent motion (AM). Here we show, with a voltage sensitive dye applied to the visual cortex of the ferret, that presentation of a sequence of stationary, short duration, stimuli which are perceived to produce AM are, initially, mapped in areas 17 and 18 as separate stationary representations. But time locked to the offset of the 1st stimulus, a sequence of signals are elicited. First, an activation traverses cortical areas 19 and 21 in the direction of AM. Simultaneously, a motion dependent feedback signal from these areas activates neurons between areas 19/21 and areas 17/18. Finally, an activation is recorded, traveling always from the representation of the 1st to the representation of the next or succeeding stimuli. This activation elicits spikes from neurons situated between these stimulus representations in areas 17/18. This sequence forms a physiological mechanism of motion computation which could bind populations of neurons in the visual areas to interpret motion out of stationary stimuli.     

Neuronal activity in the caudal frontal eye fields of monkeys during memory-based smooth pursuit eye movements: comparison with the supplementary eye fields

Recently, we examined the neuronal substrate of predictive pursuit during memory-based smooth pursuit and found that supplementary eye fields (SEFs) contain signals coding assessment and memory of visual motion direction, decision not-to-pursue ("no-go"), and preparation for pursuit. To determine whether these signals were unique to the SEF, we examined the discharge of 185 task-related neurons in the caudal frontal eye fields (FEFs) in 2 macaques. Visual motion memory and no-go signals were also present in the caudal FEF but compared with those in the SEF, the percentage of neurons coding these signals was significantly lower. In particular, unlike SEF neurons, directional visual motion responses of caudal FEF neurons decayed exponentially. In contrast, the percentage of neurons coding directional pursuit eye movements was significantly higher in the caudal FEF than in the SEF. Unlike SEF inactivation, muscimol injection into the caudal FEF did not induce direction errors or no-go errors but decreased eye velocity during pursuit causing an inability to compensate for the response delays during sinusoidal pursuit. These results indicate significant differences between the 2 regions in the signals represented and in the effects of chemical inactivation suggesting that the caudal FEF is primarily involved in generating motor commands for smooth-pursuit eye movements.     

A pure salience response in posterior parietal cortex

When exploring a visual scene, some objects perceptually popout because of a difference of color, shape, or size. This bottom-up information is an important part of many models describing the allocation of visual attention. It has been hypothesized that the lateral intraparietal area (LIP) acts as a "priority map," integrating bottom-up and top-down information to guide the allocation of attention. Despite a large literature describing top-down influences in LIP, the presence of a pure salience response to a salient stimulus defined by its static features alone has not been reported. We compared LIP responses with colored salient stimuli and distractors in a passive fixation task. Many LIP neurons responded preferentially to 1 of the 2 colored stimuli, yet the mean responses to the salient stimuli were significantly higher than to distractors, independent of the features of the stimuli. These enhanced responses were significant within 75 ms, and the mean responses to salient and distractor stimuli were tightly correlated, suggesting a simple gain control. We propose that a pure salience signal rapidly appears in LIP by collating salience signals from earlier visual areas. This contributes to the creation of a priority map, which is used to guide attention and saccades.     

Selective attention increases the dependency of cortical responses on visual motion coherence in man

Attention improves visual discrimination and consequently allows to discern stimuli with low signal-to-noise ratios that otherwise would remain undetected. We used magnetoencephalography (MEG) to test whether neuromagnetic responses recorded from occipito-temporal cortex, reflecting the size of visual motion signals embedded in noise (motion coherence), would mirror the perceptual changes induced by attention. Attention directed to a given hemifield increased and decreased the coherence modulation of the MEG response over contralateral and ipsilateral visual cortex, respectively, indicating a change in the neuronal signal-to-noise ratio at the population level.     

Speed selectivity for optic flow in area 7a of the behaving macaque

Area 7a, in the inferior parietal lobe, has been implicated in optic flow processing to obtain spatial information about the environment. Optic flow, angle-of-gaze and center-of-motion dependencies are already documented, but the selectivity of area 7a to speed is unknown. Such information is crucial as area 7a provides the final step in visual motion analysis that begins at the lateral geniculate nucleus and passes through MT, MST and LIP/VIP. Macaque area 7a neurons were tested with optic flows with speeds of 0.5-128 degrees /s. Of 161 neurons tested in four hemispheres of two adult male macaques, 53% (86/161) were speed selective at either the time of stimulus onset, at the end of the trial, or at both times. Speed selec- tivities resembling the basic filter types (band-pass, band-reject, high-pass, low-pass, broadband) were found. Area 7a neurons exhibited two novel properties not previously reported elsewhere. Speed selectivity was found to be dynamic in that many cells gained, lost or changed speed tuning over the course of a trial. In addition, speed dependence and optic flow selectivity interacted. For example, a cell could preferentially respond to one type of naviga- tional optic flow at a slow speed and a different navigational optic flow at a fast speed. The presence of speed selectivity combined with other properties of area 7a neurons indicates that these neurons may have a role in the concurrent representation of heading as well as multiple object speeds and directions.