Soft like velvet and shiny like satin: Perceptual material signatures of fabrics depicted in 17th century paintings

Dutch 17^th century painters were masters in depicting materials and their properties in a convincing way. Here, we studied the perception of the material signatures and key image features of different depicted fabrics, like satin and velvet. We also tested whether the perception of fabrics depicted in paintings related to local or global cues, by cropping the stimuli. In Experiment 1, roughness, warmth, softness, heaviness, hairiness, and shininess were rated for the stimuli shown either full figure or cropped. In the full figure, all attributes except shininess were rated higher for velvet, whereas shininess was rated higher for satin. This distinction was less clear in the cropped condition, and some properties were perceived significantly different between the two conditions. In Experiment 2 we tested whether this difference was due to the choice of the cropped area. On the basis of the results of Experiment 1, shininess and softness were rated for multiple crops from each fabric. Most crops from the same fabric differed significantly in shininess, but not in softness perception. Perceived shininess correlated positively with the mean luminance of the crops and the highlights’ coverage. Experiment 1 showed that painted velvet and satin triggered distinct perceptions, indicative of robust material signatures of the two fabrics. The results of Experiment 2 suggest that the presence of local image cues affects the perception of optical properties like shininess, but not mechanical properties such as softness.     

The effect of target salience and size in visual search within naturalistic scenes under degraded vision

We address two questions concerning eye guidance during visual search in naturalistic scenes. First, search has been described as a task in which visual salience is unimportant. Here, we revisit this question by using a letter-in-scene search task that minimizes any confounding effects that may arise from scene guidance. Second, we investigate how important the different regions of the visual field are for different subprocesses of search (target localization, verification). In Experiment 1, we manipulated both the salience (low vs. high) and the size (small vs. large) of the target letter (a “T”), and we implemented a foveal scotoma (radius: 1°) in half of the trials. In Experiment 2, observers searched for high- and low-salience targets either with full vision or with a central or peripheral scotoma (radius: 2.5°). In both experiments, we found main effects of salience with better performance for high-salience targets. In Experiment 1, search was faster for large than for small targets, and high-salience helped more for small targets. When searching with a foveal scotoma, performance was relatively unimpaired regardless of the target''s salience and size. In Experiment 2, both visual-field manipulations led to search time costs, but the peripheral scotoma was much more detrimental than the central scotoma. Peripheral vision proved to be important for target localization, and central vision for target verification. Salience affected eye movement guidance to the target in both central and peripheral vision. Collectively, the results lend support for search models that incorporate salience for predicting eye-movement behavior.     

Surface properties and the perception of color

We examined whether perception of color saturation and lightness depends on the three-dimensional (3D) shape and surface gloss of surfaces rendered to have different hues. In Experiment 1, we parametrically varied specular roughness of predominantly planar surfaces with different mesoscopic relief heights. The orientation of surfaces was varied relative to the light source and observer. Observers matched perceived lightness and chroma (effectively saturation) using spherical objects rendered using CIE LCH color space. We observed strong interactions between perceived saturation and lightness with changes in surface orientation and surface properties (specular roughness and 3D relief height). Declines in saturation and increases in lightness were observed with increasing specular roughness. Changes in relief height had greater effects on perceived saturation and lightness for blue hues compared with reddish and greenish hues. Experiment 2 found inverse correlations between perceived gloss and specular roughness across conditions. Experiment 3 estimated perceived specular coverage and found that a weighted combination of perceived gloss and specular coverage could account for perceived color saturation and lightness, with different coefficients accounting for the perceptual experience for each of the three hue conditions. These findings suggest that perceived color saturation and lightness depend on the separation of specular highlights from diffuse shading informative of chromatic surface reflectance.     

Category systems for real-world scenes

Categorization performance is a popular metric of scene recognition and understanding in behavioral and computational research. However, categorical constructs and their labels can be somewhat arbitrary. Derived from exhaustive vocabularies of place names (e.g., Deng et al., 2009), or the judgements of small groups of researchers (e.g., Fei-Fei, Iyer, Koch, & Perona, 2007), these categories may not correspond with human-preferred taxonomies. Here, we propose clustering by increasing the rand index via coordinate ascent (CIRCA): an unsupervised, data-driven clustering method for deriving ground-truth scene categories. In Experiment 1, human participants organized 80 stereoscopic images of outdoor scenes from the Southampton-York Natural Scenes (SYNS) dataset (Adams et al., 2016) into discrete categories. In separate tasks, images were grouped according to i) semantic content, ii) three-dimensional spatial structure, or iii) two-dimensional image appearance. Participants provided text labels for each group. Using the CIRCA method, we determined the most representative category structure and then derived category labels for each task/dimension. In Experiment 2, we found that these categories generalized well to a larger set of SYNS images, and new observers. In Experiment 3, we tested the relationship between our category systems and the spatial envelope model (Oliva & Torralba, 2001). Finally, in Experiment 4, we validated CIRCA on a larger, independent dataset of same-different category judgements. The derived category systems outperformed the SUN taxonomy (Xiao, Hays, Ehinger, Oliva, & Torralba, 2010) and an alternative clustering method (Greene, 2019). In summary, we believe this novel categorization method can be applied to a wide range of datasets to derive optimal categorical groupings and labels from psychophysical judgements of stimulus similarity.     

Increasing perceptual separateness affects working memory for depth – re-allocation of attention from boundaries to the fixated center

For decades, working memory (WM) has been a heated research topic in the field of cognitive psychology. However, most studies on WM presented visual stimuli on a two-dimensional plane, rarely involving depth perception. Several previous studies have investigated how depth information is stored in WM, and found that WM for depth is even more limited in capacity and the memory performance is poor compared to visual WM. In the present study, we used a change detection task to investigate whether dissociating memory items by different visual features, thereby to increase their perceptual separateness, can improve WM performance for depth. Memory items presented at various depth planes were bound with different colors (Experiments 1 and 3) or sizes (Experiment 2). The memory performance for depth locations of visual stimuli with homogeneous and heterogeneous appearances were tested and compared. The results showed a consistent pattern that although separating items with various feature values did not affect the overall memory performance, the manipulation significantly improved memory performance for the middle depth locations but impaired the performance for the boundary locations when observers fixated at the center of the whole depth volume. The memory benefits of feature separation can be attributed to enhanced individuation of memory items, therefore facilitating a more balanced allocation of attention and memory resources.     

Saccadic adaptation in the presence of artificial central scotomas

Saccadic adaptation can occur over a short period of time through a constant adjustment of the saccade target during the saccade, resulting in saccadic re-referencing, which directs the saccade to a location different from the target that elicited the saccade. Saccade re-referencing could be used to help patients with age-related macular degeneration to optimally use their residual visual function. However, it remains unknown whether saccade adaptation can take place in the presence of central scotomas (i.e., without central vision). We tested participants in two experiments in a conventional double-step paradigm with a central gaze-contingent artificial scotoma. Experiment 1 (N = 12) comprised a backward adaptation paradigm with no scotoma control, visible, and invisible 3° diameter scotoma conditions. Experiment 2 (N = 13) comprised a forward adaptation paradigm with no scotoma control, invisible 2°, and 4° diameter scotoma conditions. In Experiment 1, we observed significant adaptation in both the visible and invisible scotoma conditions comparable to the control condition with no scotoma. This was the case even when the saccade landed such that the target was occluded by the scotoma. We observed that adaptation occurred based on peripheral viewing of the stepped target during the deceleration period. In Experiment 2, we found that both scotoma conditions showed adaptation again comparable to the control condition with no scotoma. We conclude that saccadic adaptation can occur with central scotomas, showing that it does not require central vision and can be driven primarily by peripheral retinal error.     

Gaze dynamics are sensitive to target orienting for working memory encoding in virtual reality

Numerous studies have demonstrated that visuospatial attention is a requirement for successful working memory encoding. It is unknown, however, whether this established relationship manifests in consistent gaze dynamics as people orient their visuospatial attention toward an encoding target when searching for information in naturalistic environments. To test this hypothesis, participants'' eye movements were recorded while they searched for and encoded objects in a virtual apartment (Experiment 1). We decomposed gaze into 61 features that capture gaze dynamics and a trained sliding window logistic regression model that has potential for use in real-time systems to predict when participants found target objects for working memory encoding. A model trained on group data successfully predicted when people oriented to a target for encoding for the trained task (Experiment 1) and for a novel task (Experiment 2), where a new set of participants found objects and encoded an associated nonword in a cluttered virtual kitchen. Six of these features were predictive of target orienting for encoding, even during the novel task, including decreased distances between subsequent fixation/saccade events, increased fixation probabilities, and slower saccade decelerations before encoding. This suggests that as people orient toward a target to encode new information at the end of search, they decrease task-irrelevant, exploratory sampling behaviors. This behavior was common across the two studies. Together, this research demonstrates how gaze dynamics can be used to capture target orienting for working memory encoding and has implications for real-world use in technology and special populations.     

The postdictive effect of choice reflects the modulation of attention on choice

Our conscious perception of the world is not an instantaneous, moment-by-moment construction. Rather, our perception of an event is influenced, over time, by information gained after the event; this is known as a postdictive effect. A recent study reported that this postdictive effect could occur even in choice. The present study sought to test whether the striking postdictive effect of choice reflects the modulation of attention on choice, by directly and systematically manipulating attention in two experiments. Specifically, Experiment 1 revealed that the robust postdictive effect of choice was almost completely eliminated when attentional bias was removed. More important, Experiment 2 demonstrated that the postdictive effect of choice could be modulated by directly manipulating participants’ attention with a spatial cue, in particular, when the cue appeared at short time delays. These results suggest that choice could be considerably postdictively influenced by attention and this effect was most pronounced within a short time window wherein decision making was most likely in progress. The current study not only enables clarification of the mechanism of the newly discovered postdictive effect of choice, but also extends evidence of the modulation of attention on decision making.     

Distinct processes of lighting priors for lightness and 3-D shape perception

The visual system often relies on prior assumptions when interpreting ambiguous visual inputs. A well-known example is the light-from-above prior, which aids the judgment of an object''s three-dimensional (3-D) shape (i.e., convex or concave). Recent studies have revealed that the light-from-above prior also helps solve lightness ambiguity. This study aimed to examine whether 3-D shape perception and lightness perception share the same lighting prior. The study participants performed two tasks: one focusing on lightness perception and another focusing on 3-D shape perception. The dominant directions of the assumed lighting were calculated from participants’ performance in the two tasks. The results showed that the assumed lighting direction for 3-D shape perception were considerably biased toward the left, whereas the one for lightness perception was almost from directly above. The clear difference between these two directions supports the hypothesis that the visual system uses distinct lighting priors for 3-D shape perception and lightness perception. Experiments 1 and 2 involved Japanese speaking participants and European participants, respectively. The Japanese language can be read and written both horizontally (i.e., left to right) and vertically (i.e., up to down) with lines progressing from right to left. Nevertheless, the two experiments still produced the same result, which suggests that the present finding is universal regardless of reading/writing direction.     

The effect of apparent distance on peripheral target detection

Previous research suggests that peripheral target detection is modulated by viewing distance and distance simulated by pictorial cues and optic flow. In the latter case, it is unclear what cues contribute to the effect of distance. The current study evaluated the effect of distance on peripheral detection in a virtual three-dimensional environment. Experiments 1–3 used a continuous, dynamic central task that simulated observers traveling either actively or passively through a virtual environment following a car. Peripheral targets were flashed on checkerboard-covered walls to the left and right of the path of motion, at a near and a far distance from the observer. The retinal characteristics of the targets were identical across distances. Experiment 1 found more accurate and faster detection for near targets compared to far targets, especially for larger eccentricities. Experiment 2 equated the predictability of target onset across distances and found the near advantage for larger eccentricities in accuracy but a much smaller effect in reaction time (RT). Experiment 3 removed the checkerboard background implemented in Experiments 1 and 2, and Experiment 4 manipulated several static, monocular cues. Experiments 3 and 4 found that the variation in the density of the checkerboard backgrounds could explain the main effect of distance on accuracy but could not completely account for the interaction between target distance and eccentricity. These results suggest that attention is modulated by target distance, but the effect is small. Finally, there were consistent divided attention costs in the central car-following task but not the peripheral detection task.     

Post-saccadic changes disrupt attended pre-saccadic object memory

Trans-saccadic memory consists of keeping track of objects’ locations and features across saccades; pre-saccadic information is remembered and compared with post-saccadic information. It has been shown to have limited resources and involve attention with respect to the selection of objects and features. In support, a previous study showed that recognition of distinct post-saccadic objects in the visual scene is impaired when pre-saccadic objects are relevant and thus already encoded in memory (Poth, Herwig, Schneider, 2015). Here, we investigated the inverse (i.e. how the memory of pre-saccadic objects is affected by abrupt but irrelevant changes in the post-saccadic visual scene). We also modulated the amount of attention to the relevant pre-saccadic object by having participants either make a saccade to it or elsewhere and observed that pre-saccadic attentional facilitation affected how much post-saccadic changes disrupted trans-saccadic memory of pre-saccadic objects.Participants identified a flashed symbol (d, b, p, or q, among distracters), at one of six placeholders (figures “8”) arranged in circle around fixation while planning a saccade to one of them. They reported the identity of the symbol after the saccade. We changed the post-saccadic scene in Experiment one by removing the entire scene, only the placeholder where the pre-saccadic symbol was presented, or all other placeholders except this one. We observed reduced identification performance when only the saccade-target placeholder disappeared after the saccade. In Experiment two, we changed one placeholder location (inward/outward shift or rotation re. saccade vector) after the saccade and observed that identification performance decreased with increased shift/rotation of the saccade-target placeholder. We conclude that pre-saccadic memory is disrupted by abrupt attention-capturing post-saccadic changes of visual scene, particularly when these changes involve the object prioritized by being the goal of a saccade. These findings support the notion that limited trans-saccadic memory resources are disrupted when object correspondence at saccadic goal is broken through removal or location change.     

Multidimensional feature interactions in visual crowding: When configural cues eliminate the polarity advantage

Crowding occurs when surrounding objects (flankers) impair target perception. A key property of crowding is the weaker interference when target and flankers strongly differ on a given dimension. For instance, identification of a target letter is usually superior with flankers of opposite versus the same contrast polarity as the target (the “polarity advantage”). High performance when target-flanker similarity is low has been attributed to the ungrouping of target and flankers. Here, we show that configural cues can override the usual advantage of low target-flanker similarity, and strong target-flanker grouping can reduce – instead of exacerbate – crowding. In Experiment 1, observers were presented with line triplets in the periphery and reported the tilt (left or right) of the central line. Target and flankers had the same (uniform condition) or opposite contrast polarity (alternating condition). Flanker configurations were either upright (||), unidirectionally tilted (\\ or //), or bidirectionally tilted (\/ or /\). Upright flankers yielded stronger crowding than unidirectional flankers, and weaker crowding than bidirectional flankers. Importantly, our results revealed a clear interaction between contrast polarity and flanker configuration. Triplets with upright and bidirectional flankers, but not unidirectional flankers, showed the polarity advantage. In Experiments 2 and 3, we showed that emergent features and redundancy masking (i.e. the reduction of the number of perceived items in repeating configurations) made it easier to discriminate between uniform triplets when flanker tilts were unidirectional (but not when bidirectional). We propose that the spatial configurations of uniform triplets with unidirectional flankers provided sufficient task-relevant information to enable a similar performance as with alternating triplets: strong-target flanker grouping alleviated crowding. We suggest that features which modulate crowding strength can interact non-additively, limiting the validity of typical crowding rules to contexts where only single, independent dimensions determine the effects of target-flanker similarity.     

Attentional capture in multiple object tracking

Attentional processes are generally assumed to be involved in multiple object tracking (MOT). The attentional capture paradigm is regularly used to study conditions of attentional control. It has up to now not been used to assess influences of sudden onset distractor stimuli in MOT. We investigated whether attentional capture does occur in MOT: Are onset distractors processed at all in dynamic attentional tasks? We found that sudden onset distractors were effective in lowering probe detection, thus demonstrating attentional capture. Tracking performance as dependent measure was not affected. The attentional capture effect persisted in conditions of higher tracking load (Experiment 2) and was dramatically increased in lower presentation frequency of the onset distractor (Experiment 3). Tracking performance was shown to suffer only when onset distractors were presented serially with very short time gaps in between, thus effectively disturbing re-engaging attention on the tracking set (Experiment 4). We discuss that rapid dis- and re-engagement of the attention process on target objects and an additional more basic process that continuously provides location information allow managing strong disruptions of attention during tracking.     

Subjective control of polystable illusory apparent motion: Is control possible when the stimulus affords countless motion possibilities?

We investigate whether a new polystable illusion, illusory apparent motion (IAM), is susceptible to subjective perceptual control as has been shown in other polystable stimuli (e.g., the Necker cube, apparent motion quartets). Previous research has demonstrated that, although IAM shares some properties in common with other polystable stimuli, it also has some unique ones that make it unclear whether it should have similar susceptibility to subjective control. For example, IAM can be perceived in a countless number of directions and motion patterns (e.g., up–down, left–left, contracting–expanding, shear, diagonal). To explore perceptual control of IAM, in experiment 1 (n = 99) we used a motion persistence paradigm where participants are primed with different motion patterns and are instructed to control (change or hold) the initial motion pattern and indicate when the motion pattern changes. Building on experiment 1, experiment 2 (n = 76) brings the method more in line with previous subjective control research, testing whether participants can control their perception of IAM in a context without priming and while dynamically reporting their percepts throughout the trial. Findings from the two experiments demonstrate that participants were able to control their perception of IAM across paradigms. We explore the implications of these findings, strategies reported, and open questions for future research.     

Perceptual influence of auditory pitch on motion speed

There is a cross-modal mapping between auditory pitch and many visual properties, but the relationship between auditory pitch and motion speed is unexplored. In this article, the ball and baffle are used as the research objects, and an object collision experiment is used to explore the perceptual influence of auditory pitch on motion speed. Since cross-modal mapping can influence perceptual experience, this article also explores the influence of auditory pitch on action measures. In Experiment 1, 12 participants attempted to release a baffle to block a falling ball on the basis of speed judgment, and after each trial, they were asked to rate the speed of the ball. The speed score and baffle release time were recorded and used for analysis of variance. Since making explicit judgments about speed can alter the processing of visual paths, another group of participants in Experiment 2 completed the experiment without making explicit judgments about speed. Our results show that there is a cross-modal mapping between auditory pitch and motion speed, and high or low tones cause perception shift to faster or slower speeds.     

Close - but not distant - conditioned flanker emotion affects crowding

Crowding is affected by conditioned stimulus emotion. This effect is clearly observed for conditioned flankers, but only marginally pronounced for conditioned targets. Studies on the processing of emotional stimuli suggest that the magnitude of the emotional effect depends on the presentation depth in that effects of emotion increase with decreasing distance to the observer in depth. Based on respective findings, we investigate crowding with stimuli of conditioned negative and neutral emotion across real depth; that is, stimuli were either presented closer, at or farther away than the fixation depth. Conditioned emotion of flankers affected crowding when flankers were presented closer than or at fixation depth, which is also the distance the target was presented at. Farther away than the fixation depth, flanker emotion did not alter crowding (Experiment 1a). Conditioned target emotion, however, did only show weak effects on crowding; neither when flankers (Experiment 1b) nor when targets were varied in depth (Experiment 2) there was a clear effect of target emotion, replicating findings in two-dimensional settings. Taken together, the results suggest that flanker''s emotional associations can become important for crowding, although, it depends on the special processing characteristics of stimulus emotion in depth. The conditioned emotion of targets scarcely affected crowding.     

Inhibition continues to guide search under concurrent visual working memory load

It is well known that attention can be automatically attracted to salient items. However, recent studies show that it is possible to avoid distraction by a salient item (with a known feature), leading to facilitated search. This article tests a proposed mechanism for distractor inhibition: that a mental representation of the distractor feature held in visual working memory (VWM) allows attention to be guided away from the distractor. We tested this explanation by examining color-based inhibition in visual search for a shape target with and without VWM load. In Experiment 1 the presence of a distractor facilitated visual search under low and high VWM loads, as reflected in faster response times when the distractor was present (compared to absent), and in fewer eye movements to the salient distractor than the non-target items. However, the eye movement inhibition effect was noticeably weakened in the load conditions. Experiment 2 explored further, to distinguish between inhibition of the distractor color and activation of the (irrelevant) target color. Intermittently presenting single-color search trials that contained only either a target, distractor or a neutral-colored singleton revealed that the distractor color attracted attention less than the neutral color with and without VWM load. The target color, however, only attracted attention more than neutral colors under no load, whereas a VWM load completely eliminated this effect. This suggests that although VWM plays a role in guiding attention to the (irrelevant) target color, distractor-feature inhibition can operate independently.     

Multisensory integration attenuates visually induced oculomotor inhibition of return

Inhibition of return (IOR) is a mechanism of the attention system involving bias toward novel stimuli and delayed generation of responses to targets at previously attended locations. According to the two-component theory, IOR consists of a perceptual component and an oculomotor component (oculomotor IOR [O-IOR]) depending on whether the eye movement system is activated. Previous studies have shown that multisensory integration weakens IOR when paying attention to both visual and auditory modalities. However, it remains unclear whether the O-IOR effect attenuated by multisensory integration also occurs when the oculomotor system is activated. Here, using two eye movement experiments, we investigated the effect of multisensory integration on O-IOR using the exogenous spatial cueing paradigm. In Experiment 1, we found a greater visual O-IOR effect compared with audiovisual and auditory O-IOR in divided modality attention. The relative multisensory response enhancement (rMRE) and violations of Miller''s bound showed a greater magnitude of multisensory integration in the cued location compared with the uncued location. In Experiment 2, the magnitude of the audiovisual O-IOR effect was significantly less than that of the visual O-IOR in single visual modality selective attention. Implications for the effect of multisensory integration on O-IOR were discussed under conditions of oculomotor system activation, shedding new light on the two-component theory of IOR.     

Non-cardinal color mechanism elicitation by stimulus shape: Bringing the S versus L+M color plane to the table

Neurons in the cortex typically respond best to elongated stimuli, or gratings, whereas neurons in the lateral geniculate nucleus (LGN) typically prefer circular stimuli, or spots. Further, neural mechanisms specifically tuned for non-cardinal colors largely do not emerge until the cortex; therefore, the use of gratings should better reveal non-cardinal color mechanisms. This hypothesis has been tested in the isoluminant color plane in macaque monkeys (Stoughton, Lafer-Sousa, Gagin, & Conway, 2012) and in the L–M versus L+M color plane in human subjects (Gegenfurtner & Kiper, 1992). Here, this hypothesis was tested in the third color plane, S versus L+M, in human subjects in two experiments. Experiment 1 tested 10 subjects across four directions in this color plane; Experiment 2 tested three subjects in eight to twelve color directions. Consistent with data from the other two color planes, in both experiments in the S versus L+M color plane, gratings revealed the presence of non-cardinal mechanisms more strongly than did spots.     

Familiarity,orientation, and realism increase face uncanniness by sensitizing to facial distortions

The uncanny valley predicts aversive reactions toward near-humanlike entities. Greater uncanniness is elicited by distortions in realistic than unrealistic faces, possibly due to familiarity. Experiment 1 investigated how familiarity and inversion affect uncanniness of facial distortions and the ability to detect differences between the distorted variants of the same face (distortion sensitivity). Familiar or unfamiliar celebrity faces were incrementally distorted and presented either upright or inverted. Uncanniness ratings increased across the distortion levels, and were stronger for familiar and upright faces. Distortion sensitivity increased with increasing distortion difference levels, again stronger for familiar and upright faces. Experiment 2 investigated how face realism, familiarity, and face orientation interacted for the increase of uncanniness across distortions. Realism increased the increase of uncanniness across the distortion levels, further enhanced by upright orientation and familiarity. The findings show that familiarity, upright orientation, and high face realism increase the sensitivity of uncanniness, likely by increasing distortion sensitivity. Finally, a moderated linear function of face realism and deviation level could explain the uncanniness of stimuli better than a quadratic function. A re-interpretation of the uncanny valley as sensitivity toward deviations from familiarized patterns is discussed.