Unfamiliar face processing (face cognition) ability varies considerably in the general population. However, the means of its assessment are not standardised, and selected laboratory tests vary between studies. It is also unclear whether 1) the most commonly employed tests are reliable, 2) participants show a degree of consistency in their performance, 3) and the face cognition tests broadly measure one underlying ability, akin to general intelligence.  In this study, we asked participants to perform eight tests frequently employed in the individual differences literature. We examined the reliability of these tests, relationships between them, consistency in participants’ performance, and used data driven approaches to determine factors underpinning performance.  Overall, our findings suggest that the reliability of these tests is poor to moderate, the correlations between them are weak, the consistency in participant performance across tasks is low and that performance can be broadly split into two factors: telling faces together, and telling faces apart. We recommend that future studies adjust analyses to account for stimuli (face images) and participants as random factors, routinely assess reliability, and that newly developed tests of face cognition are examined in the context of convergent validity with other commonly used measures of face cognition ability.

Commonly used face cognition tests yield low reliability and inconsistent performance: Implications for test design, analysis, and interpretation of individual differences data

Previous work looking at individual differences in face identity processing (FIP) has found that most commonly used lab-based performance assessments are unfortunately not sufficiently sensitive on their own for measuring performance in both the upper and lower tails of the general population simultaneously. So more recently, researchers have begun incorporating multiple testing procedures into their assessments. Still, though, the growing consensus seems to be that at the individual level, there is quite a bit of variability between test scores. The overall consequence of this is that extreme scores will still occur simply by chance in large enough samples. To mitigate this issue, our recent work has developed measures of intra-individual FIP consistency to refine selection of those with superior abilities (i.e. from the upper tail). For starters, we assessed consistency of face matching and recognition in neurotypical controls, and compared them to a sample of SRs. In terms of face matching, we demonstrated psychophysically that SRs show significantly greater consistency than controls in exploiting spatial frequency information than controls. Meanwhile, we showed that SRs’ recognition of faces is highly related to memorability for identities, yet effectively unrelated among controls. So overall, at the high end of the FIP spectrum, consistency can be a useful tool for revealing both qualitative and quantitative individual differences. Finally, in conjunction with collaborators from the Rheinland-Pfalz Police, we developed a pair of bespoke work samples to get bias-free measures of intraindividual consistency in current law enforcement personnel. Officers with higher composite scores on a set of 3 challenging FIP tests tended to show higher consistency, and vice versa. Overall, this suggests that not only is consistency a reasonably good marker of superior FIP abilities, but could present important practical benefits for personnel selection in many other domains of expertise.

Consistency of Face Identity Processing: Basic & Translational Research

Many models of attention assume that attentional selection takes place at a specific moment in time which demarcates the critical transition from pre-attentive to attentive processing of sensory input. We argue that this intuitively appealing account is not only inaccurate, but has led to substantial conceptual confusion (to the point where some attention researchers offer to abandon the term ‘attention’ altogether). As an alternative, we offer a “diachronic” framework that describes attentional selectivity as a process that unfolds over time. Key to this view is the concept of attentional episodes, brief periods of intense attentional amplification of sensory representations that regulate access to working memory and response-related processes. We describe how attentional episodes are linked to earlier attentional mechanisms and to recurrent processing at the neural level. We present data showing that multiple sequential events can be involuntarily encoded in working memory when they appear during the same attentional episode, whether they are relevant or not. We also discuss the costs associated with processing multiple events within a single episode. Finally, we argue that breaking down the dichotomy between pre-attentive and attentive (as well as early vs. late selection) offers new solutions to old problems in attention research that have never been resolved. It can provide a unified and conceptually coherent account of the network of cognitive and neural processes that produce the goal-directed selectivity in perceptual processing that is commonly referred to as “attention”.

The diachronic account of attentional selectivity

Episodic memory performance decreases with advancing age. According to theoretical models, such memory decline might be a consequence of age-related reductions in the ability to form distinct neural representations of our past. In this talk, I want to present our new age-comparative fMRI study investigating age-related neural dedifferentiation across different representational levels. By combining univariate analyses and searchlight pattern similarity analyses, we found that older adults show reduced category selective processing in higher visual areas, less specific item representations in occipital regions and less stable item representations. Dedifferentiation on all these representational levels was related to memory performance, with item specificity being the strongest contributor. Overall, our results emphasize that age-related dedifferentiation can be observed across the entire cortical hierarchy which may selectively impair memory performance depending on the memory task.

Age-related dedifferentiation across representational levels and their relation to memory performance

The literature suggests that ensemble coding, the ability to represent the gist of sets, may be an underlying mechanism for becoming familiar with newly encountered faces. This phenomenon was investigated by introducing a new training paradigm that involves incidental learning of target identities interspersed among distractors. The effectiveness of this training paradigm was explored in Study 1, which revealed that unfamiliar observers who learned the faces incidentally performed just as well as the observers who were instructed to learn the faces, and the intervening distractors did not disrupt familiarization. Using the same training paradigm, ensemble coding was investigated as an underlying mechanism for face familiarization in Study 2 by measuring familiarity with the targets at different time points using average images created either by seen or unseen encounters of the target. The results revealed that observers whose familiarity was tested using seen averages outperformed the observers who were tested using unseen averages, however, this discrepancy diminished over time. In other words, successful recognition of the target faces became less reliant on the previously encountered exemplars over time, suggesting an exemplar-independent representation that is likely achieved through ensemble coding. Taken together, the results from the current experiment provide direct evidence for ensemble coding as a viable underlying mechanism for face familiarization, that faces that are interspersed among distractors can be learned incidentally.

Statistical Summary Representations in Identity Learning: Exemplar-Independent Incidental Recognition

In this talk, Dr. Quandt will share results from behavioral and cognitive neuroscience studies from the past few years of her work in the Action & Brain Lab, an EEG lab at Gallaudet University, the world's premiere university for deaf and hard-of-hearing students. These results will center upon the question of how extensive knowledge of signed language changes, and in some cases enhances, people's perception and cognition. Evidence for this effect comes from studies of human biological motion using point light displays, self-report, and studies of action perception. Dr. Quandt will also discuss some of the lab's efforts in designing and testing a virtual reality environment in which users can learn American Sign Language from signing avatars (virtual humans).

Enhanced perception and cognition in deaf sign language users: EEG and behavioral evidence

One challenge in exploring the internal representation of faces is the lack of controlled stimuli transformations. Researchers are often limited to verbalizable transformations in the creation of a dataset. An alternative approach to verbalization for interpretability is finding image-based measures that allow us to quantify image transformations. In this study, we explore whether PCA could be used to create controlled transformations to a face by testing the effect of these transformations on human perceptual similarity and on computational differences in Gabor, Pixel and DNN spaces. We found that perceptual similarity and the three image-based spaces are linearly related, almost perfectly in the case of the DNN, with a correlation of 0.94. This provides a controlled way to alter the appearance of a face. In experiment 2, the effect of familiarity on the perception of multidimensional transformations was explored. Our findings show that there is a positive relationship between the number of components transformed and both the perceptual similarity and the same three image-based spaces used in experiment 1. Furthermore, we found that familiar faces are rated more similar overall than unfamiliar faces. That is, a change to a familiar face is perceived as making less difference than the exact same change to an unfamiliar face. The ability to quantify, and thus control, these transformations is a powerful tool in exploring the factors that mediate a change in perceived identity.

Link to the pre-print: https://psyarxiv.com/reh2k/

Exploring perceptual similarity and its relation to image-based spaces: an effect of familiarity

Not all individuals are equally competent at recognizing the faces they interact with. Revealing how the brains of different individuals support variations in this ability is a crucial step to develop an understanding of real-world human visual behaviour. In this talk, I will present findings from a large high-density EEG dataset (>100k trials of participants processing various stimulus categories) and computational approaches which aimed to characterise the brain representations behind real-world proficiency of “super-recognizers”—individuals at the top of face recognition ability spectrum. Using decoding analysis of time-resolved EEG patterns, we predicted with high precision the trial-by-trial activity of super-recognizers participants, and showed that evidence for face recognition ability variations is disseminated along early, intermediate and late brain processing steps. Computational modeling of the underlying brain activity uncovered two representational signatures supporting higher face recognition ability—i) mid-level visual & ii) semantic computations. Both components were dissociable in brain processing-time (the first around the N170, the last around the P600) and levels of computations (the first emerging from mid-level layers of visual Convolutional Neural Networks, the last from a semantic model characterising sentence descriptions of images). I will conclude by presenting ongoing analyses from a well-known case of acquired prosopagnosia (PS) using similar computational modeling of high-density EEG activity.

Characterising the brain representations behind variations in real-world visual  behaviour

While time-averaged dynamics of brain functional connectivity are known to reflect the underlying structural connections, the exact relationship between large-scale function and structure remains an unsolved issue in network neuroscience. Large-scale networks are traditionally observed by correlation of fMRI timecourses, and connectivity of source-reconstructed electrophysiological measures are less prominent. Accessing the brain by using multimodal recordings combining EEG, fMRI and diffusion MRI (dMRI) can help to refine the understanding of the spatio-temporal organization of both static and dynamic brain connectivity. 

In this talk I will discuss our prior findings that whole-brain connectivity derived from source-reconstructed resting-state (rs) EEG is both linked to the rs-fMRI and dMRI connectome. The EEG connectome provides complimentary information to link function to structure as compared to an fMRI-only perspective. I will present an approach extending the multimodal data integration of concurrent rs-EEG-fMRI to the temporal domain by combining dynamic functional connectivity of both modalities to better understand the neural basis of functional connectivity dynamics. The close relationship between time-varying changes in EEG and fMRI whole-brain connectivity patterns provide evidence for spontaneous reconfigurations of the brain’s functional processing architecture. Finally, I will talk about data quality of connectivity derived from concurrent EEG-fMRI recordings and how the presented multimodal framework could be applied to better understand focal epilepsy. 

In summary this talk will give an overview of how to integrate large-scale EEG networks with MRI-derived brain structure and function. In conclusion EEG-based connectivity measures not only are closely linked to MRI-based measures of brain structure and function over different time-scales, but also provides complimentary information on the function of underlying brain organization. 

Spatio-temporal large-scale organization of the trimodal connectome derived from concurrent EEG-fMRI and diffusion MRI 

COVID-19 non-pharmaceutical intervention (NPI) policies have been one of the most important and contentious decisions of our time. Beyond even the "normal" inherent difficulties in impact evaluation with observational data, COVID-19 NPI policy evaluation is complicated by additional challenges related to infectious disease dynamics and lags, lack of direct observation of key outcomes, and a multiplicity of interventions occurring on an accelerated time scale. Randomized controlled trials also suffer from what is feasible and ethical to randomize as well as the sheer scale, scope, time, and resources required for an NPI trial to be informative (or at least not misinformative).

In this talk, Dr. Haber will discuss the challenges in generating useful evidence for COVID-19 NPIs, the landscape of the literature, and highlight key controversies in several high profile studies over the course of the pandemic. Chasing after unknowables poses major problems for the metascience/replicability movement, institutional research science, and decision makers. If the only choices for informing an important topic are "weak study design" vs "do nothing," when is "do nothing" the best choice?

Impact evaluation for COVID-19 non-pharmaceutical interventions: what is (un)knowable?

If we want good work to get done, we should credit those who do it. In science, researchers are credited predominantly via authorship on publications. But many contributions to modern research are not recognized with authorship, due in part to the high bar imposed by the authorship criteria of many journals. “Contributorship” is a more inclusive framework for indicating who did what in the work described by a paper, and many scientific journals have recently implemented versions of it. I will consider the motivation for and specifics of this change, describe the tenzing tool we created to facilitate it, and how we might want to support and shape the shift toward contributorship.

Redressing imbalances in the kind of research that gets done and who gets credit for it (11h CEST!!)

The ventral visual pathway extends from the occipital to the anterior temporal regions, and is specialized in giving meaning to objects and people that are perceived through vision. Numerous studies in functional magnetic resonance imaging have focused on the cerebral basis of visual recognition. However, this technique is susceptible to magnetic artefacts in ventral anterior temporal regions and it has led to an underestimation of the role of these regions within the ventral visual stream, especially with respect to face recognition and semantic representations. Moreover, there is an increasing need for implicit methods assessing these functions as explicit tasks lack specificity. In this talk, I will present three studies using fast periodic visual stimulation (FPVS) in combination with scalp and/or intracerebral EEG to overcome these limitations and provide high SNR in temporal regions. I will show that, beyond face recognition, FPVS can be extended to investigate semantic representations using a face-name association paradigm and a semantic categorisation paradigm with written words. These results shed new light on the role of temporal regions and demonstrate the high potential of the FPVS approach as a powerful electrophysiological tool to assess various cognitive functions in neurotypical and clinical populations.

Investigating visual recognition and the temporal lobes using electrophysiology and fast periodic visual stimulation

The successful recognition of familiar persons is critical for social interactions. Despite extensive research on the neural representations of familiar faces, we know little about how such representations unfold as someone becomes familiar. In three EEG experiments, we elucidated how representations of face familiarity and identity emerge from different qualities of familiarization: brief perceptual exposure (Experiment 1), extensive media familiarization (Experiment 2) and real-life personal familiarization (Experiment 3). Time-resolved representational similarity analysis revealed that familiarization quality has a profound impact on representations of face familiarity: they were strongly visible after personal familiarization, weaker after media familiarization, and absent after perceptual familiarization. Across all experiments, we found no enhancement of face identity representation, suggesting that familiarity and identity representations emerge independently during face familiarization. Our results emphasize the importance of extensive, real-life familiarization for the emergence of robust face familiarity representations, constraining models of face perception and recognition memory.

Getting to know you: emerging neural representations during face familiarization

There is a growing body of evidence that reproducibility or replication is low in neuroscience and in neuroimaging in particular, but the factors affecting studies solidity are still generally poorly understood, and the solutions are not clearly exposed to the neuroimaging scientific community. In this talk, I will review the key factors contributing to irreproducible results in neuroimaging specifically in the context of explanatory or prediction studies and propose a series of practical steps to improve the neuroimaging (and neuroscience) results robustness and re-usability.  

Neuroimaging reproducibility - pain points and roadmap for solid and reusable results

The last two decades have seen a rise in online projects such as Wikipedia or OpenStreetMap in which people collaborate to create a common product. Contributors in such projects often work together sequentially. Essentially, the first contributor generates an entry (e.g., a Wikipedia article) independently which is then adjusted in the following by other contributors by adding or correcting information. We refer to this way of working together as sequential collaboration. This process has not yet been studied in the context of judgment and decision making even though research has demonstrated that Wikipedia and OpenStreetMap yield very accurate information. In this talk, I give first insights into the structure of sequential collaboration, how adjusting each other’s judgments can yield more accurate final estimates, which boundary conditions need to be met, and which underlying mechanisms may be responsible for successful collaboration. A preprint is available at https://psyarxiv.com/w4xdk/ 

Why does online collaboration work? Insights into sequential collaboration

The ability to recognize someone’s voice spans a broad spectrum with phonagnosia on the low end and super recognition at the high end. Yet there is no standardized test to measure the individual ability to learn and recognize newly-learnt voices with samples of speech-like phonetic variability. We have developed the Jena Voice Learning and Memory Test (JVLMT), a 20 min-test based on item response theory and applicable across different languages. The JVLMT consists of three phases in which participants are familiarized with eight speakers in two stages and then perform a three-alternative forced choice recognition task, using pseudo sentences devoid of semantic content. Acoustic (dis)similarity analyses were used to create items with different levels of difficulty. Test scores are based on 22 Rasch-conform items. Items were selected and validated in online studies based on 232 and 454 participants, respectively. Mean accuracy is 0.51 with an SD of .18. The JVLMT showed high and moderate correlations with convergent validation tests (Bangor Voice Matching Test; Glasgow Voice Memory Test) and a weak correlation with a discriminant validation test (Digit Span). Empirical (marginal) reliability is 0.66. Four participants with super recognition (at least 2 SDs above the mean) and 7 participants with phonagnosia (at least 2 SDs below the mean) were identified. The JVLMT is a promising screen too for voice recognition abilities in a scientific and neuropsychological context.

The Jena Voice Learning and Memory Test (JVLMT)

The goal of this talk is to first provide a realization of why the replication crisis is omnipresent and then point to several tools via which the listener can improve their own work. To do so, I will go through our own work on social thermoregulation, point out why I thought changes were necessary, discuss which shortcomings we have in our own work, which measures we have taken to reduce those shortcomings, which tools we have relied on to do so, and which steps I believe we still need to make. Specifically, I will go through the following points:

(1) Major replication failures and data fabrication in the field of psychology
(2) Replication failures of social thermoregulation studies
(3) Realization that many of our studies were underpowered
(4) Realization that many of our studies were very narrow in scope (i.e., in undergraduate students and mostly in EU/US)
(5) Realization that a lot of our measures were not independently validated

I will show these for our own work (but will also show why, via a meta-analysis, we have enough confidence to proceed with social thermoregulation research).

Throughout the talk I will point you to the following tools that facilitate our work:

(a) Templates for exploratory and confirmatory research and for meta-analyses (developed for our work, but easily adaptable for other programs). I will also show you how to fork our templates.
(b) A lab philosophy
(c) A research milestones sheet for collaborations and overviews
(d) Excel sheet for contributorship
(e) A tutorial for exploratory research

I would recommend listeners to read through this chapter before the talk (I will repeat a lot of that work, but I will go into greater depth).

Lessons from the credibility revolution – social thermoregulation as a case study

A striking range of individual differences has been reported in a variety of visual search tasks, which naturally leads to the idea that some people are better at finding things than others. However, this conclusion appears to be premature. We carried out a replication of three recent visual search experiments and found that each task showed a wide range of individual differences as predicted, and observed good test-retest reliability in all three. However, performance on any one task was not correlated with the performance in the others: participants who naturally adopt efficient search strategies in one paradigm may perform at chance in another! Furthermore, we also show that behaviour in different versions of the same paradigm can be radically different: When simple line segments are used for search items, a large range of search strategies are found. If we instead use more complex search items, all our participants effortlessly adopt an optimal strategy. These results suggest search strategies are stable over time, but context-specific. To understand visual search we, therefore, need to account not only for differences between individuals but also how individuals interact with the search task and context.

Searching for the Super-Searchers

The human visual system enables us to recognize objects (e.g., this is a cup) and act upon them (e.g., grasp the cup) with astonishing ease and accuracy. For decades, it was widely accepted that these different functions rely on two separated cortical pathways. The ventral occipitotemporal pathway subserves object recognition, while the dorsal occipitoparietal pathway promotes visually guided actions. In my talk, I will discuss recent evidence from a series of neuropsychological, developmental and neuroimaging studies that were aimed to explore the nature of object representations in the dorsal pathway. The results from these studies highlight the plausible role of the dorsal pathway in object perception and reveal an interplay between shape representations derived by the two pathways. Together, these findings challenge the binary distinction between the two pathways and are consistent with the view that object recognition is not the sole product of ventral pathway computations, but instead relies on a distributed network of regions.

The contribution of the dorsal visual pathway to perception and action

Visual attention refers to a set of processes allowing selection of relevant and filtering out of irrelevant information in the visual environment. A large amount of research on visual attention has involved visual search paradigms, where observers are asked to report whether a single target is present or absent. However, recent studies have revealed that these classic single-target visual search tasks only provide a snapshot of how attention is allocated in the visual environment, and that multitarget visual foraging tasks may capture the dynamics visual attention more accurately. In visual foraging, observers are asked to select multiple instances of multiple target types, as fast as they can. A critical question in foraging research concerns the factors driving the next target selection. Most likely, this would require two steps: (1) identifying a set of candidates for the next selection, and (2) selecting the best option among these candidates. After having briefly described the advantage of visual foraging over visual search, I will review recent visual foraging studies testing the influence of several manipulations (e.g., target crypticity, number of items, selection modality) on foraging behaviour. Overall, these studies revealed that the next target selection during visual foraging is determined by the competition between three factors: target value, target proximity, and priming of features. I will explain how the analysis of individual differences in foraging behaviour can provide important information, with the idea that individuals show by-default internal biases toward value, proximity and priming that determine their search strategy and behaviour.

Beyond visual search: studying visual attention with multitarget visual foraging tasks

In recent years, more and more evidence has accumulated showing that many studies in psychological research cannot be replicated, effects are often overestimated, and little is publicly known about unsuccessful studies. What are the mechanisms behind this crisis? In this talk, I will explain how we got there and why it is still difficult to break free from the current system. I will further explain which role Open Science plays within the replication crisis and how it can help to improve science. This might sound like a pessimistic, negative talk, but I will end it on a positive note, I promise!

The recent history of the replication crisis in psychology & how Open Science can be part of the solution

Case-control comparisons are a gold standard method for diagnosing and researching neuropsychological deficits and dissociations at the single-case level. These statistical tests, developed by John Crawford and collaborators, provide quantitative criteria for the classical concepts of deficit, dissociation and double-dissociation. Much attention has been given to the control of Type I (false positive) errors for these tests, but far less to the avoidance of Type II (false negative) errors; that is, to statistical power. I will describe the origins and limits of statistical power for case-control comparisons, showing that there are hard upper limits on power, which have important implications for the design and interpretation of single-case studies. My aim is to stimulate discussion of the inferential status of single-case neuropsychological evidence, particularly with respect to contemporary ideals of open science and study preregistration.



McIntosh, R. D., & Rittmo, J. Ö. (2021). Power calculations in single-case neuropsychology: a practical primer. Cortex, 135, 146-158. https://doi.org/10.1016/j.cortex.2020.11.005 [preprint version: https://psyarxiv.com/fxz49]

McIntosh, R. D. (2018). Simple dissociations for a higher-powered neuropsychology. Cortex, 103, 256-265. https://doi.org/10.1016/j.cortex.2018.03.015 [preprint version: https://psyarxiv.com/mnhct]

The problem of power in single-case neuropsychology

State-of-the-art machine vision models can predict human recognition memory for complex scenes with astonishing accuracy. In this talk I present work that investigated how memorable scenes are actually remembered and experienced by human observers. We found that memorable scenes were recognized largely based on recollection of specific episodic details but also based on familiarity for an entire scene. I thus highlight current limitations in machine vision models emulating human recognition memory, with promising opportunities for future research. Moreover, we were interested in what observers specifically remember about complex scenes. We thus considered the functional role of eye-movements as a window into the content of memories, particularly when observers recollected specific information about a scene. We found that when observers formed a memory representation that they later recollected (compared to scenes that only felt familiar), the overall extent of exploration was broader, with a specific subset of fixations clustered around later to-be-recollected scene content, irrespective of the memorability of a scene. I discuss the critical role that our viewing behavior plays in visual memory formation and retrieval and point to potential implications for machine vision models predicting the content of human memories. 

Exploring Memories of Scenes

Deciding whether two different face photographs or voice samples are from the same person represent fundamental challenges within applied settings. To date, most research has focussed on average performance in these tests, failing to consider individual differences and within-person consistency in responses. In the current studies, participants completed the same face or voice matching test on two separate occasions, allowing comparison of overall accuracy across the two timepoints as well as consistency in trial-level responses. In both experiments, participants were highly consistent in their performances. In addition, we demonstrated a large association between consistency and accuracy, with the most accurate participants also tending to be the most consistent. This is an important result for applied settings in which organisational groups of super-matchers are deployed in real-world contexts. Being able to reliably identify these high performers based upon only a single test informs regarding recruitment for law enforcement agencies worldwide.

Accuracy versus consistency: Investigating face and voice matching abilities

Progress in psychology has been frustrated by challenges concerning replicability, generalizability, strategy selection, inferential reproducibility, and computational reproducibility. Although often discussed separately, I argue that these five challenges share a common cause: insufficient investment of resources into the typical psychology study. I further suggest that big team science can help address these challenges by allowing researchers to pool their resources to efficiently and drastically increase the amount of resources available for a single study. However, the current incentives, infrastructure, and institutions in academic science have all developed under the assumption that science is conducted by solo Principal Investigators and their dependent trainees. These barriers must be overcome if big team science is to be sustainable. Big team science likely also carries unique risks, such as the potential for big team science institutions to monopolize power, become overly conservative, make mistakes at a grand scale, or fail entirely due to mismanagement and a lack of financial sustainability. I illustrate the promise, barriers, and risks of big team science with the experiences of the Psychological Science Accelerator, a global research network of over 1400 members from 70+ countries.

A Manifesto for Big Team Science

The human brain is a heavily interconnected structure giving rise to complex functions. While brain functionality is mostly revealed during wakefulness, the sleeping brain might offer another view into physiological and pathological brain connectivity. Furthermore, there is a large body of evidence supporting that sleep mediates plastic changes in brain connectivity. Although brain plasticity depends on environmental input which is provided in the waking state, disconnection during sleep might be necessary for integrating new into existing information and at the same time restoring brain efficiency. In this talk, I will present structural, molecular, and electrophysiological markers of brain connectivity and sleep-dependent restoration that we have evaluated using Magnetic Resonance Imaging and electroencephalography in a healthy population. In a second step, I will show how we translated the gained findings into two clinical populations in which alterations in brain connectivity have been described, the neuropsychiatric disorder attention-deficit/hyperactivity disorder (ADHD) and the neurologic disorder thalamic ischemic stroke.

Markers of brain connectivity and sleep-dependent restoration: basic research and translation into clinical populations

Face matching tests have traditionally been developed to assess human face perception in the neurotypical range, but methods that underlie their development often make it difficult for these measures to be applied in atypical populations (developmental prosopagnosics, super recognizers) due to unadjusted difficulty. We have recently presented the development of the Oxford Face Matching Test, a measure that bases individual item-difficulty on algorithmically derived similarity of presented stimuli. The measure seems useful as it can be given online or in-laboratory, has good discriminability and high test-retest reliability in the neurotypical groups. In addition, it has good validity in separating atypical groups at either of the spectrum ends. In this talk, I examine the stability of the OFMT and other traditionally used measures in atypical groups. On top of the theoretical significance of determining whether reliability of tests is equivalent in atypical population, this is an important question because of the practical concerns of retesting the same participants across different lab groups. Theoretical and practical implications for further test development and data sharing are discussed.

Algorithmic advances in face matching: Stability of tests in atypical groups

Experimental psychology research typically employs paradigms that greatly simplify the real- world conditions within which cognition occurs. This approach has been successful for isolating cognitive processes, but cannot adequately capture how perception operates in complex environments. In turn, real world environments rarely afford the access and control required for rigorous scientific experimentation. In recent years, technology has advanced to provide a solution to these problems, through the development of affordable high-capability virtual reality (VR) equipment. The application of VR is now increasing rapidly in Psychology, but a stimulus that has been used widely in this field – the human face – is captured poorly in current VR experiments. To overcome this issue, we have recently, we have developed a user-friendly method for creating photo-realistic avatars of real people, that can be imported into VR. Across a series of experiments, we demonstrate that avatar faces of familiar people are recognised with high accuracy (Study 1), replicate the familiarity advantage typically observed in real-world face matching (Study 2), and show that these avatars produce a similarity-space that corresponds closely with real photographs of the same faces (Study 3). These studies open up the way to conduct psychological experiments on visual perception and social cognition under increased realism in VR. 

Identifying Avatars of Real People

Regional specialization is a hallmark of neural speech processing. Two of the most important specializations concern hemispheric lateralization and the intra-hemispheric differentiation between motor and sensory speech areas. One important question concerns how information processed in different hemispheres or between sensory and motor speech areas is integrated. One increasingly dominant hypothesis is that the brain overcomes this “binding problem” by the synchronization of oscillatory activity across the relevant regions. Two temporal scales seem to be of particular relevance for speech processing: the theta frequency band corresponding roughly to the length of syllables (~100–300 ms), and in the gamma frequency band corresponding to the duration of phonemes (~20–50 ms). In my talk, I will introduce different experiments where we probed oscillatory synchronization as a mechanism for inter- and intrahemispheric communication in the speech network by manipulating oscillatory synchrony from the outside through the application of electric brain stimulation.

Selective modulation of connectivity in the speech network by electric brain stimulation

Vision creates an individually unique window to our world. Past research has shown that individuals show highly consistent differences in their gaze behavior towards certain semantic features of a scene, but it is unclear whether further such features of individual divergence exist. Here, I will present ongoing work zooming in on person perception. A first line of work expanded the annotations of an existing stimulus set with pixel masks for body and face parts. Preliminary results of eye-tracking experiments using these stimuli suggest consistent individual differences, especially in the tendency to fixate mouth and eye regions. A second line of work focusses on intraindividual differences in face processing across time and across the visual field. Previous work has shown that the recognition of inner face features is best at their expected / usual location in the visual field. To date, it is still unclear if this enhanced recognition performance is a learned adaptation to input statistics or following an innate, face-specific template. The ongoing global pandemic with a surge of people wearing face masks gives us an exceptional chance to investigate the processing of artificial face features. I will present preliminary fMRI results suggesting that over time the ventral processing of face masks becomes increasingly similar to that of faces. This result is currently being followed-up by behavioral experiments testing whether the feature-location contingency observed for natural facial features can be found for artificial features as well. Taken together, these results suggest that individual gaze behavior and perception is the result of an interplay between our unique visual brain and environment.

Intra- and interindividual differences in person perception

Perception can be strongly serially-dependent (i.e. biased toward previously seen stimuli). Recently, serial dependencies in perception were proposed as a mechanism for perceptual stability, increasing the apparent continuity of the complex environments we experience in everyday life. For example, stable scene perception can be actively achieved by the visual system through global serial dependencies, a special kind of serial dependence between summary statistical representations. Serial dependence occurs also between emotional expressions, but it is highly selective for the same identity. Overall, these results further support the notion of serial dependence as a global, highly specialized, and purposeful mechanism. However, serial dependence could also be a deleterious phenomenon in unnatural or unpredictable situations, such as visual search in radiological scans, biasing current judgments toward previous ones even when accurate and unbiased perception is needed. For example, observers make consistent perceptual errors when classifying a tumor- like shape on the current trial, seeing it as more similar to the shape presented on the previous trial. In a separate localization test, observers make consistent errors when reporting the perceived position of an objects on the current trial, mislocalizing it toward the position in the preceding trial. Taken together, these results show two opposite sides of serial dependence; it can be a beneficial mechanism which promotes perceptual stability, but at the same time a deleterious mechanism which impairs our percept when fine recognition is needed.

What is serially-dependent perception good for?

In this talk I will present recent developments in data sharing, organization, and analyses that allow to build fully reproducible workflows. First, I will present the Brain Imaging Data structure and discuss how this allows to build workflows, showing some new tools to read/import/create studies from EEG data structured that way. Second, I will present several newly developed tools for reproducible pre-processing and statistical analyses. Although it does take some extra effort, I will argue that it largely feasible to make most EEG data analysis fully reproducible.

* Disclosure: I am the EEG-BIDS  and Electrophysiology-BIDS derivatives co-lead, lead developer of the LIMO-MEG toolbox and collaborate with EEGLAB and as such my views are totally biased.*

Reproducible EEG from raw data to publication figures

Current computational models of visual salience accurately predict the distribution of fixations on isolated visual stimuli. It is not known, however, whether the global salience of a stimulus, that is its effectiveness in the competition for attention with other stimuli, is a function of the local salience or an independent measure. Further, do task and familiarity with the competing images influence eye movements? In this talk, I will present the analysis of a computational model of the global salience of natural images. We trained a machine learning algorithm to learn the direction of the first saccade of participants who freely observed pairs of images. The pairs balanced the combinations of new and already seen images, as well as task and task-free trials. The coefficients of the model provided a reliable measure of the likelihood of each image to attract the first fixation when seen next to another image, that is their global salience. For example, images of close-up faces and images containing humans were consistently looked first and were assigned higher global salience. Interestingly, we found that global salience cannot be explained by the feature-driven local salience of images, the influence of task and familiarity was rather small and we reproduced the previously reported left-sided bias. This computational model of global salience allows to analyse multiple other aspects of human visual perception of competing stimuli. In the talk, I will also present our latest results from analysing the saccadic reaction time as a function of the global salience of the pair of images.

Global visual salience of competing stimuli

Emotion processing is thought to be impaired in autism and linked to atypical visual exploration and arousal modulation to others faces and gaze, yet evidence is equivocal. We propose that, where observed, atypical socioemotional processing is due to alexithymia, a distinct but frequently co-occurring condition which affects emotional self-awareness and Interoception. In study 1 (N = 80),  we tested this hypothesis by studying the spatio-temporal dynamics and entropy of eye-gaze during emotion processing tasks. Evidence from traditional and novel methods revealed that atypical eye-gaze and emotion recognition is best predicted by alexithymia in both autistic and non-autistic individuals. In Study 2 (N = 70), we assessed interoceptive and autonomic signals implicated in socioemotional processing, and found evidence for alexithymia (not autism) driven effects on gaze and arousal modulation to emotions. We also conducted two large-scale studies (N = 1300), using confirmatory factor-analytic and network modelling and found evidence that Alexithymia and Autism are distinct at both a latent level and their intercorrelations. We argue that: 1) models of socioemotional processing in autism should conceptualise difficulties as intrinsic to alexithymia, and 2) assessment of alexithymia is crucial for diagnosis and personalised interventions in autism.

Is it Autism or Alexithymia? explaining atypical socioemotional processing

Human visual perception results from a complex chain of processes, starting with the orientation-selective encoding of luminance in the primary visual cortex (V1). As the visual signals proceed in the visual system, increasingly more complex shape properties are coded, with several high-level regions specializing for selective categories such as faces, words, natural scenes. We know very little about how such high-level specialization builds upon primary encoding stages in V1. Our work combines multiple investigation techniques: psychophysics, electrophysiology (scalp EEG, ERP and steady-state), as well as neuroimaging (of V1 and high-level visual regions) and suggests that the specialization of face processing, though emerging at high-level stages of visual processing, roots into the processing of selective orientation ranges. These findings encourage the adoption of more integrative approaches to face perception, and vision in general, taking into account both low- and high-level visual mechanisms in order to address whether and how these interact when processing complex stimuli such as faces of our peers.

Faces are made of this… Sensitivity to Orientation when processing faces

Have you ever wondered what type fonts, multisensory decision-making, and consumer psychology all have in common? Join me in exploring how perceptual effects present in everyday situations affect individuals with and without dyslexia differently. I will outline my recent research on whether dyslexia affects only language-based situations and interactions of everyday life, or if there is a hidden side to it that the traditional definitions of dyslexia only hint at? For instance, can small changes of perceptual elements affect students with dyslexia attending higher education? In an attempt to answer these questions, I will draw back on a variety of my studies investigating differential eye movements, EEG components, computational modelling, and behavioural performance in adult dyslexia. I will show how a multi-method approach can be used to provide new insights into the way we approach dyslexia.

The intersection of perceptual decision-making, reading, consumer psychology and dyslexia – a multi-method approach

Visual saliency plays an important role in natural vision as it directs our gaze to relevant features in our environment. Recent evidence shows that where we look in a natural scene is most strongly influenced by the types of embedded objects. Here, I will present data (1) replicating strong and consistent individual differences in eye movements towards objects along semantic dimensions; (2) showing systematic salience differences between Super Recognizers (SRs) and controls; and (3) showing differences in SR gaze behavior towards face and inner face regions embedded in natural scenes. Finally, I will discuss the potential relevance of these differences in gaze behaviour for understanding enhanced face recognition abilities in SRs. 

Evidence for atypical semantic visual salience in Super Recognizers

Eye movements allow for visual exploration which serves to gather information from the environment in order to create, update, and reconstruct memories. There is consistent agreement regarding the positive relationship between cumulative eye movement sampling and subsequent recognition, but the role of aging in this eye movement behavior is currently unknown. Also, it is unclear whether aging influences the eye movement repetition effect (i.e., fewer fixations to repeated, compared to novel, stimuli). This study investigated the influence of aging on cumulative sampling, the repetition effect, and subsequent memory. Eye movements were monitored in two phases: a study phase during which healthy younger and healthy older adults viewed single faces from the same or different viewpoints across multiple blocks, and a test phase, in which each face was displayed from the same or a different viewpoint as seen during the study phase. Previous work by Olsen et al. (2015) indicated that the hippocampus, a region of the brain that could be affected by aging, critically contributed to recognizing faces viewed from different viewpoints. Here, examination of eye movements during encoding indicated that greater cumulative sampling was associated with subsequent recognition among younger adults. Increased sampling, however, was not associated with subsequent recognition among older adults, which suggests that in aging, the accumulation of visual information into a memory representation that supports recognition may be disrupted. Furthermore, the eye movement repetition effect was similar among younger and older adults but was not associated with subsequent recognition for either group. This suggests that, regardless of participants’ age and the nature of the recognition task, the memory representation that is reflected by the repetition effect may not contribute to the conscious recognition of the face. Finally, our findings demonstrated that healthy aging did not disrupt the ability to recognize faces that are presented across small changes in viewpoint. Altogether, this work provides key insights into the role of aging in eye movement expressions of memory and may pave the way for the development of an eye-tracking test that identifies cognitive decline before subjective symptoms emerge.