Five-dimensional neuroimaging: localization of the time-frequency dynamics of cortical activity

The spatiotemporal dynamics of cortical oscillations across human brain regions remain poorly understood because of a lack of adequately validated methods for reconstructing such activity from noninvasive electrophysiological data. In this paper, we present a novel adaptive spatial filtering algorithm optimized for robust source time-frequency reconstruction from magnetoencephalography (MEG) and electroencephalography (EEG) data. The efficacy of the method is demonstrated with simulated sources and is also applied to real MEG data from a self-paced finger movement task. The algorithm reliably reveals modulations both in the beta band (12-30 Hz) and high gamma band (65-90 Hz) in sensorimotor cortex. The performance is validated by both across-subjects statistical comparisons and by intracranial electrocorticography (ECoG) data from two epilepsy patients. Interestingly, we also reliably observed high frequency activity (30-300 Hz) in the cerebellum, although with variable locations and frequencies across subjects. The proposed algorithm is highly parallelizable and runs efficiently on modern high-performance computing clusters. This method enables the ultimate promise of MEG and EEG for five-dimensional imaging of space, time, and frequency activity in the brain and renders it applicable for widespread studies of human cortical dynamics during cognition.     

Probabilistic algorithms for MEG/EEG source reconstruction using temporal basis functions learned from data

We present two related probabilistic methods for neural source reconstruction from MEG/EEG data that reduce effects of interference, noise, and correlated sources. Both methods localize source activity using a linear mixture of temporal basis functions (TBFs) learned from the data. In contrast to existing methods that use predetermined TBFs, we compute TBFs from data using a graphical factor analysis based model [Nagarajan, S.S., Attias, H.T., Hild, K.E., Sekihara, K., 2007a. A probabilistic algorithm for robust interference suppression in bioelectromagnetic sensor data. Stat Med 26, 3886-3910], which separates evoked or event-related source activity from ongoing spontaneous background brain activity. Both algorithms compute an optimal weighting of these TBFs at each voxel to provide a spatiotemporal map of activity across the brain and a source image map from the likelihood of a dipole source at each voxel. We explicitly model, with two different robust parameterizations, the contribution from signals outside a voxel of interest. The two models differ in a trade-off of computational speed versus accuracy of learning the unknown interference contributions. Performance in simulations and real data, both with large noise and interference and/or correlated sources, demonstrates significant improvement over existing source localization methods.     

Geometrical interpretation of fMRI-guided MEG/EEG inverse estimates

Magneto- and electroencephalography (MEG/EEG) and functional magnetic resonance imaging (fMRI) provide complementary information about the functional organization of the human brain. An important advantage of MEG/EEG is the millisecond time resolution in detecting electrical activity in the cerebral cortex. The interpretation of MEG/EEG signals, however, is limited by the difficulty of determining the spatial distribution of the neural activity. Functional MRI can help in the MEG/EEG source analysis by suggesting likely locations of activity. We present a geometric interpretation of fMRI-guided inverse solutions in which the MEG/EEG source estimate minimizes a distance to a subspace defined by the fMRI data. In this subspace regularization (SSR) approach, the fMRI bias does not assume preferred amplitudes for MEG/EEG sources, only locations. Characteristic dependence of the source estimates on the regularization parameters is illustrated with simulations. When the fMRI locations match the true MEG/EEG source locations, they serve to bias the underdetermined MEG/EEG inverse solution toward the fMRI loci. Importantly, when the fMRI loci do not match the true MEG/EEG loci, the solution is insensitive to those fMRI loci.     

Identifying true cortical interactions in MEG using the nulling beamformer

Modeling functional brain interaction networks using non-invasive EEG and MEG data is more challenging than using intracranial recording data. This is because most interaction measures are not robust to the cross-talk (interference) between cortical regions, which may arise due to the limited spatial resolution of EEG/MEG inverse procedures. In this article, we describe a modified beamforming approach to accurately measure cortical interactions from EEG/MEG data, designed to suppress cross-talk between cortical regions. We estimate interaction measures from the output of the modified beamformer and test for statistical significance using permutation tests. Since the underlying neuronal sources and their interactions are unknown in real MEG data, we demonstrate the performance of the proposed beamforming method in a novel simulation scheme, where intracranial recordings from a macaque monkey are used as neural sources to simulate realistic MEG signals. The advantage of this approach is that local field potentials are more realistic representations of true neuronal sources than simulation models and therefore are more suitable to indicate the performance of our nulling beamforming method.     

Estimating true brain connectivity from EEG/MEG data invariant to linear and static transformations in sensor space

The imaginary part of coherency is a measure to investigate the synchronization of brain sources on the EEG/MEG sensor level, robust to artifacts of volume conduction meaning that independent sources cannot generate a significant result. It does not mean, however, that volume conduction is irrelevant when true interactions are present. Here, we analyze in detail the possibilities to construct measures of true brain interactions which are strictly invariant to linear spatial transformations of the sensor data. Specifically, such measures can be constructed from maximization of imaginary coherency in virtual channels, bivariate measures as a corrected variate of imaginary coherence, and global measures indicating the total interaction contained within a space or between two spaces. A complete theoretic framework on this question is provided for second order statistical moments. Relations to existing linear and nonlinear approaches are presented. We applied the methods to resting state EEG data, showing clear interactions at all bands, and to a combined measurement of EEG and MEG during rest condition and a finger tapping task. We found that MEG was capable of observing brain interactions which were not observable in the EEG data.     

The advantage of combining MEG and EEG: comparison to fMRI in focally stimulated visual cortex

To exploit the high (millisecond) temporal resolution of magnetoencephalography (MEG) and electroencephalography (EEG) for measuring neuronal dynamics within well-defined brain regions, it is important to quantitatively assess their localizing ability. Previous modeling studies and empirical data suggest that a combination of MEG and EEG signals should yield the most accurate localization, due to their complementary sensitivities. However, these two modalities have rarely been explicitly combined for source estimation in studies of recorded brain activity, and a quantitative empirical assessment of their abilities, combined and separate, is currently lacking. Here we studied early visual responses to focal Gabor patches flashed during subject fixation. MEG and EEG data were collected simultaneously and were compared with the functional MRI (fMRI) localization produced by identical stimuli in the same subjects. This allowed direct evaluation of the localization accuracy of separate and combined MEG/EEG inverse solutions. We found that the localization accuracy of the combined MEG+EEG solution was consistently better than that of either modality alone, using three different source estimation approaches. Further analysis suggests that this improved localization is due to the different properties of the two imaging modalities rather than simply due to increased total channel number. Thus, combining MEG and EEG data is important for high-resolution spatiotemporal studies of the human brain.     

The saccadic spike artifact in MEG

Electro- and magnetoencephalography (EEG/MEG) are the means to investigate the dynamics of neuronal activity non-invasively in the human brain. However, both EEG and MEG are also sensitive to non-neural sources, which can severely complicate the interpretation. The saccadic spike potential (SP) at saccade onset has been identified as a particularly problematic artifact in EEG because it closely resembles synchronous neuronal gamma band activity. While the SP and its confounding effects on EEG have been thoroughly characterized, the corresponding artifact in MEG, the saccadic spike field (SF), has not been investigated. Here we provide a detailed characterization of the SF. We simultaneously recorded MEG, EEG, gaze position and electrooculogram (EOG). We compared the SF in MEG for different saccade sizes and directions and contrasted it with the well-known SP in EEG. Our results reveal a saccade amplitude and direction dependent, lateralized saccadic spike artifact, which was most prominent in the gamma frequency range. The SF was strongest at frontal and temporal sensors but unlike the SP in EEG did not contaminate parietal sensors. Furthermore, we observed that the source configurations of the SF were comparable for regular and miniature saccades. Using distributed source analysis we identified the sources of the SF in the extraocular muscles. In summary, our results show that the SF in MEG closely resembles neuronal activity in frontal and temporal sensors. Our detailed characterization of the SF constitutes a solid basis for assessing possible saccadic spike related contamination in MEG experiments.     

Spectral spatiotemporal imaging of cortical oscillations and interactions in the human brain

This paper presents a computationally efficient source estimation algorithm that localizes cortical oscillations and their phase relationships. The proposed method employs wavelet-transformed magnetoencephalography (MEG) data and uses anatomical MRI to constrain the current locations to the cortical mantle. In addition, the locations of the sources can be further confined with the help of functional MRI (fMRI) data. As a result, we obtain spatiotemporal maps of spectral power and phase relationships. As an example, we show how the phase locking value (PLV), that is, the trial-by-trial phase relationship between the stimulus and response, can be imaged on the cortex. We apply the method to spontaneous, evoked, and driven cortical oscillations measured with MEG. We test the method of combining MEG, structural MRI, and fMRI using simulated cortical oscillations along Heschl's gyrus (HG). We also analyze sustained auditory gamma-band neuromagnetic fields from MEG and fMRI measurements. Our results show that combining the MEG recording with fMRI improves source localization for the non-noise-normalized wavelet power. In contrast, noise-normalized spectral power or PLV localization may not benefit from the fMRI constraint. We show that if the thresholds are not properly chosen, noise-normalized spectral power or PLV estimates may contain false (phantom) sources, independent of the inclusion of the fMRI prior information. The proposed algorithm can be used for evoked MEG/EEG and block-designed or event-related fMRI paradigms, or for spontaneous MEG data sets. Spectral spatiotemporal imaging of cortical oscillations and interactions in the human brain can provide further understanding of large-scale neural activity and communication between different brain regions.     

A method for spatiotemporal mapping of event-related modulation of cortical rhythmic activity

Cortical rhythmic activity can be systematically modulated by stimuli or tasks and may thus provide relevant information about brain function. Meaningful use of those phenomena requires characterization of both locations and time courses of event-related suppressions and increases of oscillatory activity. However, localization of the neural sources of cortical rhythms during intervals of very low levels of activity, and within short time intervals, is not a trivial matter. Hence, event-related modulation of rhythmic activity has typically been described at the level of magnetoencephalography (MEG) sensors or electroencephalography (EEG) electrodes, without reaching into the brain. Here, we introduce erDICS, an event-related version of Dynamic Imaging of Coherent Sources that allows spatial mapping of the level of oscillatory activity in the brain as a function of time, with respect to stimulus or task timing. By utilizing a time-resolved frequency-domain beamformer, erDICS yields the spatial distribution of both power suppressions and power increases. Permutation tests further reveal areas and time windows in which the modulations of oscillatory power are statistically significant, in individual subjects. We demonstrate the usability of erDICS on simulated and real MEG data. From the erDICS maps we identify areas showing salient event-related changes of rhythmic activity, represent them with equivalent current dipoles and calculate their contribution to the measured signal. Comparison of this multidipole model with the original signal yields a quantitative measure of goodness for the identified source areas and the analysis approach in general.     

Localization of extended brain sources from EEG/MEG: the ExSo-MUSIC approach

We propose a new MUSIC-like method, called 2q-ExSo-MUSIC (q ≥ 1). This method is an extension of the 2q-MUSIC (q ≥ 1) approach for solving the EEG/MEG inverse problem, when spatially-extended neocortical sources ("ExSo") are considered. It introduces a novel ExSo-MUSIC principle. The novelty is two-fold: i) the parameterization of the spatial source distribution that leads to an appropriate metric in the context of distributed brain sources and ii) the introduction of an original, efficient and low-cost way of optimizing this metric. In 2q-ExSo-MUSIC, the possible use of higher order statistics (q ≥ 2) offers a better robustness with respect to Gaussian noise of unknown spatial coherence and modeling errors. As a result we reduced the penalizing effects of both the background cerebral activity that can be seen as a Gaussian and spatially correlated noise, and the modeling errors induced by the non-exact resolution of the forward problem. Computer results on simulated EEG signals obtained with physiologically-relevant models of both the sources and the volume conductor show a highly increased performance of our 2q-ExSo-MUSIC method as compared to the classical 2q-MUSIC algorithms.     

A spatiotemporal dynamic distributed solution to the MEG inverse problem

MEG/EEG are non-invasive imaging techniques that record brain activity with high temporal resolution. However, estimation of brain source currents from surface recordings requires solving an ill-conditioned inverse problem. Converging lines of evidence in neuroscience, from neuronal network models to resting-state imaging and neurophysiology, suggest that cortical activation is a distributed spatiotemporal dynamic process, supported by both local and long-distance neuroanatomic connections. Because spatiotemporal dynamics of this kind are central to brain physiology, inverse solutions could be improved by incorporating models of these dynamics. In this article, we present a model for cortical activity based on nearest-neighbor autoregression that incorporates local spatiotemporal interactions between distributed sources in a manner consistent with neurophysiology and neuroanatomy. We develop a dynamic Maximum a Posteriori Expectation-Maximization (dMAP-EM) source localization algorithm for estimation of cortical sources and model parameters based on the Kalman Filter, the Fixed Interval Smoother, and the EM algorithms. We apply the dMAP-EM algorithm to simulated experiments as well as to human experimental data. Furthermore, we derive expressions to relate our dynamic estimation formulas to those of standard static models, and show how dynamic methods optimally assimilate past and future data. Our results establish the feasibility of spatiotemporal dynamic estimation in large-scale distributed source spaces with several thousand source locations and hundreds of sensors, with resulting inverse solutions that provide substantial performance improvements over static methods.     

A graphical model for estimating stimulus-evoked brain responses from magnetoencephalography data with large background brain activity

This paper formulates a novel probabilistic graphical model for noisy stimulus-evoked MEG and EEG sensor data obtained in the presence of large background brain activity. The model describes the observed data in terms of unobserved evoked and background factors with additive sensor noise. We present an expectation maximization (EM) algorithm that estimates the model parameters from data. Using the model, the algorithm cleans the stimulus-evoked data by removing interference from background factors and noise artifacts and separates those data into contributions from independent factors. We demonstrate on real and simulated data that the algorithm outperforms benchmark methods for denoising and separation. We also show that the algorithm improves the performance of localization with beamforming algorithms.     

Detection of very high correlation in the alpha band between temporal regions of the human brain using MEG

It is generally believed that alpha band (8-12 Hz) electric and magnetic activity in the area of the left and right temporal regions in the human brain are at best poorly correlated. There are no previous reports of very high alpha band correlation between left and right temporal regions by magnetoencephalography (MEG) or electroencephalography (EEG). We present whole head magnetoencephalography (MEG) results that demonstrate that, for temporal channels in the majority of healthy subjects tested, the alpha band signals are highly to very highly correlated and are antiparallel in direction. A correlation as high as -0.97 was found for a limited time in one subject. We suggest that the correlation found may be the consequence of strong direct or indirect coupling between homologue areas in left and right temporal regions rather than a common source. The correlation may provide a valuable index of loss of connectivity in the brain due to disease as well providing valuable insight to brain function and deserves further investigation.     

A novel integrated MEG and EEG analysis method for dipolar sources

The ability of magnetoencephalography (MEG) to accurately localize neuronal currents and obtain tangential components of the source is largely due to MEG's insensitivity to the conductivity profile of the head tissues. However, MEG cannot reliably detect the radial component of the neuronal current. In contrast, the localization accuracy of electroencephalography (EEG) is not as good as MEG, but EEG can detect both the tangential and radial components of the source. In the present study, we investigated the conductivity dependence in a new approach that combines MEG and EEG to accurately obtain, not only the location and tangential components, but also the radial component of the source. In this approach, the source location and tangential components are obtained from MEG alone, and optimal conductivity values of the EEG model are estimated by best-fitting EEG signal, while precisely matching the tangential components of the source in EEG and MEG. Then, the radial components are obtained from EEG using the previously estimated optimal conductivity values. Computer simulations testing this integrated approach demonstrated two main findings. First, there are well-organized optimal combinations of the conductivity values that provide an accurate fit to the combined MEG and EEG data. Second, the radial component, in addition to the location and tangential components, can be obtained with high accuracy without needing to know the precise conductivity profile of the head. We then demonstrated that this new approach performed reliably in an analysis of the 20-ms component from human somatosensory responses elicited by electric median-nerve stimulation.     

Application of multi-source minimum variance beamformers for reconstruction of correlated neural activity

Linearly constrained minimum variance beamformers are highly effective for analysis of weakly correlated brain activity, but their performance degrades when correlations become significant. Multiple constrained minimum variance (MCMV) beamformers are insensitive to source correlations but require a priori information about the source locations. Besides the question whether unbiased estimates of source positions and orientations can be obtained remained unanswered. In this work, we derive MCMV-based source localizers that can be applied to both induced and evoked brain activity. They may be regarded as a generalization of scalar minimum-variance beamformers for the case of multiple correlated sources. We show that for arbitrary noise covariance these beamformers provide simultaneous unbiased estimates of multiple source positions and orientations and remain bounded at singular points. We also propose an iterative search algorithm that makes it possible to find sources approximately without a priori assumptions about their locations and orientations. Simulations and analyses of real MEG data demonstrate that presented approach is superior to traditional single-source beamformers in situations where correlations between the sources are significant.     

Source cancellation profiles of electroencephalography and magnetoencephalography

Recorded electric potentials and magnetic fields due to cortical electrical activity have spatial spread even if their underlying brain sources are focal. Consequently, as a result of source cancellation, loss in signal amplitude and reduction in the effective signal-to-noise ratio can be expected when distributed sources are active simultaneously. Here we investigate the cancellation effects of EEG and MEG through the use of an anatomically correct forward model based on structural MRI acquired from 7 healthy adults. A boundary element model (BEM) with four compartments (brain, cerebrospinal fluid, skull and scalp) and highly accurate cortical meshes (~ 300,000 vertices) were generated. Distributed source activations were simulated using contiguous patches of active dipoles. To investigate cancellation effects in both EEG and MEG, quantitative indices were defined (source enhancement, cortical orientation disparity) and computed for varying values of the patch radius as well as for automatically parcellated gyri and sulci. Results were calculated for each cortical location, averaged over all subjects using a probabilistic atlas, and quantitatively compared between MEG and EEG. As expected, MEG sensors were found to be maximally sensitive to signals due to sources tangential to the scalp, and minimally sensitive to radial sources. Compared to EEG, however, MEG was found to be much more sensitive to signals generated antero-medially, notably in the anterior cingulate gyrus. Given that sources of activation cancel each other according to the orientation disparity of the cortex, this study provides useful methods and results for quantifying the effect of source orientation disparity upon source cancellation.     

fMRI-EEG integrated cortical source imaging by use of time-variant spatial constraints

In response to the need of establishing a high-resolution spatiotemporal neuroimaging technique, tremendous efforts have been focused on developing multimodal strategies that combine the complementary advantages of high-spatial-resolution functional magnetic resonance imaging (fMRI) and high-temporal-resolution electroencephalography (EEG) or magnetoencephalography (MEG). A critical challenge to the fMRI-EEG/MEG integration lies in the spatial mismatches between fMRI activations and instantaneous electrical source activities. Such mismatches are fundamentally due to the fact that fMRI and EEG/MEG signals are generated and collected in highly different time scales. In this paper, we propose a new theoretical framework to solve the problem of fMRI-EEG integrated cortical source imaging. The new framework has two principal technical advancements. First, by assuming a linear neurovascular coupling, a method is derived to quantify the fMRI signal in each voxel as proportional to the time integral of the power of local electrical current during the period of event-related potentials (ERP). Second, the EEG inverse problem is solved for every time instant using an adaptive Wiener filter, in which the prior time-variant source covariance matrix is estimated by combining the quantified fMRI responses and the segmented EEG signals before response averaging. A series of computer simulations were conducted to evaluate the proposed methods in terms of imaging the instantaneous cortical current density (CCD) distribution and estimating the source time courses with a millisecond temporal resolution. As shown in the simulation results, the instantaneous CCD reconstruction by using the proposed fMRI-EEG integration method was robust against both fMRI false positives and false negatives while retaining a spatial resolution nearly as high as that of fMRI. The proposed method could also reliably estimate the source waveforms when multiple sources were temporally correlated or uncorrelated, or were sustained or transient, or had some features in frequency or phase, or had even more complicated temporal dynamics. Moreover, applying the proposed method to real fMRI and EEG data acquired in a visual experiment yielded a time series of reconstructed CCD images, in agreement with the traditional view of hierarchical visual processing. In conclusion, the proposed method provides a reliable technique for the fMRI-EEG integration and represents a significant advancement over the conventional fMRI-weighted EEG (or MEG) source imaging techniques and is also applicable to the fMRI-MEG integrated source imaging.     

A multitrial analysis for revealing significant corticocortical networks in magnetoencephalography and electroencephalography

We present an MEG/EEG framework to reveal statistically significant brain areas engaged in the same cognitive process across trials without resort to averaging procedures. The variability of neuronal responses is assumed to take place only in the reconstructed time series of cortical sources and not in their positions. This hypothesis allows the use of the surrogate data method to detect recurrently active brain areas across trials adjusted with any cortically constrained focal MEEG inverse solution. Results obtained from synthetic data show that considering several trials enhances the accuracy of the source localisation. We apply this approach on MEG data recorded during a simple visual stimulation. The considered stimulus is frequency tagged in order to reveal the neural network correlated to its perception using phase synchronisation analysis. The results show consistent patterns of distributed synchronous networks centred on occipital areas.     

Investigating spatial specificity and data averaging in MEG

This study shows that the spatial specificity of MEG beamformer estimates of electrical activity can be affected significantly by the way in which covariance estimates are calculated. We define spatial specificity as the ability to extract independent timecourse estimates of electrical brain activity from two separate brain locations in close proximity. Previous analytical and simulated results have shown that beamformer estimates are affected by narrowing the time frequency window in which covariance estimates are made. Here we build on this by both experimental validation of previous results, and investigating the effect of data averaging prior to covariance estimation. In appropriate circumstances, we show that averaging has a marked effect on spatial specificity. However the averaging process results in ill-conditioned covariance matrices, thus necessitating a suitable matrix regularisation strategy, an example of which is described. We apply our findings to an MEG retinotopic mapping paradigm. A moving visual stimulus is used to elicit brain activation at different retinotopic locations in the visual cortex. This gives the impression of a moving electrical dipolar source in the brain. We show that if appropriate beamformer optimisation is applied, the moving source can be tracked in the cortex. In addition to spatial reconstruction of the moving source, we show that timecourse estimates can be extracted from neighbouring locations of interest in the visual cortex. If appropriate methodology is employed, the sequential activation of separate retinotopic locations can be observed. The retinotopic paradigm represents an ideal platform to test the spatial specificity of source localisation strategies. We suggest that future comparisons of MEG source localisation techniques (e.g. beamformer, minimum norm, Bayesian) could be made using this retinotopic mapping paradigm.