New method improves convergence of spatial filters in neural networks.
problem Poor convergence behavior of spatial filters in neural networks.
method Correlated initialization for spatial filters.
result Uncorrelated initialization leads to poor convergence and slow training of some parameters.
DNNs improve SIMP method but not spatially invariant, study shows.
problem Improving SIMP method with DNNs but maintaining spatial invariance.
method Use of DNNs for density field generation, study of NTK filter properties.
result DNNs lead to a non-spatially invariant filter, requiring embeddings for spatial invariance.
Proposes a GNN for multivariate time-series prediction with filtering.
problem Low signal-to-noise ratio in complex systems data.
method Integrates a spatial-temporal GNN with a matrix filtering module to generate filtered graphs.
result Proposed model outperforms baseline approaches in multivariate time-series prediction.
The electroencephalogram (EEG) is the most popular form of input for brain computer interfaces (BCIs). However, it can be easily contaminated by various artifacts and noise, e.g., eye blink, muscle activities, powerline noise, etc. Therefore, the EEG signals are often filtered both spatially and temporally to increase …
New training algorithm enhances SNNs for temporal signal processing.
problem Lack of robust training algorithms for large-scale SNNs.
method Formulated SNN as IIR filters, proposed training algorithm for optimal synapse filter kernels and weights.
result Model and training algorithm outperform state-of-the-art approaches in accuracy.
New method relaxes spatial invariance in locally connected layers, improving accuracy.
problem Improving classification accuracy with locally connected layers.
method Designing a low-rank locally connected layer with varying spatially varying combining weights.
result Relaxing spatial invariance improves classification accuracy over convolution and locally connected layers.
A new model predicts dynamic O-D matrices using graph neural networks and Kalman filters.
problem Predicting dynamic O-D demand matrices from traffic flow data.
method Combines graph neural networks and Kalman filters to recognize spatial and temporal patterns.
result The proposed model outperforms other methods in various prediction scenarios.
Latent FxLMS accelerates ANC by adapting along low-dimensional filter weights.
problem Improving active noise control with neural adaptive filters.
method Training an auto-encoder on filter coefficients, constraining weights to latent variables, and updating in latent space.
result Latent FxLMS converges in fewer steps with comparable error to standard FxLMS.
In this work we study the non-parametric reconstruction of spatio-temporal dynamical Gaussian processes (GPs) via GP regression from sparse and noisy data. GPs have been mainly applied to spatial regression where they represent one of the most powerful estimation approaches also thanks to their universal representing p…
This paper improves MI-based BCIs by applying transfer learning across all components.
problem Reducing calibration effort for new subjects in MI-based BCIs.
method Proposes TL in spatial filtering, feature engineering, and classification blocks, and adds data alignment.
result Integrating data alignment and sophisticated TL significantly improves classification performance and reduces calibration effort.
MASF improves score-based filters for high-dimensional nonlinear systems with spatially sparse measurements.
problem Challenges in data assimilation for nonlinear, high-dimensional systems with spatially sparse measurements.
method Developed a forward process tailored for filtering that transforms the system state toward the measurement space, enabling a theoretically sound formulation of the likelihood score.
result MASF shows improved performance over existing score-based filters and ensemble-type Kalman filters, achieving up to a 28.2× wall-clock speedup.
Data-driven spatial filtering algorithms optimize scores such as the contrast between two conditions to extract oscillatory brain signal components. Most machine learning approaches for filter estimation, however, disregard within-trial temporal dynamics and are extremely sensitive to changes in training data and invol…
LOCO-Reg improves CNN accuracy by promoting feature cohesion near filter centers.
problem Current regularization schemes in CNNs violate the principle that weights near the center of a filter are larger than weights on the outside.
method Introduces Locality-Promoting Regularization (LOCO-Reg) to correct this issue.
result LOCO-Reg yields accuracy gains across multiple architectures and datasets.
This paper presents a learning method for convolutional autoencoders (CAEs) for extracting features from images. CAEs can be obtained by utilizing convolutional neural networks to learn an approximation to the identity function in an unsupervised manner. The loss function based on the pixel loss (PL) that is the mean s…
Efficient spatio-temporal Gaussian process inference method.
problem Scalable Gaussian process inference for multivariate, spatio-temporal data.
method Combines spatio-temporal filtering with natural gradient variational inference, resulting in a scalable non-conjugate GP method.
result Linear scaling with respect to time and logarithmic scaling with respect to time steps.
This paper explains a mechanism called phase collapse that improves image classification accuracy.
problem Understanding the role of non-linearities and convolutional filters in image classification.
method Demonstrates phase collapse as a mechanism that eliminates spatial variability and linearly separates classes.
result Phase collapse improves classification accuracy, while thresholding operators degrade performance.
Video sequences contain rich dynamic patterns, such as dynamic texture patterns that exhibit stationarity in the temporal domain, and action patterns that are non-stationary in either spatial or temporal domain. We show that a spatial-temporal generative ConvNet can be used to model and synthesize dynamic patterns. The…
Modified swarm optimizers improve GD initialization for EEG spatial filtering.
problem Gradient Descent fails in complex, multi-scale convexity scenarios.
method Modified Swarm-based Optimizers (ICA and PSO) applied to GD initialization.
result The modified optimizers outperform baseline optimizers in EEG classification and loss function fitness.
Introduces numerical Gaussian process Kalman filtering for infinite-dimensional systems.
problem Kalman filtering on infinite-dimensional systems.
method Embedding numerical Gaussian processes into Kalman filter equations.
result Ability to perform Kalman filtering on infinite-dimensional systems using Gaussian processes.
The wavelet Maximum Entropy on the Mean (wMEM) approach to the MEG inverse problem is revisited and extended to infer brain activity from full space-time data. The resulting dimensionality increase is tackled using a collection of techniques , that includes time and space dimension reduction (using respectively wavelet…
New algorithm speeds up online mapping of unknown terrains.
problem Increasing computational demands of GP mapping as area expands.
method Recursive GP mapping using local basis functions in an information filter.
result Reduces overall computational complexity and speeds up mapping.
Machine learning models perform better with location coordinates alone, not Moran Eigenvectors.
problem Improving machine learning models for spatial data.
method Examined Moran Eigenvectors as additional spatial features in machine learning models using synthetic datasets.
result Machine learning models using only location coordinates achieve better accuracies than eigenvector-based approaches.
EnSF improves accuracy in tracking high-dimensional nonlinear systems.
problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.
We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle …
We describe a model for capturing the statistical structure of local amplitude and local spatial phase in natural images. The model is based on a recently developed, factorized third-order Boltzmann machine that was shown to be effective at capturing higher-order structure in images by modeling dependencies among squar…
DSF improves EEG model robustness to missing channels and noise.
problem Robust learning from corrupted EEG data with missing channels.
method Dynamic Spatial Filtering (DSF) as a multi-head attention module.
result DSF achieves up to 29.4% accuracy improvement over baseline models in noisy conditions.
New filter bank regularization improves DCNNs by incorporating image priors.
problem Improving DCNNs' robustness and generality.
method Structured filter bank regularization of DCNN kernels.
result Filter bank regularization leads to faster convergence and better generalization.
In this paper, we tackle the question of discovering an effective set of spatial filters to solve hyperspectral classification problems. Instead of fixing a priori the filters and their parameters using expert knowledge, we let the model find them within random draws in the (possibly infinite) space of possible filters…
New method improves Kalman filtering and smoothing for large state spaces.
problem High computational cost and uncertainty in large-scale Kalman filtering.
method Probabilistic numerical method leveraging GPU acceleration and tunable trade-off.
result Mitigates scaling issues and provides more accurate uncertainty estimates.
In 2003, Ozsváth and Szabó defined the concordance invariant τ for knots in oriented 3-manifolds as part of the Heegaard Floer homology package. In 2011, Sarkar gave a combinatorial definition of τ for knots in S3 and a combinatorial proof that τ gives a lower bound for the slice genus of a knot. Recently, Har…
Dimensionality reduction (DR) methods have attracted extensive attention to provide discriminative information and reduce the computational burden of the hyperspectral image (HSI) classification. However, the DR methods face many challenges due to limited training samples with high dimensional spectra. To address this …
DISTANA predicts and denoises spatial wave dynamics.
problem Identifying causality in spatially distributed, non-linear dynamical processes.
method Generative, recurrent graph convolution neural network architecture (DISTANA).
result DISTANA outperforms alternative approaches in denoising and predicting complex spatial wave propagation.
MCFNet recovers spatial detail and fuses it with semantic information for real-time segmentation.
problem Recovering spatial detail information and fusing it with semantic information in real-time.
method Proposes a new architecture (MCFNet) with feature refinement and fusion modules, and a gating unit.
result Achieves competitive performance with high speed (75.5% mIOU, 151.3 FPS on Cityscapes).
New algorithm improves sparse-view tomography without needing ground-truth data.
problem Poor image reconstructions with sparse projections and non-uniform sensors.
method Unsupervised deep learning with CNN and STN modules.
result Significantly outperforms filtered backprojection in sparse-view scenarios.
Study uses SAR data to map defoliation and regrowth in tundra-forest areas.
problem Mapping defoliation and regrowth in tundra-forest areas using SAR data.
method Novel guided nonlocal means speckle filtering of polarimetric covariance matrix.
result Over 99.7% classification accuracy in defoliation and regrowth mapping.
GenInSAR uses CNNs to filter InSAR phase and estimate coherence without supervision.
problem Improving accuracy in InSAR phase filtering and coherence estimation.
method Unsupervised CNN-based generative model for joint phase filtering and coherence estimation.
result GenInSAR outperforms five related methods in residue reduction and coherence estimation.
The paper bridges spectral and spatial graph convolutions, improving model capacity and transferability.
problem Improving graph neural networks by bridging spectral and spatial design.
method Theoretical demonstration and general framework for spectral analysis, new spectral convolutions, and depthwise separable convolutions.
result General framework allows spectral analysis of ConvGNNs, showing their performance and limits, and proposing new spectral convolutions.
A new real-time method estimates system matrices and states using Kalman filter.
problem Real-time estimation of system matrices and states using Kalman filter.
method Estimation in an observation space, time-invariant interval, and online learning framework.
result Extraordinary performance in estimating matrices for damped oscillation model.
New equivariant filters improve graph classification.
problem Designing deep learning models for graph symmetries.
method Nonlinear spectral filters (NLSFs) that are equivariant to graph functional shifts.
result NLSFs outperform existing spectral GNNs in graph classification.
Unsupervised beamforming improves ASR in noisy conditions.
problem Improving ASR in unknown noisy environments.
method Multichannel NMF-Informed Beamforming (MVDR) for noise-robust ASR.
result The proposed method outperformed DNN-based beamforming in unknown environments.
Augments GNNs with diversification to preserve node identity.
problem Current GNNs filter node information, potentially losing node identity.
method Integrates diversification operators with aggregation to enrich node representations.
result Significant performance boost on 9 node classification tasks.
Hyperspectral images (HSI) contain a wealth of information over hundreds of contiguous spectral bands, making it possible to classify materials through subtle spectral discrepancies. However, the classification of this rich spectral information is accompanied by the challenges like high dimensionality, singularity, lim…
Real-time ionospheric images created from limited data using parallel Kalman filters.
problem Monitoring ionospheric irregularities using limited spatio-temporal observations.
method Bayesian framework with parallel Kalman filters and connectivity information.
result Real-time ionospheric images with high spatio-temporal resolution can be produced.
DACNN improves skeleton-based action recognition and segmentation.
problem Lack of spatial relationships and non-uniform temporal scalings in skeleton-based data.
method Introduces deep-aligned convolutional neural network (DACNN) with new filters trained on local subsequences.
result DACNN achieves competitive performance compared to state-of-the-art models.
Accurate taxi demand-supply forecasting is a challenging application of ITS (Intelligent Transportation Systems), due to the complex spatial and temporal patterns. We investigate the impact of different spatial partitioning techniques on the prediction performance of an LSTM (Long Short-Term Memory) network, in the con…
New methods detect targets from imprecisely labeled hyperspectral data.
problem Challenges in acquiring labeled hyperspectral data.
method Multi-Target MI-ACE and MI-SMF methods that learn target signatures from imprecisely labeled samples.
result Effective at learning target signatures and performing target detection.
Deep Learning has been shown to learn efficient representations for structured data such as image, text or audio. In this chapter, we present neural network architectures that are able to learn efficient representations of molecules and materials. In particular, the continuous-filter convolutional network SchNet accura…
Central to robot exploration and mapping is the task of persistent localization in environmental fields characterized by spatially correlated measurements. This paper presents a Gaussian process localization (GP-Localize) algorithm that, in contrast to existing works, can exploit the spatially correlated field measurem…