Deep density methods improve filtering in high-dimensional systems.
problem Nonlinear filtering in high-dimensional systems.
method Two deep density methods based on Feynman-Kac formulas and neural networks.
result Logarithmic deep backward stochastic differential equation filter outperforms classical methods in high dimensions.
A deep learning method solves nonlinear filtering problems efficiently.
problem Nonlinear filtering problem
method Deep splitting method combined with energy-based neural network approximation
result Computational efficiency and performance comparable to Kalman and bootstrap filters
Novel filter uses deep BSDE for nonlinear density approximation.
problem Nonlinear filtering problem.
method Bayesian filter based on deep BSDE and neural networks.
result Theoretical convergence rate confirmed in numerical examples.
Proposes a deep latent factor model for better recommendation systems.
problem Improving collaborative filtering in recommendation systems.
method Introduces a deeper latent factor model using deep learning.
result Significantly outperforms state-of-the-art techniques in experiments.
Advances deep network embedding through multi-filtering GCN.
problem Existing attribute embedding methods fail to capture different aspects of node features.
method Multi-filtering Graph Convolution Neural Network (GCN) framework.
result Significant improvement in link prediction and node classification tasks with limited training data.
NBF combines deep learning with classical filtering for better belief tracking.
problem Maintaining distributions over hidden states in partially observable systems.
method Trains neural networks to map beliefs to fixed-length vectors, updating them with incoming observations and dynamics.
result NBF efficiently tracks shifting, multimodal beliefs without particle impoverishment.
Recursive KalmanNet combines neural networks with Kalman filters for precise state estimation.
problem State estimation in systems with noisy measurements and non-Gaussian noise.
method Recursive KalmanNet uses a recurrent neural network to estimate states with consistent error covariance, optimizing for Gaussian negative log-likelihood.
result Recursive KalmanNet outperforms conventional Kalman filters and deep learning-based estimators in non-Gaussian noise conditions.
New deep learning method approximates Benes filter model.
problem Approximating high-dimensional SPDEs for filtering.
method Deep learning mesh-free neural network representation.
result First study of neural network method for Benes model.
Visualizes deep neural networks for speech recognition using learned topographic filter maps.
problem Unintuitive internal structure of deep neural networks complicates activation visualization.
method Trains a convolutional speech recognition model with filters arranged in a 2D grid, highlighting similar filters.
result Topographic filter maps visualize artificial neuron activations more intuitively.
A new numerical scheme approximates nonlinear filtering densities for noisy and partial measurements.
problem Approximating nonlinear filtering densities for noisy and partial measurements.
method Deep splitting scheme applied to the Fokker--Planck equation followed by Bayes' formula.
result Convergence rate established for the numerical scheme under parabolic Hörmander condition.
We present a filter correlation based model compression approach for deep convolutional neural networks. Our approach iteratively identifies pairs of filters with the largest pairwise correlations and drops one of the filters from each such pair. However, instead of discarding one of the filters from each such pair naï…
Deep learning has the potential to dramatically impact navigation and tracking state estimation problems critical to autonomous vehicles and robotics. Measurement uncertainties in state estimation systems based on Kalman and other Bayes filters are typically assumed to be a fixed covariance matrix. This assumption is r…
Neuron Shapley identifies key neurons in deep networks, improving model accuracy and fairness.
problem Identifying responsible neurons in deep networks for better model performance and fairness.
method Neuron Shapley framework quantifies neuron contributions, accounting for interactions.
result Removing just 30 critical filters can destroy model accuracy, revealing network function.
In an effort to understand the meaning of the intermediate representations captured by deep networks, recent papers have tried to associate specific semantic concepts to individual neural network filter responses, where interesting correlations are often found, largely by focusing on extremal filter responses. In this …
Improved volatility estimation using SV-PF-RNN.
problem Estimating true volatility in the presence of market noise.
method SV-PF-RNN: hybrid neural network and particle filter architecture.
result SV-PF-RNN outperforms basic particle filter.
Develops state-space deep Gaussian processes for irregular signals.
problem Solving deep Gaussian process regression problems for irregular signals/functions.
method Represent DGPs as SDEs, solve using state-space filtering and smoothing methods.
result Rich class of priors compatible with irregular signals/functions.
Develops Bayesian filtering for online learning and related problems.
problem Sequential machine learning challenges, especially non-stationarity, model misspecification, and high dimensionality.
method Modular adaptive framework, provably robust filter, and sequential parameter updates.
result Improved performance in dynamic, high-dimensional, and misspecified models.
Paper proposes a DNN-driven AF framework for improved generalization.
problem Generalization challenge in adaptive filtering.
method Structural embedding of DNN into AF system, using maximum likelihood as implicit cost function.
result Demonstrates improved generalization capability through extensive experiments.
A new method approximates deep neural networks using Kalman Filters.
problem Approximating deep neural networks with limited data.
method Matrix Ensemble Kalman Filter-based multi-arm ANN (MEnKF-ANN).
result MEnKF-ANN can adequately approximate LSTM networks and provide uncertainty estimates.
A new method prunes deep networks in one go without specifying pruning levels.
problem Deep model compression to reduce model size and inference time.
method Learning a pruner network to identify and prune unnecessary filters from a pre-trained network.
result Pruned networks achieve comparable performance to unpruned ones, with significant reduction in model size.
Transformers can solve complex filtering problems for non-Gaussian signals.
problem Non-linear and non-Markovian filtering problems for conditionally Gaussian signals.
method Continuous-time transformer models called filterformers.
result Filterformers can approximate the conditional law of non-Markovian and conditionally Gaussian signal processes.
Regularization techniques are widely used to improve the generality, robustness, and efficiency of deep convolutional neural networks (DCNNs). In this paper, we propose a novel approach of regulating DCNN convolutional kernels by a structured filter bank. Comparing with the existing regularization methods, such as $\el…
ED-Filter improves eating disorder classification on Twitter.
problem High dimensionality and extensive feature sets in Twitter data for ED classification.
method Informed branch and bound search technique with hybrid greedy-based deep learning.
result Significant improvements in classification accuracy and efficiency.
Explicit encoding of group actions in deep features makes it possible for convolutional neural networks (CNNs) to handle global deformations of images, which is critical to success in many vision tasks. This paper proposes to decompose the convolutional filters over joint steerable bases across the space and the group …
CG-EnKF and NS-EnKF outperform deep learning-based SF in data assimilation.
problem Data assimilation with non-linear perturbations.
method Two non-linear extensions of EnKF: CG-EnKF and NS-EnKF.
result CG-EnKF and NS-EnKF outperform SF in high-dimensional multiscale data assimilation.
Deep learning improves chaotic dynamics filtering without ensemble.
problem Discovering efficient DA schemes for chaotic dynamics.
method Residual Convolutional Neural Network for the analysis step.
result Deep learning achieves ensemble filtering accuracy without an ensemble.
Method uses deep learning to estimate traffic intensity.
problem Estimating stochastic intensity of traffic processes.
method Deep neural networks for nonlinear filtering.
result Deep learning method accurately estimates traffic intensity.
Deep learning explained through spectral filtering of hierarchical features.
problem Understanding how deep neural networks learn useful representations from data.
method Neural Low-Degree Filtering (Neural LoFi) as a stylized limit of gradient-based training.
result Predicts how representations are selected layer by layer and explains emergence of concepts.
Improved product recommendations using deep learning.
problem Sparse customer purchasing data for personalized recommendations.
method Deep Collaborative Filtering (NCF) with latent variables and Bayesian Optimization.
result NCF achieved highest NDCG performance on proprietary dataset.
Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods of uncertainty propagation for DNNs while lowering the computational overhead con…
Deep filtering improves robustness of models from noisy, sparse data.
problem Challenges in understanding microscopic interactions from noisy, sparse, and biased data.
method Statistical approach based on deep filtering of nonlinear feature networks.
result Physicochemical models are more robust, transparent, and generalize better.
CPOT prunes deep networks by identifying redundant filters using optimal transport.
problem Redundant filters in deep neural networks make models hard to deploy on resource-limited platforms.
method CPOT uses optimal transport to find the mean of channel distributions, pruning redundant information.
result CPOT outperforms state-of-the-art methods in pruning ResNet models and image-to-image translation tasks.
Proposes a deep hybrid model for better recommendation systems.
problem Limited studies on hybrid recommender systems and the need for more advanced approaches.
method Integrates deep learning with ID embeddings and auxiliary features for improved recommendation.
result Improves recommendation results over deep learning models using ID embeddings.
In this paper, we consider recommender systems with side information in the form of graphs. Existing collaborative filtering algorithms mainly utilize only immediate neighborhood information and have a hard time taking advantage of deeper neighborhoods beyond 1-2 hops. The main caveat of exploiting deeper graph informa…
We present a novel method of compression of deep Convolutional Neural Networks (CNNs) by weight sharing through a new representation of convolutional filters. The proposed method reduces the number of parameters of each convolutional layer by learning a 1D vector termed Filter Summary (FS). The convolutional filters ar…
Paper proposes knockoff-based methods to simplify deep neural networks by controlling false discovery rates.
problem High-dimensional deep neural networks with many irrelevant parameters and inputs.
method Knockoff methods combined with regularized neural networks for variable screening.
result Proposed algorithms show satisfactory performance in controlling false discovery rates.
We introduce the variational filtering EM algorithm, a simple, general-purpose method for performing variational inference in dynamical latent variable models using information from only past and present variables, i.e. filtering. The algorithm is derived from the variational objective in the filtering setting and cons…
Filter banks are a popular tool for the analysis of piecewise smooth signals such as natural images. Motivated by the empirically observed properties of scale and detail coefficients of images in the wavelet domain, we propose a hierarchical deep generative model of piecewise smooth signals that is a recursion across s…
Extends RDS filtering to position-orientation space for better image processing.
problem Enhancing and inpainting images with crossing structures.
method Created a version of RDS filtering using gauge frames, studying generalised diffusion.
result RDS filtering on position-orientation space improves denoising and inpainting of crossing structures.
The redundancy is widely recognized in Convolutional Neural Networks (CNNs), which enables to remove unimportant filters from convolutional layers so as to slim the network with acceptable performance drop. Inspired by the linear and combinational properties of convolution, we seek to make some filters increasingly clo…
DeepUnHide uses deep learning to reveal hidden demographic features in recommender systems.
problem Extracting hidden demographic features from recommender systems factors.
method Gradient-based localization in deep learning for feature extraction.
result DeepUnHide outperforms state-of-the-art feature selection methods.
We consider time-domain digital backpropagation with chromatic dispersion filters jointly optimized and quantized using machine-learning techniques. Compared to the baseline implementations, we show improved BER performance and >40% power dissipation reductions in 28-nm CMOS.
Filtering is a general name for inferring the states of a dynamical system given observations. The most common filtering approach is Gaussian Filtering (GF) where the distribution of the inferred states is a Gaussian whose mean is an affine function of the observations. There are two restrictions in this model: Gaussia…
Holistic Filter Pruning reduces DNN complexity efficiently.
problem Redundant parameters in deep neural networks.
method Holistic Filter Pruning (HFP) for efficient DNN training.
result Achieves state-of-the-art performance with 60% reduction in multiplications on ImageNet.
Deep learning improves GW signal detection efficiency and robustness.
problem Traditional matched-filtering techniques are limited in detecting new GW signals.
method Optimized CNN models with techniques like batch normalization and dropout.
result CNN models are robust to the variation of GW waveform parameters.
State of the art music recommender systems mainly rely on either matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict the next user interaction by learning from temporal sequences of user actions. D…
An important problem in fiber-optic communications is to invert the nonlinear Schrödinger equation in real time to reverse the deterministic effects of the channel. Interestingly, the popular split-step Fourier method (SSFM) leads to a computation graph that is reminiscent of a deep neural network. This observation all…
Deep neural networks with convolutional layers usually process the entire spectrogram of an audio signal with the same time-frequency resolutions, number of filters, and dimensionality reduction scale. According to the constant-Q transform, good features can be extracted from audio signals if the low frequency bands ar…