Method introduces topological regularization using information filtering networks.
problem Sparse probabilistic modeling and multicollinear regression.
method Topological regularization via information filtering network.
result Direct application to L0-norm regularized problems. BankGCN improves graph convolution networks by handling multi-channel signals with adaptive filter banks.
problem Handling multi-channel graph signals with limited architectures.
method BankGCN decomposes multi-channel signals into subspaces and uses adapted filters for each subspace.
result BankGCN achieves excellent performance in graph classification on benchmark datasets.
BSF algorithm reduces neural network size and selects features efficiently.
problem Neural network size and feature selection optimization.
method Binary Stochastic Filtering (BSF) layer that penalizes information, stochastically passes or drops features.
result Multifold decrease in neural network size and optimal feature selection.
A new neural network separates singing voices more effectively.
problem Separating singing voices from mixed signals with high accuracy.
method MBR-FCN that processes different frequency bands with varying resolutions and filters.
result The MBR-FCN achieves better performance with fewer parameters.
A new algorithm PD improves stock-correlation network clustering and robustness.
problem Improving clustering and robustness of stock-correlation networks.
method Proposes a new proportional degree algorithm to filter information on a complete graph of normalised mutual information.
result The PD algorithm produces a network with better homogeneity and robustness compared to PMFG.
Prunes CNNs by removing redundant filters with provable guarantees.
problem Redundant filters in over-parameterized neural networks.
method Sampling-based approach using saliency scores and importance sampling.
result Consistently generates sparser and more efficient models.
New training algorithm enhances SNNs for temporal signal processing.
problem Lack of robust training algorithms for large-scale SNNs.
method Formulated SNN as IIR filters, proposed training algorithm for optimal synapse filter kernels and weights.
result Model and training algorithm outperform state-of-the-art approaches in accuracy.
This work ranks CNN filters based on their importance.
problem Unclear role of CNN neurons in producing output.
method Two methods: Shapley value game theory and Importance switch variational inference.
result Filters with higher importance are more crucial for output.
KalmanNet uses neural networks to improve state estimation in systems with unknown dynamics.
problem State estimation of systems with non-linear dynamics and partial information.
method KalmanNet integrates a recurrent neural network with the Kalman filter to handle non-linearities and model mismatches.
result KalmanNet outperforms classic filtering methods in systems with both mismatched and accurate domain knowledge.
HKF uses neural networks to adapt Kalman filters for dynamic channel tracking.
problem Tracking channels with varying dynamics and Doppler values.
method Combines Kalman filters with hypernetworks for dynamic adaptation.
result HKF achieves up to 2dB gain over Kalman filters at high Doppler values.
Paper compares semi-supervised training for differentiable particle filters.
problem Lack of labelled data in real-world applications.
method Compares two semi-supervised training objectives.
result Improved performance in environments with scarce labelled data.
Paper introduces context-sensitive filters for better text processing.
problem Static filters limit NLP performance; need dynamic context.
method Meta network learns context-aware filters for sentences.
result Context-sensitive filters improve NLP tasks.
Recursive KalmanNet combines neural networks with Kalman filters for precise state estimation.
problem State estimation in systems with noisy measurements and non-Gaussian noise.
method Recursive KalmanNet uses a recurrent neural network to estimate states with consistent error covariance, optimizing for Gaussian negative log-likelihood.
result Recursive KalmanNet outperforms conventional Kalman filters and deep learning-based estimators in non-Gaussian noise conditions.
Collaborative filtering is used to recommend items to a user without requiring a knowledge of the item itself and tends to outperform other techniques. However, collaborative filtering suffers from the cold-start problem, which occurs when an item has not yet been rated or a user has not rated any items. Incorporating …
EnSF improves accuracy in tracking high-dimensional nonlinear systems.
problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.
A new hybrid GNN framework tackles oversmoothing in graph data.
problem Oversmoothing in graph convolutional networks limits their expressive power and generalization.
method Combines traditional GCN filters with band-pass filters defined via geometric scattering and introduces an attention framework.
result Improves expressive power and generalization of graph convolutional networks.
Proposes a Kalman Filter modifier to improve neural network performance in changing environments.
problem Maintaining performance of neural networks in non-stationary environments.
method Kalman Filter based modifier to adapt to changes.
result The proposed model adapts better to changes with a 0.4% accuracy drop compared to 90% for conventional models.
I-AID categorizes disaster tweets into useful information types.
problem Filtering useful information from social media during disasters.
method Multimodel approach using BERT, GAT, and Relation Network.
result I-AID outperforms state-of-the-art approaches in F1 scores.
Proposes a GNN for multivariate time-series prediction with filtering.
problem Low signal-to-noise ratio in complex systems data.
method Integrates a spatial-temporal GNN with a matrix filtering module to generate filtered graphs.
result Proposed model outperforms baseline approaches in multivariate time-series prediction.
HLOB predicts mid-price changes in L.O.Bs using deep learning.
problem Forecasting mid-price changes in Limit Order Books.
method HLOB uses a deep learning model with an Information Filtering Network and Homological Convolutional Neural Networks.
result HLOB outperforms state-of-the-art models in real-world datasets.
Improved method using filtered PDEs for robust physics-informed deep learning.
problem Complex real-world problems with noisy and sparse data.
method Proposed a surrogate constraint (FPDE) to filter and reduce the influence of noisy and sparse observation data.
result FPDE models converge better and produce higher quality solutions with less data.
We generate transformation-invariant CNNs using context-aware filters.
problem Creating transformation-invariant neural networks for image recognition.
method Input-conditioned convolution filters combined with max-pooling and multi-instance learning.
result Significantly improved error rates on MNIST variations (1.13% on MNIST-rot-12k, 1.12% on Half-rotated MNIST, 0.68% on Scaling MNIST).
Stable algebraic filters improve neural network performance.
problem Improving neural network stability to deformations.
method Analyzed stability of algebraic filters and neural networks under deformations of the homomorphism.
result Stable algebraic filters have frequency responses whose derivative is inversely proportional to frequency.
The paper develops a computational method for efficient online filtering of diffusion processes.
problem Online filtering of discretely observed nonlinear diffusion processes.
method The approach involves Doob's h-transforms approximated by solving backward Kolmogorov equations using nonlinear Feynman-Kac formulas and neural networks. result The proposed method can be orders of magnitude more efficient than state-of-the-art particle filters.
ScDCFNet improves multiscale image classification with reduced model size.
problem Improving performance in multiscale image classification.
method Decomposed convolutional filters for ST-equivariant CNNs.
result ScDCFNet achieves significantly improved performance in multiscale image classification.
Compression method reduces model size while maintaining accuracy.
problem Deep neural networks are large and resource-intensive.
method Iteratively drops correlated filters, re-optimizes, and finetunes.
result State-of-the-art FLOPs compression rates with excellent predictive performance.
The paper analyzes deep neural networks using information theory to improve classification accuracy.
problem Improving classification accuracy in deep neural networks.
method Modeling the output of convolutional filters as a random variable conditioned on class and network structure, computing conditional entropy as a compact code.
result The conditional entropy feature analysis leads to higher classification accuracy than the original CNN.
Improved collaborative filtering with neural network models of reviews.
problem Improve collaborative filtering performance using side information from reviews.
method Introduced two neural network models (product-of-experts and recurrent neural network) to incorporate reviews into collaborative filtering.
result The product-of-experts model achieved state-of-the-art performance, outperforming LDA-based approach.
Graph neural networks are found to be primarily low-pass filters, not manifold learners.
problem Improving performance and scalability of graph neural networks for graph-structured data.
method Developed a theoretical framework based on graph signal processing.
result Graph neural networks only perform low-pass filtering on feature vectors and do not have non-linear manifold learning property.
Generative adversarial networks improve speech synthesis from MFCCs.
problem Synthesizing speech from MFCCs, which are typically unusable for synthesis.
method Predict fundamental frequency and voicing from MFCCs, convert spectral envelope to filters, train excitation model, add noise.
result High quality speech can be reconstructed from MFCCs alone.
Improved particle filters enhance vehicle tracking accuracy.
problem Particle filters struggle with frequent, informative observations.
method Proposes particle filters that sample around recent observations.
result Significant improvement in accuracy and efficiency.
WaveletGAN improves GANs by homogenizing noise through multi-channel wavelet filtering.
problem Current noise generation models in GANs struggle with homogenizing noise, leading to low-fidelity samples.
method Proposes a multi-channel wavelet-based filtering method to homogenize noise in GANs.
result WaveletGAN generates high-fidelity samples with the smallest FIDs on Fashion-MNIST, KMNIST, and SVHN datasets.
The paper proposes a method to detect and filter noisy or mislabeled data using pointwise mutual information.
problem Detecting and filtering noisy or mislabeled data in deep learning models.
method A mutual information-based framework quantifying statistical dependencies between inputs and labels.
result The method effectively filters low-quality samples, improving classification accuracy by up to 15%.
Joint sensing and communication network improves target localization and reduces communication load.
problem Efficiently localize multiple targets with reduced communication overhead.
method Multi-base station cooperative sensing with AI-aided clustering and tracking.
result Optimal sub-pattern assignment (OSPA) error less than 60 cm with reduced communication capacity.
A new model predicts dynamic O-D matrices using graph neural networks and Kalman filters.
problem Predicting dynamic O-D demand matrices from traffic flow data.
method Combines graph neural networks and Kalman filters to recognize spatial and temporal patterns.
result The proposed model outperforms other methods in various prediction scenarios.
VAEs improve collaborative filtering for implicit feedback.
problem Limited modeling capacity of linear factor models in collaborative filtering.
method Introduced a generative model with multinomial likelihood and used Bayesian inference for parameter estimation.
result Significantly outperforms state-of-the-art baselines on real-world datasets.
PSRNNs combine RNN and PSR insights for system filtering and prediction.
problem Modeling dynamical systems efficiently and accurately.
method Combines insights from RNNs and PSRs using bilinear transfer functions and tensor decomposition.
result PSRNNs outperform other models in filtering and prediction tasks across multiple datasets.
Paper simplifies CNNs for irregular data using MIMO graph filters.
problem Challenges in applying CNNs to irregularly structured data.
method Introduces MIMO graph filters to CNNs, simplifying architectures.
result Proposed architectures reduce model complexity and computational cost.
The paper uses NMF to detect political communities in Twitter networks.
problem Detecting pure political communities in Twitter networks.
method Developed three NMF frameworks to analyze user connectivity and content.
result User content and endorsement filtered connectivity are complementary.
Introduces a neural network-based method for efficient state and parameter estimation in complex systems.
problem Efficiently estimating state paths and parameters from noisy measurements in high-dimensional nonlinear systems.
method Bayesian Information Field Theory with neural network parameterization and optimization algorithms.
result Proposes a method to simplify and enrich state path parameterizations using neural networks, improving inference accuracy.
Graph DNA uses Bloom filters to efficiently encode deep graph neighborhoods for better collaborative filtering.
problem Collaborative filtering struggles with exploiting deeper graph neighborhoods due to high time and space complexity.
method Graph DNA employs Bloom filters to compute approximate deep neighborhood information in linear time, enabling efficient encoding and utilization in collaborative filtering.
result Graph DNA significantly improves collaborative filtering performance with minimal computational and memory overhead.
GNNs generalize CNNs for graph data, showing equivariance and stability.
problem Processing signals on graphs.
method Graph convolutional filters, nonlinearities, stacked layers.
result GNNs converge to graphon neural networks under graph convergence.
Efficiently models financial data with parsimonious sparse structures.
problem Estimating sparse inverse covariance matrices for financial data.
method Information Filtering Networks for local and parallelizable computations.
result Computational efficiency and robustness in sparse inference.
Study assesses deep neural networks' robustness in mammogram images.
problem Understanding deep neural networks' robustness in mammogram images for breast cancer screening.
method Measuring sensitivity to four perturbations and analyzing low-pass filtering effects.
result Mammogram image classifiers are sensitive to perturbations similar to natural images, but low-pass filtering degrades clinically meaningful features.
The paper examines FDL and SF algorithms using information bottleneck theory.
problem Understanding the behavior of FDL algorithms using information-theoretic terms.
method Formalization of FDL in information-theoretic terms, using information planes to analyze SF algorithm.
result Empirical support for the conjecture about the dynamics of FDL.
Neural network Kalman filtering improves 3D ultrasound object tracking.
problem Accurate and robust 3D positional estimation from 2D ultrasound data.
method Neural network training for out-of-plane offset estimation, combined with Kalman filtering.
result Mean error of 0.1mm for simulated data, 0.2mm for experimental data.
Augments GNNs with diversification to preserve node identity.
problem Current GNNs filter node information, potentially losing node identity.
method Integrates diversification operators with aggregation to enrich node representations.
result Significant performance boost on 9 node classification tasks.
Enhances SBM with continuous attributes for better network analysis.
problem Community detection in networks with multiple continuous attributes.
method Augmented stochastic block model with multivariate Gaussian parameters.
result Satisfactory performance in link prediction and collaborative filtering tasks.