Pruning CNNs by removing less important filters based on empirical loss changes.
problem Reducing memory and computation requirements for CNNs on resource-limited devices.
method Developed a novel filter importance norm based on empirical loss changes, and used sampling and ranking to prune filters.
result Reduced 60% of parameters and 64% of FLOPs with less than 0.6% accuracy drop.
Prunes CNNs by removing redundant filters with provable guarantees.
problem Redundant filters in over-parameterized neural networks.
method Sampling-based approach using saliency scores and importance sampling.
result Consistently generates sparser and more efficient models.
AOFP prunes CNN filters faster and more accurately.
problem Finding optimal CNN width and pruning filters efficiently.
method Binary search, random masking, multi-path framework.
result AOFP achieves faster pruning with minimal accuracy loss.
Neuron Shapley identifies key neurons in deep networks, improving model accuracy and fairness.
problem Identifying responsible neurons in deep networks for better model performance and fairness.
method Neuron Shapley framework quantifies neuron contributions, accounting for interactions.
result Removing just 30 critical filters can destroy model accuracy, revealing network function.
The redundancy is widely recognized in Convolutional Neural Networks (CNNs), which enables to remove unimportant filters from convolutional layers so as to slim the network with acceptable performance drop. Inspired by the linear and combinational properties of convolution, we seek to make some filters increasingly clo…
Removing or filtering outliers and mislabeled instances prior to training a learning algorithm has been shown to increase classification accuracy. A popular approach for handling outliers and mislabeled instances is to remove any instance that is misclassified by a learning algorithm. However, an examination of which l…
A filter detects and removes noisy labels in semi-supervised learning.
problem Label noise in semi-supervised learning reduces classifier accuracy.
method LGC_LVOF: leave-one-out filtering based on LGC algorithm.
result LGC_LVOF detects and removes noisy labels, improving SSL classifier performance.
A Bloom filter approach combined with Transformer models improves accuracy for machine learning tasks on opaque IDs.
problem Improving accuracy for machine learning tasks on opaque IDs with large vocabulary sizes.
method Applying hash functions to map opaque IDs to multiple hash tokens, similar to a Bloom filter, and using a multi-layer Transformer to process these digests.
result Models outperform those without hashing and sampled softmax, achieving high accuracy with a smaller computational budget.
QFIL improves offline RL by filtering data to reduce bias and variance.
problem Improving offline reinforcement learning policies with limited data.
method QFIL uses a filtered dataset to improve policies, trading off bias and variance through quantile selection.
result QFIL provides a safe policy improvement step with function approximation and effectively balances bias and variance.
Self-organized criticality has been claimed to play an important role in many natural and social systems. In the present work we empirically investigate the relevance of this theory to stock-market dynamics. Avalanches in stock-market indices are identified using a multi-scale wavelet-filtering analysis designed to rem…
A method estimates and prunes neural network filters to reduce computation and improve accuracy.
problem Reduction of neural network parameters to save computation and energy.
method Estimates each neuron's contribution to loss using first and second-order Taylor expansions; iteratively removes less important neurons.
result High (>93%) correlation between estimated and true importance; 40% FLOPS reduction with 0.02% top-1 accuracy loss.
Simple k-NN filtering improves model accuracy on noisy labels.
problem Training models with noisy labels reduces performance and is hard to identify.
method A simple k-nearest neighbor-based filtering approach on the logit layer. result Improves model accuracy compared to recent methods.
Study assesses deep neural networks' robustness in mammogram images.
problem Understanding deep neural networks' robustness in mammogram images for breast cancer screening.
method Measuring sensitivity to four perturbations and analyzing low-pass filtering effects.
result Mammogram image classifiers are sensitive to perturbations similar to natural images, but low-pass filtering degrades clinically meaningful features.
The study reveals flaws in pruning criteria and proposes a new assumption for better filter selection.
problem Flaws in existing pruning criteria for CNNs.
method Empirical experiments and Convolutional Weight Distribution Assumption.
result The Convolutional Weight Distribution Assumption improves filter selection in pruning.
Have you ever felt miserable because of a sudden whipsaw in the price that triggered an unfortunate trade? In an attempt to remove this noise, technical analysts have used various types of moving averages (simple, exponential, adaptive one or using Nyquist criterion). These tools may have performed decently but we show…
SELF filters noisy labels to improve deep learning performance.
problem Overfitting to noisy labels in deep learning.
method Self-ensemble label filtering (SELF) using running averages of predictions.
result SELF improves task performance by filtering noisy labels dynamically.
Paper explores unsupervised learning for ultrasound image artifact removal.
problem Improving visual quality of ultrasound images from various artifacts.
method Inspired by optimal transport cycleGAN, unsupervised deep learning for artifact removal.
result Unsupervised learning method provides comparable results to supervised learning.
A new method suppresses echo more effectively with lower latency.
problem Echo cannot be fully removed by linear filters due to nonlinear relationships.
method Uses a modified Conv-TasNet with multiple streams of input signals.
result Efficacy validated in both single-talk and double-talk situations.
Boosted HP filter improves trend estimation in economic data.
problem Inadequate HP filter settings for trend estimation in economic data.
method Iterating the HP smoother to improve trend estimation and eliminate trends.
result Asymptotic recovery of trend mechanisms involving unit root processes and polynomial drifts.
GenInSAR uses CNNs to filter InSAR phase and estimate coherence without supervision.
problem Improving accuracy in InSAR phase filtering and coherence estimation.
method Unsupervised CNN-based generative model for joint phase filtering and coherence estimation.
result GenInSAR outperforms five related methods in residue reduction and coherence estimation.
Robust ASR model removes fast-changing features to resist attacks.
problem Vulnerability of ASR systems to adversarial attacks.
method Removing fast-changing features using slow feature analysis or low-pass filtering.
result Hybrid ASR models are more than four times more robust against targeted attacks.
Paper presents a fast and adaptive filter for SI suppression in full-duplex transceivers.
problem Self-interference suppression in full-duplex transceivers with nonlinearity.
method Adaptive projected subgradient method (APSM) in a reproducing kernel Hilbert space (RKHS).
result The proposed method achieves favorable digital SIC performance compared to benchmarks.
Proposes a method to repair arbitrage in option prices data.
problem Arbitrage in option price data can lead to poor performance or failure of financial applications.
method Formulates data repair as a linear programming (LP) problem to minimise price changes within bid and ask price bounds.
result The proposed method gives sparse perturbations on data and improves model calibration with enhanced robustness and reduced calibration error.
A new feature selection method using random forest and Kolmogorov filter.
problem Ultra-high dimensional data feature selection.
method Fused Kolmogorov filter with random forest based recursive feature elimination.
result Selection and L2 consistency under weak conditions. Several algorithms have been proposed to filter information on a complete graph of correlations across stocks to build a stock-correlation network. Among them the planar maximally filtered graph (PMFG) algorithm uses 3n−6 edges to build a graph whose features include a high frequency of small cliques and a good clust…
GCN improved for large graphs with LCF to reduce complexity and noise.
problem Efficiency and effectiveness of graph convolution in large graphs.
method Proposed Low-pass Collaborative Filter (LCF) to simplify graph convolution.
result Significant improvement in effectiveness and efficiency of GCN.
Improved change point detection using matched filters for non-parametric tests.
problem False positives and localization ambiguity in non-parametric two-sample tests.
method Derived and applied matched filters for various two-sample tests.
result Matched filters reduce false positives and improve test precision.
A new method for joint noise removal and trend estimation from sparse signals.
problem Jointly removing noise and estimating trends from sparse signals.
method PENDANTSS combines SOOT/SPOQ penalties with BEADS algorithm in a Trust-Region block alternating variable metric forward-backward approach.
result Outperforms comparable methods in deconvolving analytical chemistry signals.
The quality of an induced model by a learning algorithm is dependent on the quality of the training data and the hyper-parameters supplied to the learning algorithm. Prior work has shown that improving the quality of the training data (i.e., by removing low quality instances) or tuning the learning algorithm hyper-para…
A Fourier transform approach optimizes clustering algorithms.
problem Optimizing clustering algorithms for accuracy and reliability.
method Fourier transform and Gaussian filtering to smooth density functions, detecting peaks as cluster centroids.
result Remarkable accuracy in finding cluster centroids, overcoming initialization problems.
Optimizes portfolio with two controls to minimize trades and maintain signal integrity.
problem Optimizing a single-asset portfolio with transaction costs and signal autocorrelation.
method Formulated an optimization problem to minimize trades while maintaining signal integrity and achieving maximum return.
result Locally optimal solution minimizes trades and achieves maximum return, with a quantifiable improvement based on threshold and autocorrelation removed.
Network deconvolution removes redundant data to improve neural network performance.
problem Redundant data in neural networks makes training challenging.
method Network deconvolution optimally removes pixel-wise and channel-wise correlations before each layer.
result Network deconvolution improves performance across various datasets.
Improved drug-protein interaction prediction using FTL method.
problem Predicting drug-protein interactions from noisy data with uncertain labels.
method Filtered Transfer Learning (FTL) method that fine-tunes a deep neural network across multiple tiers of data confidence.
result FTL method outperforms deep neural networks trained on single confidence ranges.
This paper deals with a new filter algorithm for selecting the smallest subset of features carrying all the information content of a data set (i.e. for removing redundant features). It is an advanced version of the fractal dimension reduction technique, and it relies on the recently introduced Morisita estimator of Int…
In this study we consider relations between companies in Poland taking into account common branches they belong to. It is clear that companies belonging to the same branch compete for similar customers, so the market induces correlations between them. On the other hand two branches can be related by companies acting in…
A model-free framework extracts risk-neutral densities from short-dated options.
problem Arbitrage and bid-ask spread issues in short-dated options.
method Develops ARIES for filtering static arbitrage and SEDEx for density extraction.
result Robust density extraction across various market conditions and volatility smiles construction.
New method proves cosmetic surgery conjecture for certain knots.
problem Proving the cosmetic surgery conjecture for specific knots.
method Using filtered instanton homology and Chern-Simons filtration.
result Reduced the conjecture to surgeries of ±2 on genus 2 knots. Plants monitor their surrounding environment and control their physiological functions by producing an electrical response. We recorded electrical signals from different plants by exposing them to Sodium Chloride (NaCl), Ozone (O3) and Sulfuric Acid (H2SO4) under laboratory conditions. After applying pre-processing tec…
Proposes a new deep learning framework for financial stock trading.
problem Lack of effective techniques to fuse multi-channel financial time-series data.
method Inspired by convolution transform learning, SDCF processes channels through 1-D convolutions, fuses outputs with fully-connected layers, and applies softmax classification.
result Proposed framework yields better results than state-of-the-art techniques for stock trading.
Paper proposes new pruning techniques to significantly reduce DNN weights and improve model compression.
problem High computation and memory storage challenges in deep learning networks.
method Combines filter and column pruning with ADMM algorithm and introduces Network Purification and Unused Path Removal (P-RM) for post-processing.
result Achieved up to 60x compression on ResNet-18 CIFAR-10, demonstrating effectiveness of proposed methods.
Automatic conflict detection has grown in relevance with the advent of body-worn technology, but existing metrics such as turn-taking and overlap are poor indicators of conflict in police-public interactions. Moreover, standard techniques to compute them fall short when applied to such diversified and noisy contexts. W…
BlurNet defends against adversarial attacks by filtering feature maps.
problem Adversarial attacks on deep neural networks, especially for image classification.
method BlurNet introduces a depthwise convolution layer with standard blur kernels after the first layer to filter high frequency noise.
result The defense reduces the success rate of adversarial attacks from 90% to 20% with total variation regularization.
Enhanced conformal methods improve validity of LLM outputs.
problem Lack of conditional validity and high false rejection rates in LLM validity guarantees.
method Adaptive conditional conformal procedure and improved scoring function differentiation.
result Demonstrated improved validity and utility on real datasets.
Gaussian processes provide a flexible framework for forecasting, removing noise, and interpreting long temporal datasets. State space modelling (Kalman filtering) enables these non-parametric models to be deployed on long datasets by reducing the complexity to linear in the number of data points. The complexity is stil…
We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse parameters with sub-linear sample complexity, in the presence of a constant fractio…
Optimized fuzzy entropy framework improves feature selection and classification performance.
problem Improving feature selection and classification in fuzzy entropy frameworks.
method Implemented and compared combinations of ideal vectors, maximal similarity classifiers, and fuzzy entropy functions.
result Optimized combination of ideal vector, similarity classifier, and fuzzy entropy function achieved the most stable performance for all three datasets.
A new method routes EEG covariance matrices across domains using adaptive subspace selection.
problem Challenges in cross-domain EEG decoding due to distinct SPD manifold regions.
method Dynamic Stiefel routing with expert filters and cross-attention for adaptive subspace projection.
result Consistent gains across three datasets: balanced accuracy improves from 0.773 to 0.823, 0.757 to 0.809, and 0.801 to 0.839.
New method estimates mean from noisy data with few outliers.
problem Estimate mean from noisy data with few outliers.
method Iterative multi-filtering approach.
result Achieves near-optimal error with practical efficiency.