A new exploration method for RL using parameter space noise.
problem Improving exploration in deep reinforcement learning.
method Switching isotropic and directional exploration in parameter space with parameter space noise.
result The proposed method achieves competitive results and better performance in sparse reward environments.
Identifying causal direction in location-scale noise models with hidden variables
problem Causal discovery in location-scale noise models with hidden variables
method ADMGs satisfying a bow-free condition
result First identifiability result for causally insufficient models beyond noise additivity
Study evaluates how noise affects ANMs' ability to identify causal directions.
problem Challenges in identifying causal relationships in bivariate cases with noise.
method Empirical study using Regression with Subsequent Independence Test (RESIT) on various ANM models.
result ANMs can fail to identify true causal directions for certain noise levels.
TRA detects causal direction from bivariate data using geometric shapes.
problem Inferring causal direction from observational data is challenging and unreliable.
method TRA compares rank-based copula-standardized residual clouds to detect causal direction.
result TRA is robust and superior in detecting causal direction across various scenarios.
Noise can affect the overparametrization of QNNs, enabling new directions but also suppressing sensitivity.
problem The overparametrization of QNNs in the presence of noise.
method Analyzing the Quantum Fisher Information Matrix (QFIM) to understand how noise affects the rank of QFIM.
result Noise can turn previously-zero eigenvalues of the QFIM to non-zero, enabling exploration of new directions.
New model identifies causal direction in nonlinear systems with observed data.
problem Identifying causal direction in nonlinear systems with observed data.
method Cascade Nonlinear Additive Noise Model (CNANM) with Variational Auto-Encoder (VAE) estimation.
result Causal direction is identifiable under suitable conditions on data generation.
Alternative to likelihood-based LSNM model selection, residual independence testing is more robust to noise misspecification.
problem Cause-effect inference in location-scale noise models with misspecified noise distributions.
method Residual independence testing as an alternative to likelihood-based model selection.
result Residual independence testing is more robust to noise misspecification.
Novel criterion identifies heteroscedastic noise in causal discovery.
problem Heteroscedastic noise violates equal-variance assumption in causal discovery.
method Skewness-based criterion for identifying HSNMs.
result Skewness-based criterion distinguishes causal from anticausal directions.
The paper explores how symmetries and noise in SGD influence parameter dynamics.
problem Understanding the dynamics of parameter updates in SGD with symmetries.
method Proved the existence of noise equilibria and showed their role in balancing gradient noise.
result Gradient noise creates a systematic motion of parameters to a unique fixed point, called noise equilibria.
New MVG mechanism improves differential privacy for matrix-valued queries.
problem Lack of optimal methods for matrix-valued queries in differential privacy.
method Proposes MVG mechanism using matrix-variate Gaussian noise.
result Proves MVG mechanism preserves (ε,δ)-differential privacy. New damping technique improves deep learning models by reducing noise in flat directions.
problem Improving generalization in deep learning models by reducing estimation noise in flat directions.
method Developed a novel random matrix theory based damping learner to reduce the shrinkage coefficient and improve generalization.
result Significant generalization improvements in logistic regression and deep neural networks experiments.
This work improves structured prediction by learning the balance between signal and random noise.
problem Structured prediction with random perturbations.
method Learning the variance of randomized structured predictors to balance signal and noise.
result Learning the balance improves structured prediction effectiveness.
The paper analyzes how noise geometry influences the performance of SGD in machine learning.
problem Understanding how noise geometry affects the performance of stochastic gradient descent.
method Developed two metrics to quantify noise alignment strength and analyzed their effects on loss and subspace projection dynamics.
result Noise geometry can be used to guarantee alignment under certain conditions, aiding SGD's ability to escape from sharp minima.
This study examines how noise levels affect causal discovery methods.
problem Impact of noise levels on causal discovery methods.
method Empirical study using Regression with Subsequent Independence Test and Identification using Conditional Variances on ANMs with varying noise levels.
result Causal discovery methods can fail for certain noise levels.
New approach for bandits with noise dependent on evaluation points, improving on existing methods.
problem Stochastic bandit problem with heteroscedastic noise.
method Introduces Information Directed Sampling (IDS) and proves high-probability regret bounds.
result New high-probability regret bounds for general policies, including IDS.
A new kernel test reduces noise in MMD by focusing on leading eigen-directions.
problem Noise in trailing directional components degrades power of standard kernel two-sample tests.
method Truncate MMD spectral decomposition, retaining only leading eigen-directions.
result Our method achieves superior power and robustness, especially in high-dimensional and unbalanced settings.
We propose a robust method to estimate heteroscedastic noise models using Student's t-distribution.
problem Identifying cause and effect from bivariate observational data with non-Gaussian noise.
method We propose a novel approach using Student's t-distribution to estimate heteroscedastic noise models, which is more robust and achieves better performance.
result Our estimators are more robust and achieve better overall performance across synthetic and real benchmarks.
M2M tackles zero-shot structured noise suppression in images.
problem Structured noise with strong anisotropic correlations in real-world images.
method M2M introduces a novel sampling strategy that generates pseudo-independent sub-image pairs from a single noisy input, using directional interpolation and generalized median filtering.
result M2M consistently outperforms state-of-the-art zero-shot methods under correlated noise.
New method learns DAGs from noisy data without identifiability assumptions.
problem Learning DAGs from non-identifiable Gaussian models with heteroscedastic noise.
method Mixed-integer programming framework for medium-sized problems.
result Asymptotically optimal solution with early stopping criterion.
Privacy subsidy found in market trading with noisy direction signals.
problem Analyzing welfare and bid-ask spread in a market with privacy mechanisms.
method Closed-form derivation of bid-ask spread and welfare under flip-noise direction observation.
result Privacy subsidy of μηΔ from liquidity pool to traders, robust across models. New algorithm for estimating MLR parameters with non-Gaussian noise.
problem Estimating MLR parameters with non-Gaussian noise.
method Combining ADMM with EM algorithm idea.
result Our method outperforms EM algorithm in non-Gaussian noise case.
Robust sparse reduced rank regression for high-dimensional data with heavy-tailed noise.
problem Analyzing large, complex high-dimensional data with heavy-tailed random noise.
method Convex relaxation of a rank- and sparsity-constrained non-convex optimization problem solved using the alternating direction method of multipliers.
result Established non-asymptotic estimation error bounds under Frobenius and nuclear norms, quantifying the tradeoff between heavy-tailedness and statistical bias.
Researchers analyze SGD dynamics using von Mises-Fisher distributions.
problem Understanding the dynamics of stochastic gradient descent in high-dimensional spaces.
method Geometric analysis of minibatch gradient norms and directions through von Mises-Fisher distribution.
result Directional uniformity of minibatch gradients increases over SGD iterations.
We analyze a family of methods for statistical causal inference from sample under the so-called Additive Noise Model. While most work on the subject has concentrated on establishing the soundness of the Additive Noise Model, the statistical consistency of the resulting inference methods has received little attention. W…
KCS improves parametric maps from PET images by reducing noise and variance.
problem Improving the quality of parametric maps from PET images due to noise.
method Kinetic Compressive Sensing (KCS) method based on a hierarchical Bayesian model and novel reconstruction algorithm.
result KCS produces spatially coherent images and parametric maps with lower noise and better contrast.
AniDS improves molecular force field modeling by learning anisotropic noise.
problem Molecular force field modeling suffers from oversimplified assumptions about atomic motions.
method AniDS introduces anisotropic noise generation for better modeling of directional and structural variability.
result AniDS outperforms existing methods on benchmarks, achieving significant improvements in force prediction accuracy.
CWGD measures gradient diversity weighted by curvature, improving SGD convergence.
problem Gradient noise in high-curvature directions is underestimated by standard methods.
method CWGD weights gradient diversity by the inverse square root of the Hessian.
result CWGD-Cosine reduces optimization error by up to 20% compared to standard cosine annealing.
A new method for identifying causal directions in complex systems.
problem Identifying causal relationships in nonlinear systems with limited data.
method Sequential edge orientation approach using pairwise additive noise model.
result The method can recover true causal DAGs under nonlinear additive noise models.
We propose a method to learn causal response representations through direct effect analysis.
problem Uncovering direct causal effects in complex, multivariate settings.
method Our method bridges conditional independence testing with causal representation learning, formulating an optimisation problem to maximise evidence against conditional independence.
result The largest eigenvalue distribution can be bounded by an F-distribution, providing testable conditional independence. Interpolating label noise makes models vulnerable to adversarial attacks.
problem Adversarial vulnerability of models trained on noisy labels.
method Theoretical analysis of label noise and adversarial risk relationship.
result Uniform label noise induces adversarial risk similar to worst-case poisoning.
We consider structural equation models in which variables can be written as a function of their parents and noise terms, which are assumed to be jointly independent. Corresponding to each structural equation model, there is a directed acyclic graph describing the relationships between the variables. In Gaussian structu…
Efficiently learns linear non-Gaussian DAGs with noisy nodes.
problem Learning DAGs with non-Gaussian noise and diverging number of nodes.
method Proposes a novel method using topological layers for bottom-up reconstruction and consistent parent-child relations.
result Topological layers can be exactly reconstructed and parent-child relations established without faithfulness assumption.
RS-NSGD improves SGD convergence for heavy-tailed noise.
problem Nonconvex optimization with heavy-tailed noise.
method Integrates direction normalization into subspace updates.
result Achieves better oracle complexity than full-dimensional normalized SGD.
SGD noise helps select flat minima by concentrating in sharp directions and being proportional to loss value.
problem Understanding the implicit regularization of SGD and selecting flat minima in over-parameterized models.
method Relating SGD's linear stability to the Frobenius norm of the Hessian and analyzing the alignment property of SGD noise.
result Flat minima are linearly stable for SGD, and their sharpness is bounded independently of model size and sample size.
This letter presents a new spectral-clustering-based approach to the subspace clustering problem. Underpinning the proposed method is a convex program for optimal direction search, which for each data point d finds an optimal direction in the span of the data that has minimum projection on the other data points and non…
Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to the best of our knowledge, all existing theoretical guarantees for it assume that …
We consider the problem of learning causal directed acyclic graphs from an observational joint distribution. One can use these graphs to predict the outcome of interventional experiments, from which data are often not available. We show that if the observational distribution follows a structural equation model with an …
New algorithm learns DGM parameters privately, using dataset-specific noise.
problem Private learning of DGM parameters with graph structure.
method Customizes noise based on dataset and graph structure for utility.
result Our algorithm requires 3x less privacy budget for similar utility.
New guarantees for SGD in non-convex optimization without strict noise bounds.
problem Efficiently escaping saddle points in non-convex optimization.
method Mean-square arguments and relaxed gradient noise variance bounds.
result Gradient descent can efficiently escape saddle points with a more relaxed gradient noise variance bound.
Proposes a DOA estimation method using IVs and DNNs for noise and reverberation reduction.
problem Accuracy of IV-based DOA estimation degrades due to noise and reverberation.
method Combines IV-based DOA estimation with DNNs for denoising and dereverberation.
result Average DOA error of 0.528 degrees, outperforming conventional methods.
Estimates parameters in max-linear Bayesian networks with noise.
problem Causal inference in extreme-value settings with noise parameters.
method Max-plus algebra and logarithm transformation, normal distribution estimation, EM algorithm and quadratic optimization.
result An estimator of a parameter for each edge in a DAG is normally distributed.
New methods learn DAGs from noisy data, adapting to noise levels.
problem Inferring causal relationships from observational data with noise and confounding.
method Reformulate DAG learning as a continuous optimization problem over adjacency matrices, jointly inferring structure and noise levels.
result Improved robustness to heteroscedasticity and distribution shifts.
New method estimates root-directed tree from extreme data.
problem Discovering causality in river networks from extreme flow data.
method Qualitative max-linear Bayesian network approach to estimate bivariate scores and root-directed spanning tree.
result The new estimator is consistent under max-linear Bayesian network model with noise.
Study mini-batch SGD noise and its limits, proving complexity guarantees.
problem Analyzing the noise in mini-batch SGD and its impact on optimization.
method Examined the conditional covariance and diffusion limits of SGD under different sampling designs.
result Proved mean-square upper bounds and Fisher van Trees lower bounds for SGD, linking them to effective dimension and condition number.
RECLAIM discovers causal graphs in cyclic, noisy systems.
problem Discovering causal relationships in cyclic, noisy systems.
method RECLAIM uses EM with residual normalizing flows to handle cycles and noise.
result RECLAIM effectively discovers causal graphs in both synthetic and real-world datasets.
The study analyzes how label noise affects deep learning feature learning.
problem The impact of label noise on deep learning feature learning.
method Theoretical analysis of a two-layer convolutional neural network under noisy label conditions.
result Two key stages identified: signal learning in Stage I and noise memorization in Stage II.
SpecGD mitigates misalignment in phase retrieval models with anisotropic inputs.
problem Misalignment during gradient descent in phase retrieval models with anisotropic inputs.
method Spectral gradient descent modifies gradient updates to preserve directional information and remove spike amplification.
result SpecGD removes spike amplification, leading to stable alignment and accelerated noise contraction.
Theory explains how noise affects learning in linear DAEs.
problem Understanding how noise influences learning in DAEs.
method Developed theory for linear DAEs, derived analytic expressions, verified with simulations and experiments.
result Noise allows DAEs to ignore low variance directions in inputs while reconstructing them.