Paper analyzes bias-variance tradeoff in graph Laplacian regularization.
problem Understanding the optimal regularization parameter for graph Laplacian.
method Spectral graph properties and signal-to-noise ratio parameter used to determine optimal regularization.
result Selecting mediocre regularization is often suboptimal, suggesting near-optimal performance.
Improves diffusion models by controlling total variance and signal-to-noise-ratio.
problem Long sampling time in diffusion models.
method Total-Variance/Signal-to-Noise-Ratio (TV/SNR) disentangled framework.
result Improves generation performance by controlling TV and SNR independently.
This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over input dependent noise variance (heteroscedasticity) and input dependent signal varia…
New methods incorporate alpha signals into portfolio construction, improving performance.
problem Signal-blindness in existing portfolio construction methods.
method Introduces three methods: HRP- μ \mu μ , HRP- Σ μ \Sigma\mu Σ μ , and CRISP. result CRISP at intermediate γ \gamma γ consistently outperforms other methods. GRRT recovers sparse signals without prior sparsity or noise variance knowledge.
problem Recovering sparse signals without prior sparsity or noise variance knowledge.
method Generalized residual ratio thresholding (GRRT) for SOMP and BOMP.
result Finite sample and finite SNR guarantees for exact support recovery.
We propose a Bayesian expectation-maximization (EM) algorithm for reconstructing Markov-tree sparse signals via belief propagation. The measurements follow an underdetermined linear model where the regression-coefficient vector is the sum of an unknown approximately sparse signal and a zero-mean white Gaussian noise wi…
Optimal treatment assignment reduces demand response signal variance.
problem Accurately estimating demand response impact with limited signals and covariates.
method Formulated as a multivariate linear model, used randomized assignment and a strategic algorithm.
result Strategic assignment achieves optimal variance reduction, independent of covariates.
Gaussian processes over graphs enforce specific signal profiles and outperform conventional GPs.
problem Signal processing over graphs with specific profiles.
method Graph Laplacian regularization to enforce desired signal profiles, proving predictive variance advantage.
result Gaussian processes over graphs have strictly smaller predictive variance than conventional GPs.
A new method for time series analysis that highlights important signals.
problem Finding signals that matter most in time series data.
method Contrastive Multivariate Singular Spectrum Analysis (CMSA) using a background dataset.
result CMSA identifies signals that are more relevant to the analyst than those with the highest variance.
Paper proposes a self-supervised method to denoise autoregressive signals with heavy-tailed noise.
problem Denoising autoregressive signals corrupted by heavy-tailed noise.
method Self-supervised learning approach without requiring full noise distribution knowledge.
result Strong denoising performance compared to baseline methods, especially for impulsive noise.
New estimator reduces bias and variance in tensor and matrix denoising.
problem Optimal bias-variance tradeoff in matrix and tensor estimation.
method One-step variant of higher-order SVD (HOSVD) estimator.
result Achieves optimal bias-variance tradeoff in both matrix and tensor settings.
The paper develops estimators for variance in graph structures using fused lasso.
problem Variance estimation in graph-structured problems.
method Developed linear time estimator for homoscedastic case and total variation regularization estimator for heteroscedastic case.
result Minimax rates and consistency for variance estimation in various graph structures.
Develops algorithms for sparse signal reconstruction without needing signal sparsity or noise variance.
problem Sparse signal reconstruction challenges due to unknown signal sparsity and noise variance.
method TF-IGP and RRT-IGP frameworks for OMP and OLS without prior knowledge of k 0 k_0 k 0 and σ 2 σ^2 σ 2 . result TF-IGP and RRT-IGP achieve successful sparse recovery under restricted isometry conditions.
New techniques for compressive sensing without noise or signal statistics.
problem Support recovery in underdetermined linear regression models without prior noise and signal statistics.
method Proposes RRM and RRTA to operate OMP algorithm without noise variance or signal sparsity knowledge.
result Establishes high SNR consistency for OMP without prior noise and signal statistics.
PEGR improves deep learning models' robustness against noisy data.
problem Learning signals from noisy data in deep learning models.
method Per-example gradient regularization (PEGR) to suppress noise.
result PEGR enhances test error and robustness against noise perturbations.
Reward estimation improves model-free RL performance under corrupted rewards.
problem Handling corrupted or stochastic rewards in reinforcement learning.
method Using an estimator for both rewards and value functions.
result Improves performance in various noise types and environments.
Paper introduces MSA for weakly supervised covariance alignment in MEG signals.
problem Limited labeled signals in target datasets for MEG applications.
method Mixing model Stiefel Adaptation (MSA) leveraging unlabeled data.
result MSA outperforms recent methods in brain-age regression with MEG signals.
EVA adapts LoRA for faster, more efficient fine-tuning.
problem Fast and efficient fine-tuning of large models for specific tasks.
method EVA uses directions capturing most activation variance for initialization, maximizing gradient signal and reducing parameters.
result EVA achieves faster convergence and higher average scores across tasks, reducing parameters.
Paper learns DAG models with signal-dependent variance.
problem Learning large-scale DAG models with identifiable and computationally tractable noise variance.
method Introduces QVF DAG models, introduces ODS algorithm for learning.
result ODS algorithm statistically consistent in high-dimensional settings.
Algorithm estimates common mean from Gaussian variables with unknown variances.
problem Estimating common mean from Gaussian variables with different unknown variances.
method Intuitive and efficient algorithm using Subset-of-Signals model as benchmark.
result Improved estimation error by polynomial factors compared to previous work.
The paper estimates common mean of entangled Gaussians with bounded variances.
problem Estimating common mean of entangled Gaussians with bounded variances.
method Iteratively averaging truncated samples.
result Achieves error $O \left(\frac{\sqrt{n\ln n}}{m}
ight)$ with high probability when m = Ω ( n ln n ) m=Ω(\sqrt{n\ln n}) m = Ω ( n ln n ) . VGE provides a practical approach to uncertainty estimation in ensemble models.
problem Uncertainty estimation in ensemble models using additive decomposition breaks down.
method Variance-Gated Ensembles (VGE) introduces a differentiable framework with a signal-to-noise gate.
result VGE provides a Variance-Gated Margin Uncertainty (VGMU) score and Variance-Gated Normalization (VGN) layer.
Regularization helps resolve ambiguity in mean-variance models, improving predictive uncertainty quantification.
problem Signal-to-noise ambiguity in overparameterized mean-variance models.
method Statistical field theory framework to explain phase transition.
result Regularization reduces variability and improves predictive uncertainty quantification.
Proposes a new method for uncertainty estimation in neural networks.
problem Uncertainty quantification in neural networks for high-risk applications.
method Intuitive framework based on signal-to-noise ratio and variance-gated measure.
result Demonstrates a collapse in diversity of committee machines.
New method uses model comparison signals to improve LLM evaluation accuracy.
problem Limited benchmark sizes and model stochasticity in evaluating LLMs' mathematical reasoning.
method Combines standard labeled outcomes with model comparison signals to design a statistically efficient evaluation framework.
result Semiparametric estimator achieves the semiparametric efficiency bound and substantially improves ranking accuracy.
A new update rule for deep reinforcement learning reduces learning variance and variance in reference signals.
problem Learning variance and incorrect reference signals in deep reinforcement learning.
method t-soft update method inspired by student-t distribution, which reduces extreme updates and accelerates similar updates.
result The t-soft update method outperforms conventional methods in terms of return and variance in PyBullet robotics simulations.
FGD reduces noisy gradient variance in SGD for neural networks.
problem Noisy and unreliable gradient estimation in SGD for deep learning.
method Solves an adaptive filtering problem to consistently estimate the local gradient.
result Significantly reduces gradient variance and accelerates convergence.
A new ML-based framework improves variational inference efficiency.
problem Efficient and accurate gradient estimation in variational inference.
method Multilevel Monte Carlo (MLMC) with reparameterized gradient estimators and adaptive learning rate.
result Our method achieves faster convergence and reduces gradient variance.
Paper improves variance control in importance weighted variational bounds.
problem Improving the variance of gradient estimators for IWAE.
method Develops a novel control variate that grows SNR as √K for large K.
result Empirically, the method yields superior variance reduction for generative models.
Efficient system classifies EEG signals for cognitive tasks using nuclear features.
problem Classification of raw EEG signals for cognitive tasks is challenging.
method Singular value decomposition for computing dominant variances of EEG signals, using them as nuclear features, and a simple classifier.
result Nuclear features from frontal brain region achieved 100% prediction accuracy.
Bayesian Parametric Portfolio Policies corrects overestimation of utility and risk in traditional PPP.
problem Traditional Parametric Portfolio Policies ignore policy risk, leading to overestimation of expected utility and understatement of portfolio risk.
method Developed Bayesian Parametric Portfolio Policies (BPPP) by placing a prior on policy coefficients to correct the decision rule.
result BPPP delivers higher Sharpe ratios, lower turnover, larger investor welfare, and lower tail risk compared to traditional PPP.
The paper introduces isotropy as a regularizer to enhance portfolio stability.
problem Model uncertainty and estimation errors in diversification strategies.
method Integrates isotropy as a geometric regularizer into mean-variance optimization.
result Isotropy constraint systematically induces negative average-signal exposure, providing a robust crash hedge.
This work analyzes how preconditioning affects generalization in machine learning models.
problem The impact of preconditioning on the generalization of machine learning models.
method An asymptotic bias-variance decomposition of the generalization error for ridgeless regression under various preconditioners.
result The optimal preconditioner depends on label noise, model specification, and signal alignment, with NGD potentially better under certain conditions.
In this paper, we consider the optimal portfolio liquidation problem under the dynamic mean-variance criterion and derive time-consistent solutions in three important models. We give adapted optimal strategies under a reconsidered mean-variance subject at any point in time. We get explicit trading strategies in the bas…
SpecGD mitigates misalignment in phase retrieval models with anisotropic inputs.
problem Misalignment during gradient descent in phase retrieval models with anisotropic inputs.
method Spectral gradient descent modifies gradient updates to preserve directional information and remove spike amplification.
result SpecGD removes spike amplification, leading to stable alignment and accelerated noise contraction.
A new speech enhancement method using variational autoencoders.
problem Improving speech quality in noisy environments.
method Using a variational autoencoder as a speech model, trained with unsupervised noise modeling.
result The method outperforms existing techniques in speech enhancement.
This work improves structured prediction by learning the balance between signal and random noise.
problem Structured prediction with random perturbations.
method Learning the variance of randomized structured predictors to balance signal and noise.
result Learning the balance improves structured prediction effectiveness.
New sampler reduces MCMC complexity for Bayesian variable selection.
problem High-dimensional Bayesian variable selection with high computation complexity.
method Variable-complexity subset weighted-Tempered Gibbs Sampler (wTGS) with Rao-Blackwellized estimator.
result Variances of Rao-Blackwellized estimator are smaller than those of subset wTGS.
We address the issue of estimating the regression vector β β β in the generic s s s -sparse linear model y = X β + z y = Xβ+z y = X β + z , with β ∈ R p β\in\R^{p} β ∈ R p , y ∈ R n y\in\R^{n} y ∈ R n , $z\sim\mathcal N(0,\sg^2 I)$ and p > n p> n p > n when the variance $\sg^{2}$ is unknown. We study two LASSO-type methods that jointly estimate β β β and the variance. These estimators ar…
Stabilizes deep Bayesian neural networks with self-stabilizing priors.
problem Brittleness and difficulty in training deep Bayesian neural networks.
method Signal propagation theory, reformulated ELBO, self-stabilizing priors.
result Improved convergence and robustness in training deeper networks and noisier settings.
TF-OMP and TF-GARD improve sparse signal recovery without SC or noise variance knowledge.
problem Recovering sparse signals in noisy linear regression models without prior knowledge of signal sparsity or noise variance.
method Developed TF-OMP and TF-GARD, which do not require SC or noise variance knowledge.
result TF-OMP and TF-GARD achieve successful sparse recovery under RIC and mutual coherence assumptions, with competitive performance compared to algorithms requiring SC or noise variance knowledge.
Decoupled PFNs improve sequential decision-making by separating epistemic and aleatoric uncertainties.
problem Sequential decision-making requires distinguishing between epistemic uncertainty about latent signals and irreducible aleatoric observation noise.
method Developed a decoupled PFN architecture that uses query-level labels to train separate heads for latent signal and aleatoric noise.
result Empirically, decoupled PFNs mitigate the failure mode of total-variance exploration in noisy and heteroscedastic settings.
This paper optimizes cryptocurrency portfolios by integrating sentiment analysis with technical indicators.
problem Effective portfolio management in volatile cryptocurrency markets.
method Dynamic portfolio strategy using technical indicators and sentiment analysis.
result The integrated approach outperforms traditional benchmarks and achieves stronger risk-adjusted returns.
Proposes a method to decompose multivariate signals into Gaussian components.
problem Decomposing multivariate signals into Gaussian components.
method Greedy variational method for non-negative multivariate signals as a weighted sum of Gaussians.
result Upper bound for the distance from any mode of a Gaussian mixture model to the set of corresponding means.
Paper proposes efficient methods for clustering and signal recovery in high-dimensional data with block structures.
problem High-dimensional clustering and signal recovery under block signal structures.
method CFA-PCA and MA-PCA methods for sparse and dense block signals.
result Proposed methods achieve computational minimax optimality for clustering and signal recovery.
A new method for portfolio optimization using signature signatures to incorporate path-dependencies.
problem Traditional portfolio optimization models struggle with path-dependencies and exogenous signals.
method Signature Trading framework using rough path signatures to represent trading strategies.
result Efficient incorporation of exogenous signals and drawdown control in optimal strategies.
Study detects signals in spiked Wigner models using log likelihood ratio.
problem Detecting signals in rank-one spiked Wigner models with non-Gaussian noise.
method Proved asymptotic normality of log likelihood ratio and computed error thresholds.
result Optimal signal-to-noise ratio threshold for reliable detection.
Bayesian priors improve neural network performance on weak signals.
problem Challenges in encoding domain knowledge for weak signals in neural networks.
method Proposed a new joint prior over local scale parameters for feature sparsity and signal-to-noise ratio, optimized with Stein gradient.
result Improved prediction accuracy on various datasets, including genetics applications with weak and sparse signals.