Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

60121181241 · Jun 202019922001200920172026
48 results for Variation Aware

This work connects SAM to variational inference and evaluates its performance.

problem Improving generalization of gradient-based learning by finding flat minima.
method Establishes connections between SAM and Mean-Field Variational Inference (MFVI), and evaluates variational algorithms combining or interpolating between SAM and MFVI.
result SAM-like updates can be used as a drop-in replacement for the reparametrisation trick.

Proposes a new framework for uncertainty-aware LLM post-training.

problem Heterogeneous, conflicting data in large language models.
method α-Rényi variational framework for learning distributions over post-training parameters.
result Enables training examples to be softly routed across ensemble members, promoting model specialisation and providing uncertainty estimates.

TA-VAAL improves active learning by better utilizing task structures and overall data distribution.

problem High labeling cost limits deep learning applications; active learning selects informative samples.
method Task-aware variational adversarial active learning (TA-VAAL) modifies VAAL by relaxing task loss prediction and using ranking loss information.
result TA-VAAL outperforms state-of-the-arts on various datasets, including balanced and imbalanced labels.

Unified framework for fair regression in aware and unaware settings.

problem Lack of principled methods for fair regression in unawareness settings.
method Formulated as an optimal transport problem, unifying aware and unaware settings.
result Characterizes optimal prediction functions via optimal transport maps under different penalties.

SVAT reduces investment risks by making stock models sensitive to adversarial perturbations.

problem Risk control in stock recommendation models is insufficient, leading to high investment losses.
method SVAT combines adversarial learning and variational perturbation generation to enhance risk awareness.
result SVAT reduces investment risks by more than 30% compared to state-of-the-art baselines.

Bayes-CATSI uses variational Bayesian deep learning for medical time series data imputation.

problem Missing values in medical time series data.
method Bayes-CATSI integrates variational inference for uncertainty quantification and context-aware imputation.
result Bayes-CATSI outperforms CATSI by 9.57% in imputation performance.

This paper establishes the asymptotic consistency of the {\it loss-calibrated variational Bayes} (LCVB) method. LCVB was proposed in~\cite{LaSiGh2011} as a method for approximately computing Bayesian posteriors in a `loss aware' manner. This methodology is also highly relevant in general data-driven decision-making con…

2019-11-04abs ↗pdf ↗

Paper develops a new RL method for MDPs with uncertainty, achieving better regret bounds.

problem Online reinforcement learning in environments with both endogenous and exogenous uncertainty.
method Developed a VB-UCRL algorithm that restarts based on variation schedules.
result Established a regret bound of saving at most S\sqrt{S} or S16T112S^{\frac{1}{6}}T^{\frac{1}{12}}.

Bayesian neural networks improve uncertainty calibration without sacrificing accuracy.

problem Bayesian neural networks struggle with uncertainty calibration and high-dimensional geometry.
method Model uncertainty only in weight directions using a von Mises-Fisher posterior on the unit sphere, deriving a compact KL term.
result A lightweight, dimension-aware variational unit improves calibration without sacrificing accuracy.

Improved DP-SGD for variational inference reduces noise and variance.

problem Poor convergence and high variance in variational parameter outputs due to gradient noise in DP-SGD.
method Introduced aligned gradients and iterate averaging to reduce DP-induced noise, and noise-aware posteriors.
result Less noisy gradient estimator and improved parameter estimates for variational inference.

Bispectral OT improves dataset comparison by preserving intrinsic coherence.

problem Ignoring intrinsic coherence in dataset comparisons using pairwise geometric distances.
method Introduces Bispectral Optimal Transport, a symmetry-aware extension of discrete OT.
result Transport plans computed with Bispectral OT achieve greater class preservation accuracy.

Poisson variational autoencoders introduce a metabolic cost term that penalizes high baseline activity.

problem Energy constraints in computation.
method Poisson variational autoencoders with a Kullback-Leibler divergence term proportional to firing rates.
result Poisson variational autoencoders introduce a metabolic cost term that penalizes high baseline activity.

Proposes a model to generate 3D-aware images from 2D images.

problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.

Quantum state preparation framework speeds up basket option pricing.

problem Limited practical benefit of quantum amplitude estimation due to state-preparation depth.
method Structure-aware tensor-train rank-based variational state preparation.
result State-preparation depth scaling replaced with linear scaling, maintaining low basket-pricing errors.

A simple approach to obtaining uncertainty-aware neural networks for regression is to do Bayesian linear regression (BLR) on the representation from the last hidden layer. Recent work [Riquelme et al., 2018, Azizzadenesheli et al., 2018] indicates that the method is promising, though it has been limited to homoscedasti…

2019-12-14abs ↗pdf ↗

STAR improves equivariant and invariant representation learning by routing projection heads.

problem Redundant feature learning in equivariant and invariant representation learning.
method Soft Task-Aware Routing (STAR) for projection heads specialization.
result Lower canonical correlations between invariant and equivariant embeddings.

GAME improves matrix completion by considering subgroup-specific latent structures.

problem Heterogeneous data with overlapping categories, smoothing away subgroup-specific variation.
method Group-Aware Matrix Estimation (GAME) with overlapping nuclear-norm penalties.
result GAME outperforms global low-rank estimators in structured missingness regimes.

A neural network method tackles high-dimensional diffeomorphic mapping problems.

problem High-dimensional diffeomorphic mapping struggles with the curse of dimensionality.
method Combines variational principles with quasi-conformal theory for accurate, bijective mappings.
result Validated accuracy, robustness, and effectiveness in complex registration scenarios.

Donor-aware scRNA-seq benchmarks improve classification accuracy in inflammatory bowel disease.

problem Influenza disease classification from scRNA-seq data is prone to donor-level confounding.
method Developed and evaluated three feature representations across two IBD cohorts.
result Compartment-stratified CLR composition and GatedStructuralCFN embeddings outperform linear models in classification accuracy.

Different types of Convolutional Neural Networks (CNNs) have been applied to detect cancerous lung nodules from computed tomography (CT) scans. However, the size of a nodule is very diverse and can range anywhere between 3 and 30 millimeters. The high variation of nodule sizes makes classifying them a difficult and cha…

2019-01-01abs ↗pdf ↗

Deep learning has demonstrated success in health risk prediction especially for patients with chronic and progressing conditions. Most existing works focus on learning disease Network (StageNet) model to extract disease stage information from patient data and integrate it into risk prediction. StageNet is enabled by (1…

2020-01-24abs ↗pdf ↗

SVGP KAN integrates uncertainty quantification into Kolmogorov-Arnold networks.

problem Uncertainty quantification in scientific machine learning models.
method Sparse variational Gaussian process inference with Kolmogorov-Arnold topology.
result Demonstrated ability to distinguish aleatoric and epistemic uncertainty in various scientific applications.

Structured Nonparametric Variational Inference for Dependent Latent Modeling

problem Approximating posterior distributions with complex dependencies among latent variables
method Structured Nonparametric Variational Inference (SN-VI)
result Flexible and accurate posterior approximation with arbitrary shapes

This paper reviews Bayesian methods for sparsity-aware modeling.

problem Uncertainty evaluation and robustness in sparsity-aware models.
method Incorporates sparsity-promoting priors into deep neural networks, Gaussian processes, and tensor decomposition.
result Bayesian methods improve model robustness and uncertainty evaluation.

Modularity-aware GAE and VGAE improve community detection and link prediction.

problem Improving community detection with GAE and VGAE in the absence of node features.
method Introducing a modularity-aware message passing scheme and regularizer to GAE and VGAE encoders.
result Jointly addressing community detection and link prediction with high accuracy is possible.

Unified framework for planning under uncertainty using variational inference.

problem Planning under uncertainty with separate objectives for exploration and exploitation.
method Variational inference on a generative model augmented with priors.
result EFE-based planning emerges as variational inference, enabling scalable, resource-aware policies.

In this paper, we analyze energy-harvesting adaptive diffusion networks for a distributed estimation problem. In order to wisely manage the available energy resources, we propose a scheme where a censoring algorithm is jointly applied over the diffusion strategy. An energy-aware variation of a diffusion algorithm is us…

2015-09-29abs ↗pdf ↗

Conformal-DP improves differential privacy on manifold data by calibrating perturbations based on local densities.

problem Lack of density-awareness in existing differential privacy mechanisms for manifold data leads to biased and suboptimal privacy-utility trade-offs.
method Proposes Conformal-DP, a density-aware differential privacy mechanism using conformal transformations to calibrate perturbations based on local densities.
result Demonstrates improved privacy-utility trade-off in heterogeneous data distribution settings compared to state-of-the-art mechanisms.

Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised manner. To overcome this limitation, we introduce the notion of input-dependent unce…

2018-05-24abs ↗pdf ↗

VDA improves disentanglement of latent representations in complex signals.

problem Learning disentangled and interpretable representations in nonstationary, high-dimensional time-evolving signals.
method Variational decomposition autoencoding (VDA) framework, incorporating signal decomposition, contrastive self-supervised task, and variational prior approximation.
result DecVAEs surpass state-of-the-art VAE-based methods in disentanglement quality and generalization.

GH-PID uses guided harmonic paths for efficient SOT with interpretable diagnostics.

problem Efficiently solving Stochastic Optimal Transport with hard terminal distributions and soft costs.
method Guided Harmonic Path-Integral Diffusion (GH-PID) framework with low-dimensional guidance.
result GH-PID generates geometry-aware, cost-reducing trajectories that match terminal distributions.

Noise-aware Bayesian inference framework for locally private data collection.

problem Privacy-preserving data collection with non-trustworthy aggregators.
method Noise-aware probabilistic modeling framework for Bayesian inference under LDP.
result Demonstrated efficacy in parameter estimation for various distributions and regression models.