A new method for brain tissue segmentation across medical centers using a smoothness prior.
problem Tissue segmentation challenges due to center-specific acquisition protocols.
method Developed a smoothness prior that is fit to segmentations from another medical center, integrated into an unsupervised Bayesian model.
result Segmentations are similarly smooth across centers, improving generalization.
GS-B3SE improves label shift estimation by smoothing priors on a graph.
problem Label shift adaptation when source and target distributions share conditional but not marginal probabilities.
method Graph-Smoothed Bayesian Black-Box Shift Estimator (GS-B3SE) places Laplacian-Gaussian priors on log-priors and confusion-matrix columns tied by a label-similarity graph. result GS-B3SE produces a tractable posterior with HMC or Newton-CG schemes, proving identifiability, contraction, and robustness. Paper learns hypergraph structures from signals with smoothness priors.
problem Learning hypergraph structures from signals with high-order relationships.
method Proposes HGSL framework with dual smoothness prior to map signals to hypergraph structure.
result HGSL efficiently infers meaningful hypergraph topologies from signals.
GPCDL uses Gaussian Processes to learn smooth templates from data.
problem Lack of smoothness in learned templates leads to overfitting and poor predictive performance.
method GPCDL incorporates Gaussian Process priors to enforce smoothness in the learned templates.
result GPCDL outperforms unregularized CDL in accuracy and predictive performance across various SNRs and applications.
Bayesian neural network achieves nearly optimal performance in Besov space.
problem Bayesian neural networks in Besov space.
method Spike-and-slab prior and shrinkage prior for posterior convergence rate.
result The posterior convergence rate is nearly minimax and adaptive to unknown smoothness.
New framework reduces minimax regret for high-dimensional data.
problem Minimizing regret in high-dimensional data with logarithmic loss.
method Developed envelope complexity framework and spike-and-tails prior.
result Achieves minimax regret within a factor of two over high-dimensional ℓ1-balls. Novel approach for estimating conditional expectations using Bayesian quadrature.
problem Estimating conditional expectations with costly evaluations.
method Probabilistic numerical methods incorporating prior smoothness knowledge.
result Fast convergence rate and uncertainty quantification.
Proposes I-prior extension for additive interaction models.
problem Challenges in estimating and selecting models with interactions.
method Extends I-prior methodology to multiple covariates, introducing a parsimonious model specification.
result Improves estimation and model selection for additive interaction models.
T-LoHo model detects structured sparsity and smoothness on graph data.
problem Detecting structured sparsity and smoothness in graph-structured data.
method Tree-based Low-rank Horseshoe (T-LoHo) prior for multivariate parameters.
result Improves anomaly detection on road networks compared to other methods.
New algorithms optimize without knowing problem parameters.
problem Optimizing large-scale problems without knowing key parameters.
method Combining mirror descent with dual averaging techniques.
result Converges without prior knowledge of problem parameters.
The construction of a meaningful graph plays a crucial role in the success of many graph-based representations and algorithms for handling structured data, especially in the emerging field of graph signal processing. However, a meaningful graph is not always readily available from the data, nor easy to define depending…
Study smooth embeddings of line configurations in complex projective plane.
problem Realizing line configurations as smooth 2-spheres.
method Lattice-theoretic arguments based on Donaldson's diagonalization theorem.
result Established a stronger obstruction in the smooth category.
Proposes learning a hierarchical prior in VAEs to avoid over-regularization.
problem Over-regularization in VAEs with standard normal priors.
method Formulates as a constrained optimisation problem, introduces graph-based interpolation.
result Learned latent representation reflects data manifold topology and properties.
Extends IBP for non-diagonal latent covariance structures, improving feature recovery and denoising.
problem Modeling latent features with smoothness characteristics.
method Extend Indian Buffet Process to include non-diagonal latent covariance structures.
result Smoothness prior improves feature recovery and denoising under appropriate conditions.
Framework uses DL and STORM priors for FBU cardiac MRI reconstruction.
problem Reconstructing FBU cardiac MRI from undersampled data.
method Model-based reconstruction with DL and STORM priors.
result Demonstrates potential for accelerating FBU cardiac MRI.
LMC algorithm receives first convergence guarantees under weak smoothness conditions.
problem Convergence guarantees for LMC under weak smoothness conditions.
method Using Latała--Oleszkiewicz or modified log-Sobolev inequalities.
result First convergence guarantees for LMC under weak smoothness conditions.
Label assignment problems with large state spaces are important tasks especially in computer vision. Often the pairwise interaction (or smoothness prior) between labels assigned at adjacent nodes (or pixels) can be described as a function of the label difference. Exact inference in such labeling tasks is still difficul…
We propose a Bayesian framework of Gaussian process in order to extend Fisher's discriminant to classify functional data such as spectra and images. The probability structure for our extended Fisher's discriminant is explicitly formulated, and we utilize the smoothness assumptions of functional data as prior probabilit…
Bayesian deep learning with heavy-tailed weights achieves near-optimal performance.
problem Deep neural networks with heavy-tailed weights achieve near-optimal performance in various contexts.
method Introduced a Bayesian deep learning prior based on heavy-tailed weights and ReLU activation, showing near-optimal minimax contraction rates.
result Posterior distribution achieves near-optimal minimax contraction rates, adaptive to smoothness and intrinsic dimension.
This work provides a guaranteed tensor recovery method by combining low-rankness and smoothness priors.
problem Guaranteed tensor recovery with theoretical guarantees for low-rank and smoothness priors.
method Developed a new regularization term that combines low-rankness and smoothness priors, proving exact recovery guarantees.
result Rigorously proved exact recovery guarantees for tensor completion and tensor robust principal component analysis.
Novel prior for orthogonal functions improves functional component estimation.
problem Improving orthogonality in functional principal component analysis.
method Sequential adaptive priors for orthogonal functions using hierarchical conditionally normal distributions.
result Proposed prior leads to nearly orthogonal posterior estimates.
Advances smooth over-parameterization for solving non-smooth optimization problems.
problem Non-smooth optimization with structural constraints in imaging and machine learning.
method Smooth over-parameterization of non-smooth problems, using gradient descent and mirror descent.
result Gradient descent on the reformulated smooth problem converges efficiently without parameter tuning.
New algorithm proves convergence for MAP estimation with denoisers.
problem Proving convergence of MAP estimation methods using pretrained denoisers.
method A simple gradient descent algorithm on smoothed proximal objectives.
result Algorithm provably converges to the proximal operator under log-concavity.
This paper solves aggregation of Pareto optimal models by using Bayesian priors and weighted averaging.
problem How to rationally aggregate Pareto optimal models while preserving Pareto efficiency.
method Four logical steps: 1) Bayesian models, 2) Prior as preference ranking, 3) Consistent aggregation, 4) Weighted average of priors.
result All rational/consistent aggregation rules follow a generalized hierarchical Bayesian model.
New method samples from piecewise smooth distributions using Hamiltonian Monte Carlo.
problem Sampling from distributions with discontinuous gradients.
method Generalized Randomized Hamiltonian Monte Carlo (GRHMC) for piecewise smooth targets.
result GRHMC processes sample from piecewise smooth target distributions with the desired distribution as the invariant distribution.
Midicoth compresses online probability estimates by correcting prior smoothing biases.
problem Compression inefficiency due to prior smoothing in adaptive models.
method Micro-diffusion denoising applied in a bitwise tree hierarchy.
result Significant compression improvement with reliable calibration.
New method improves signal estimation by convexifying ℓ0-norm constraints.
problem Signal estimation with sparsity and smoothness priors.
method Iterative convex conic quadratic relaxations exploiting ℓ0-norm and smoothness terms. result Significantly better estimators than ℓ1-norm approaches and interpretable parameters. Smooth Schrödinger Bridges improve trajectory inference by smoothing Gaussian processes.
problem Improving trajectory inference in applications like particle tracking.
method Generalizes Schrödinger Bridge problem to smooth Gaussian processes, solving the problem on phase space.
result The method outperforms existing methods on real datasets.
A new framework improves tensor completion accuracy by considering numerical priors.
problem Tensor completion accuracy loss due to ignoring numerical priors.
method Generalized CP Decomposition Tensor Completion (GCDTC) framework incorporating numerical priors.
result GCDTC framework outperforms state-of-the-arts in non-negative tensor completion.
Horseshoe priors improve small area estimation by borrowing strength globally but locally.
problem Improving precision of small area estimators through global-local borrowing of strength.
method Developed a tail-robust horseshoe model for Fay-Herriot small area estimation, using heteroscedastic Tweedie identity and regular variation theory.
result The horseshoe model outperforms structured Gaussian smoothing on strongly spatial data, identifying exceptional areas that smoothing suppresses.
Bayesian framework for sphere regression using Gaussian fields.
problem Nonparametric regression on the sphere with Gaussian priors.
method Isotropic Gaussian field priors, harmonic structure, exact posterior distributions, optimal spectral truncation, posterior contraction rates.
result Sharp posterior contraction rates for Gaussian priors with polynomially decaying angular power spectra.
Gradient descent with logistic loss can interpolate deep networks with smoothed ReLU activations under certain conditions.
problem Conditions for gradient descent to drive logistic loss to zero in deep networks with smoothed ReLU activations.
method Gradient descent applied to fixed-width deep networks with smoothed ReLU approximations (e.g., Swish, Huberized ReLU).
result Gradient descent can drive logistic loss to zero under specific conditions, providing bounds on convergence rate.
Improved deep learning models using new attribution priors and expected gradients.
problem Improving interpretability and performance of deep learning models.
method Introducing new attribution priors and expected gradients method that satisfies interpretability axioms.
result Improves model performance across various real-world tasks.
SAHMM-VAE separates sources adaptively using hidden Markov priors.
problem Unsupervised blind source separation.
method Source-wise adaptive Hidden Markov prior variational autoencoder.
result Different latent dimensions align with different source-specific temporal organizations.
Gradient descent reveals the exact implicit bias via dual optimization for linearly separable data.
problem Characterizing the implicit bias of gradient descent on linearly separable data.
method Primal-dual analysis with smoothed margin for general losses, and exponential loss with specific step sizes.
result Proves faster convergence rates for implicit bias and margin maximization.
DVAE++ uses overlapping distributions to train discrete latent variables.
problem Training discrete latent variable models with gradient information.
method Proposes a new class of smoothing transformations based on a mixture of two overlapping distributions.
result Overlapping transformations outperform other recent methods in training discrete latent variables.
Parallel sampling for smooth distributions with fast convergence.
problem Efficiently sampling from distributions with smooth densities.
method Parallelization of Langevin algorithms under log-Sobolev inequalities.
result Samples close to target distribution with low KL divergence or TV distance.
Gluon optimizes LMO-based methods for large-scale tasks, improving performance and theory-practice gap.
problem LMO-based methods lack theoretical support for practical implementation and smoothness assumptions.
method Introduces Gluon, a new LMO-based method with refined smoothness model.
result Gluon's theoretical stepsizes match fine-tuned values, closing the theory-practice gap.
A novel Bayesian method for dynamic sparsity in Gaussian dynamic linear regression.
problem Variable selection and shrinkage in time-varying regression models.
method Time-varying sparsity via Markov switching priors for coefficients' variances, extending spike-and-slab priors.
result Induces smoothness or shrinkage towards zero at each time point, leading to improved model performance.
DS-TS adapts to abrupt and smooth changes in bandit problems.
problem Non-stationary multi-armed bandit problems with abrupt and smooth changes.
method Discounted Thompson Sampling with Gaussian priors.
result Achieves nearly optimal regret bound for both abrupt and smooth changes.
Bayesian Probabilistic Integration uses BART for high-dimensional, non-smooth functions.
problem Bayesian quadrature's limitations in high-dimensional or non-smooth functions.
method Bayesian Additive Regression Trees (BART) priors for numerical integration.
result Explicit convergence rates can be obtained in various settings.
New adaptive strategy for active learning with smooth boundaries.
problem Adaptive active learning in multivariate classification with unknown distributional parameters.
method Combining insights from recent works, reduction to univariate-adaptive strategies.
result Near-optimal rates achieved without prior knowledge of distributional parameters.
The study optimizes Gaussian process approximations for finite-rank models.
problem Posterior behavior of finite-rank approximations differs from parent GP priors.
method Locally supported basis expansions with dependent Gaussian coefficients.
result Finite-rank expansions inherit the same posterior contraction rate as parent GP priors.
Adam converges with high probability under unconstrained non-convex smooth stochastic optimizations.
problem Theoretical limitations of Adam's convergence under unconstrained non-convex smooth stochastic optimizations.
method Deep analysis of Adam's convergence rate under affine variance noise, without bounded gradient assumptions.
result Adam converges to the stationary point with a high probability rate of $\mathcal{O}\left({
m poly}(\log T)/\sqrt{T}
ight)$.
Smooth activations enable optimal error rates in neural networks for Sobolev function classes.
problem Achieving optimal approximation and estimation error rates for neural networks in Sobolev function classes.
method Study of neural networks with smooth activations, proving optimal rates via approximation and statistical properties.
result Constant-depth networks with smooth activations achieve optimal rates of approximation and estimation, demonstrating smoothness adaptivity.
New algorithm reduces prediction error in online learning without knowing base measure.
problem Smoothed online learning without knowledge of base measure.
method R-Cover algorithm based on recursive coverings.
result First algorithm to guarantee sublinear regret for agnostic smoothed online learning without prior knowledge of base measure.
New method for robust fixed-point smoothing without state augmentation.
problem Estimating initial states in Gaussian smoothing algorithms.
method Cholesky-based formulation without state augmentation.
result Matches runtime and robustness of existing methods.
Let M be a smooth compact oriented manifold without boundary, imbedded in a euclidean space E and let f be a smooth map of M into a Riemannian manifold N. An unknown state x in M is observed via X=x+su where s>0 is a small parameter and u is a white Gaussian noise. For a given smooth prior on M and smooth estimators g …