New framework improves experimental design using integral probability metrics.
problem Challenges in Bayesian Optimal Experimental Design (BOED) with KL divergence.
method Integrates integral probability metrics (IPMs) for stability and flexibility.
result IPM-based designs yield more robust and accurate credible sets.
Unified framework denoises data and abstains from uncertain predictions.
problem Data quality and predictive uncertainty in deep neural networks.
method Unified filtering framework leveraging data density.
result Framework outperforms state-of-the-art techniques in denoising and abstaining.
RNE provides a flexible framework for diffusion models, enabling inference-time control and energy-based training.
problem Insufficient knowledge of marginal densities in diffusion models.
method Introduces Radon-Nikodym Estimator (RNE) to reveal the connection between marginal densities and transition kernels.
result RNE delivers strong results in inference-time control and energy-based diffusion training.
New method uses CNN for seismic inversion uncertainty quantification.
problem Uncertainty quantification in seismic inversion for noisy data.
method Plug-and-Play Stein Variational Gradient Descent (PnP-SVGD) with CNN denoiser.
result High-resolution, trustworthy posterior samples for subsurface structures.
PnP-CM integrates CMs into PnP frameworks for efficient inverse problem solving.
problem Efficiently solving inverse problems with high-quality reconstructions.
method Reinterpreting CMs as proximal operators and integrating them into PnP frameworks.
result PnP-CM achieves high-quality reconstructions in as few as 4 NFEs.
Develops a robust method for image reconstruction from limited data.
problem Inference of unknown images from few measurements, often ill-posed.
method Introduces DPnP, a diffusion plug-and-play method combining likelihood and score-based samplers.
result Establishes performance guarantees for DPnP, demonstrating robustness and efficiency.
Paper tackles Bayesian image restoration in low-photon Poisson imaging problems.
problem Bayesian inference in challenging low-photon Poisson imaging problems.
method Plug-and-play (PnP) Langevin sampling strategies with accelerated methods and mirror sampling.
result Effective PnP Langevin sampling methods for low-photon Poisson imaging problems.
A new framework for controllable generation of discrete masked models.
problem Efficient controllable generation of discrete data models.
method Plug-and-play framework based on importance sampling.
result Demonstrates versatility across multiple domains, including protein design.
Plug-and-play L-GM-AMP improves CS recovery for any i.i.d. source prior.
problem Efficiently recovering signals from compressed measurements with unknown priors.
method Deep learning with Gaussian-mixture model to approximate source prior, combined with learned denoising.
result L-GM-AMP achieves state-of-the-art performance without prior knowledge of source distribution.
Paper tackles fairness issues in GNNs by proposing ELEGANT for certification.
problem Fairness issues in GNN predictions due to graph data perturbations.
method Proposes ELEGANT framework for certifying fairness of any GNN without assumptions or re-training.
result The fairness of any GNN backbone is impossible to be corrupted under certain perturbation budgets.
New convergence rates found for PnP methods using MMSE denoisers.
problem Asymptotic convergence of PnP methods with MMSE denoisers.
method Explicitly represented MMSE denoiser as an upper Moreau envelope, derived sublinear convergence rates.
result First sublinear convergence guarantee for PnP proximal gradient descent with MMSE denoiser.
SNORE applies denoiser only on images with noise of adequate level for image restoration.
problem Image restoration challenges with iterative algorithms and denoising.
method SNORE framework using stochastic regularization and stochastic gradient descent.
result SNORE is competitive with state-of-the-art methods on deblurring and inpainting tasks.
Novel algorithm accelerates PnP methods for image deblurring and super-resolution.
problem Efficiently solving inverse problems and imaging with provable convergence guarantees.
method Incorporates quasi-Newton steps into provable PnP framework based on proximal denoisers.
result 2--8x faster convergence compared to other provable PnP methods with similar quality.
A new method uses DMs as priors for imaging problems, offering more accurate reconstructions.
problem Accurate probabilistic imaging for complex inverse problems.
method Markov chain Monte Carlo algorithm using DMs as plug-and-play priors for solving Bayesian inverse problems.
result Offers more accurate reconstructions and posterior estimation compared to existing methods.
Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world graphs often come with high-dimensional and sparse node features, rendering the le…
Unified framework for image restoration using equivariant denoisers.
problem Restoring images with realistic priors and invariant transformations.
method Unified framework named ERED based on equivariant denoisers and stochastic optimization.
result Unified framework ERED converges and improves image restoration.
Neural networks utilize the softmax as a building block in classification tasks, which contains an overconfidence problem and lacks an uncertainty representation ability. As a Bayesian alternative to the softmax, we consider a random variable of a categorical probability over class labels. In this framework, the prior …
A new method uses compressive autoencoders for image restoration.
problem Efficient regularization of inverse problems in computational imaging.
method Variational Bayes Latent Estimation (VBLE) with compressive autoencoders.
result VBLE achieves similar performance to state-of-the-art PnP methods but faster.
Scalable PnP-ADMM for large-scale imaging problems.
problem Heavy computational and memory requirements of current PnP algorithms.
method Incremental variant of PnP-ADMM with theoretical convergence guarantees.
result Fast convergence and scalability compared to existing PnP algorithms.
A lightweight framework improves convergence and stability of PINNs for complex PDEs.
problem Training instability and reduced accuracy in PINNs for complex PDEs.
method Adaptive curvature correction using secant information to optimize first-order optimizers.
result Consistent improvements in convergence speed, stability, and accuracy over standard optimizers.
New method improves clustering accuracy in noisy single-cell data.
problem Challenges in clustering single-cell RNA sequencing data due to noise and variability.
method Latent plug-and-play diffusion framework with input-space steering.
result Improved clustering accuracy on synthetic and real-world single-cell data.
Bayesian approach improves rain field reconstruction using CMLs and DMs.
problem Challenges in accurately reconstructing ground-level rainfall from CML path-integrated measurements.
method Bayesian inverse problem with Diffusion Models as priors.
result Improved performance in rainfall estimation compared to existing methods.
Framework for designing nonlinearities in neural networks with slope constraints.
problem Designing nonlinearities with specific properties for signal processing.
method Variational framework with regularization for slope constraints and optimization of adaptive splines.
result Adaptive nonuniform linear splines achieve global optimum in constrained optimization.
Deep neural networks trained using a softmax layer at the top and the cross-entropy loss are ubiquitous tools for image classification. Yet, this does not naturally enforce intra-class similarity nor inter-class margin of the learned deep representations. To simultaneously achieve these two goals, different solutions h…
New method addresses error bounds for PnP-ULA under mismatched models.
problem Error bounds for PnP-ULA under mismatched measurement and prior models.
method Posterior-L2 pseudometric to quantify error bounds.
result Explicit error bound for PnP-ULA under mismatched posterior distribution.
New PnP algorithm converges with relaxed proximal gradient descent.
problem Convergence issues in PnP methods with deep denoisers.
method Relaxed proximal gradient descent for PnP with weakly convex regularization.
result Proposed PnP-αPGD converges for a wider range of regularization parameters. New algorithm improves signal recovery from noisy measurements with theoretical guarantees.
problem Recovering signals from noisy measurements in inverse problems.
method Wasserstein-based projections (WP) replacing analytic regularization with data-driven denoising.
result WP approximates true projection with high probability, providing theoretical guarantees.
E-CIT framework reduces CITs' computational burden and improves causal discovery performance.
problem High computational cost of traditional CITs in causal discovery.
method E-CIT framework using divide-and-aggregate strategy with stable distribution p-value combination.
result Significant reduction in computational burden and competitive performance in causal discovery.
ES improves training efficiency by dynamically selecting data samples.
problem Efficiently selecting informative data samples for faster learning.
method Evolved Sampling (ES) dynamically selects data samples based on loss dynamics and differences.
result ES achieves significant training acceleration without compromising model performance.
BOAT optimizes multiple antibody properties efficiently.
problem Balancing multiple drug-like properties in antibody design.
method Bayesian optimization framework coupling surrogate modeling and genetic algorithm.
result Competitive performance with state-of-the-art multi-objective protein optimization methods.
New method uses random decompositions for high-dimensional Bayesian optimization.
problem Learning accurate decompositions for high-dimensional black-box functions.
method Data-independent random tree-based decomposition sampling.
result Random decomposition upper-confidence bound algorithm (RDUCB) yields significant empirical gains.
Generative models produce realistic objects in many domains, including text, image, video, and audio synthesis. Most popular models---Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs)---usually employ a standard Gaussian distribution as a prior. Previous works show that the richer family of pri…
New method optimizes sensor placement for stochastic systems efficiently.
problem Optimizing sensor placements for black-box stochastic systems with computational constraints.
method Trains a joint energy-based model on simulation data to learn parameter and solution distributions, allowing efficient sensor placement.
result Demonstrates lower computational cost and more informative sensor locations compared to conventional approaches.
CMRM improves robustness in noisy label settings without requiring privileged knowledge.
problem Learning with noisy labels without privileged knowledge.
method Conformal Margin Risk Minimization (CMRM) framework.
result CMRM consistently improves accuracy and reduces mislabeling under various noise conditions.
Bridging physics and deep learning is a topical challenge. While deep learning frameworks open avenues in physical science, the design of physically-consistent deep neural network architectures is an open issue. In the spirit of physics-informed NNs, PDE-NetGen package provides new means to automatically translate phys…
This paper learns variational models and solvers for inverse problems from incomplete data.
problem Solving inverse problems with partially observed data.
method Joint learning of variational cost and gradient-based solver as neural networks.
result Joint learning leads to improved reconstruction performance.
Paper introduces a new sampling method for Bayesian inference.
problem Efficiently sampling from complex posterior distributions.
method Plug-and-Play split Gibbs sampler using variable splitting and ADMM.
result The method allows for embedding deep generative priors in Bayesian inference.
Training a Generative Adversarial Networks (GAN) for a new domain from scratch requires an enormous amount of training data and days of training time. To this end, we propose DAWSON, a Domain Adaptive FewShot Generation FrameworkFor GANs based on meta-learning. A major challenge of applying meta-learning GANs is to obt…
Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning framework. Surrogate and relaxation methods exist but tend to be specific to a given…
AugMask trains diffusion models on incomplete tabular data by augmenting missing values and applying denoising supervision.
problem Training diffusion models on incomplete tabular data with missing values.
method AugMask uses stochastic augmentation and denoising supervision to adapt diffusion models to incomplete data.
result AugMask enables diffusion-based tabular generators to outperform specialized missing-aware baselines across various datasets and missingness regimes.
Paper introduces a novel framework for set input tasks in meta-learning.
problem Meta-learning problems with set inputs often require efficient summary networks.
method Prototype-oriented optimal transport (POT) framework to improve summary networks.
result Significantly improves summary statistics from sets in meta-learning.
TAMO optimizes multiple objectives in-context using transformers.
problem Balancing competing objectives in expensive, black-box problems.
method Fully amortized, transformer-based policy for multi-objective optimization.
result Significant speedup in proposal time with improved Pareto quality.
Robots rely on sensors to provide them with information about their surroundings. However, high-quality sensors can be extremely expensive and cost-prohibitive. Thus many robotic systems must make due with lower-quality sensors. Here we demonstrate via a case study how modeling a sensor can improve its efficacy when em…
Designs CNNs for better image reconstruction.
problem Image reconstruction from limited data.
method Parseval convolution operators and chaining of elementary modules.
result CNN-based algorithm yields better results than sparsity-based methods.
CRC improves multivariate forecasting accuracy without risking performance degradation.
problem Systematic errors and lack of guarantees in multivariate forecasters.
method CRC uses a causality-inspired encoder and hybrid corrector with a safety mechanism.
result CRC consistently improves accuracy and ensures high non-degradation rates.
FunDPS improves PDE solution recovery from sparse data.
problem Recovering whole solutions from sparse or noisy measurements in PDEs.
method Function-space diffusion model with gradient-based guidance.
result FunDPS achieves 32% accuracy improvement over state-of-the-art methods.
A new Branch-and-Bound solver tackles L0-penalized problems with flexible loss functions.
problem Solving L0-penalized optimization problems with a broader class of loss functions.
method Generic Branch-and-Bound procedure with closed-form expressions for key quantities.
result El0ps solver achieves state-of-the-art performance and extends computational feasibility.
Paper develops a framework for generating coherent image captions using visual features and hierarchical topics.
problem Generating semantically coherent paragraphs to describe image content.
method Plug-and-play hierarchical-topic-guided image paragraph generation framework integrating visual extractor and deep topic model.
result Proposed models can distill interpretable multi-layer semantic topics and generate diverse and coherent captions.