Optimal square matrices for image approximation under translation and rotation.
problem Approximating images with translation and rotation invariant subspaces.
method Abstract harmonic analysis for constructing optimal square matrices.
result Optimal approximation of images with minimal quadratic error.
New method improves image denoising with fewer parameters and less data.
problem Image denoising requires large datasets and supervised settings, limiting practical applications.
method Self-supervised framework using Tucker low-rank tensor approximation.
result Improves model generalizability and reduces data acquisition costs.
Paper improves image retrieval quality using nonlinear rank approximations.
problem Improving image retrieval quality in high-dimensional feature spaces.
method Computes normalized approximated ranks, converts to similarities, and uses them in a new loss function.
result Significant improvement in image retrieval quality on multiple datasets.
Study convexity and AFPP in digital images.
problem Relationship between convexity and AFPP in digital images.
method Examined in Z^2 digital images.
result Relationship between convexity and AFPP in digital images.
Convolution and pooling improve kernel methods in image classification.
problem Understanding the interplay between approximation and generalization in convolutional architectures.
method Characterized RKHS of kernels with convolution, pooling, and downsampling, computed generalization error.
result Convolution and pooling operations trade off approximation with generalization power.
Digital trees have approximate fixed point property, and conditions for products are explored.
problem Conditions for the approximate fixed point property in digital tree products.
method Analyzes digital trees and their products, explores conditions for the AFPP.
result Conditions are found for the AFPP in digital tree products.
DKGM improves image quality by debiasing kernel-based models.
problem Improving image quality in generative models without losing detail.
method Two-stage framework: KDE for density estimation, debiasing algorithm inspired by stochastic approximation.
result DKGM achieves comparable image quality to state-of-the-art models on CIFAR10.
New model generates images by reversing heat equation, revealing disentanglement.
problem Image generation without considering image structure.
method Stochastically reverses the heat equation to generate images, using variational approximation.
result Emergent disentanglement of overall colour and shape in images.
We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the MCMC operator to improve these samples, and finally use the samples to update the a…
Paper presents a deterministic method for diverse subset selection.
problem Diverse subset selection problems in recommendation, summarization, and search.
method Greedy deterministic adaptation of k-DPP for low-rank approximations and image search.
result The method yields low-rank approximations of kernel matrices and demonstrates effectiveness in image search.
Introduces robust and decomposable AP for image retrieval.
problem Challenges in training deep neural networks with AP.
method Differentiable rank approximation and loss function design.
result ROADMAP outperforms AP approximation methods and deep models.
Paper solves Musielak-Orlicz-Gauss image problem using parabolic flows.
problem Characterize Musielak-Orlicz-Gauss image measure of convex bodies.
method Study of parabolic flows and approximation technique.
result Provides solutions to the extended Musielak-Orlicz-Gauss image problem.
The idea of computer vision as the Bayesian inverse problem to computer graphics has a long history and an appealing elegance, but it has proved difficult to directly implement. Instead, most vision tasks are approached via complex bottom-up processing pipelines. Here we show that it is possible to write short, simple …
Paper introduces STSL, a second-order Tweedie sampler for efficient posterior sampling in inverse problems.
problem Computational challenges in sampling from posterior distributions using latent diffusion models.
method Introduces STSL, a novel second-order Tweedie sampler with tractable reverse process.
result STSL achieves 4X and 8X reduction in neural function evaluations compared to state-of-the-art solvers.
Attention mechanisms and non-local mean operations in general are key ingredients in many state-of-the-art deep learning techniques. In particular, the Transformer model based on multi-head self-attention has recently achieved great success in natural language processing and computer vision. However, the vanilla algori…
Quantum machine learns to clean up blurry images.
problem Cleaning up blurry images using quantum computing.
method Uses Boltzmann machines, QUBO, and quantum annealing to balance image quality and noise.
result Quantum method produces cleaner images than noisy originals on average.
Untrained neural networks can recover natural images from few measurements.
problem Recovering natural images from a small number of measurements.
method Gradient descent on un-trained convolutional neural networks.
result Untrained neural networks can approximate reconstruct signals/images from a near minimal number of random measurements.
Study on cold and freezing sets in digital images.
problem Properties of cold sets in digital images.
method Analysis of properties and relationships between cold and freezing sets.
result Examined relationships between cold and freezing sets.
Improved image restoration using frequency-guided sampling.
problem Restoring high-quality images from degraded observations with known degradation processes.
method Proposed a frequency-guided sampling approach for diffusion-based image restoration, incorporating a time-varying low-pass filter.
result Significantly improved performance on challenging image restoration tasks, including motion deblurring and image dehazing.
In this article, we prove energy quantization for approximate (intrinsic and extrinsic) biharmonic maps into spheres where the approximate map is in LlogL. Moreover, we demonstrate that if the LlogL norm of the approximate maps does not concentrate, the image of the bubbles are connected without necks.
Paper proposes faster incremental subclass discriminant analysis.
problem Efficiently classify subclasses in incremental data.
method Exact and approximate linear and kernelized solutions.
result Superior training time and accuracy compared to existing methods.
Modern neural network training relies on piece-wise (sub-)differentiable functions in order to use backpropagation to update model parameters. In this work, we introduce a novel method to allow simple non-differentiable functions at intermediary layers of deep neural networks. We do so by training with a differentiable…
We pursue an early stopping technique that helps Gaussian Restricted Boltzmann Machines (GRBMs) to gain good natural image representations in terms of overcompleteness and data fitting. GRBMs are widely considered as an unsuitable model for natural images because they gain non-overcomplete representations which include…
Image post-processing is used in clinical-grade ultrasound scanners to improve image quality (e.g., reduce speckle noise and enhance contrast). These post-processing techniques vary across manufacturers and are generally kept proprietary, which presents a challenge for researchers looking to match current clinical-grad…
Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We show how higher-order Bayesian decision-making problems, such as optimizing imag…
We introduce a general method of performing Residual Network inference and learning in the JPEG transform domain that allows the network to consume compressed images as input. Our formulation leverages the linearity of the JPEG transform to redefine convolution and batch normalization with a tune-able numerical approxi…
SLUG method detects bias and out-of-distribution content in generative models.
problem Generative models can underrepresent certain groups and fail on out-of-distribution data.
method SLUG: A new uncertainty quantification method for VAEs combining Laplace approximations and stochastic trace estimators.
result SLUG's UQ score correlates with bias and out-of-distribution content.
A variety of real-world tasks involve the classification of images into pre-determined categories. Designing image classification algorithms that exhibit robustness to acquisition noise and image distortions, particularly when the available training data are insufficient to learn accurate models, is a significant chall…
Paper explores supervised learning methods to approximate ideal observer for joint signal detection and localization.
problem Optimizing medical imaging systems by assessing their performance using the Ideal Observer model.
method Uses supervised learning methods, specifically convolutional neural networks, to approximate the Ideal Observer for joint signal detection and localization tasks.
result Supervised learning-based methods can approximate the Ideal Observer for joint signal detection and localization tasks, as shown by comparisons to MCMC and analytical methods.
Generative Adversarial Networks are powerful generative models that are able to model the manifold of natural images. We leverage this property to perform manifold regularization by approximating a variant of the Laplacian norm using a Monte Carlo approximation that is easily computed with the GAN. When incorporated in…
DEUA detects diffusion-generated images by accounting for different types of uncertainty.
problem Detecting generated images with varying aleatoric and epistemic uncertainty.
method DEUA framework using Laplace approximation for DEU estimation and asymmetric loss function.
result DEUA achieves state-of-the-art performance on large-scale benchmarks.
A new method uses DMs as priors for imaging problems, offering more accurate reconstructions.
problem Accurate probabilistic imaging for complex inverse problems.
method Markov chain Monte Carlo algorithm using DMs as plug-and-play priors for solving Bayesian inverse problems.
result Offers more accurate reconstructions and posterior estimation compared to existing methods.
Infinite-dimensional SBDMs improve image generation across multiple resolutions.
problem Efficient image generation at high resolutions and across different levels.
method Developed SBDMs in infinite-dimensional setting, using trace class operators and operator networks.
result Improved efficiency and generalization across resolution levels.
Discriminator optimizes to approximate optimal transport for better image generation.
problem Improving the quality of generated images using GANs.
method Trains discriminator to optimize a lower bound of Wasserstein distance, approximating optimal transport.
result Trained discriminator improves inception score and FID metrics.
Patch priors have become an important component of image restoration. A powerful approach in this category of restoration algorithms is the popular Expected Patch Log-Likelihood (EPLL) algorithm. EPLL uses a Gaussian mixture model (GMM) prior learned on clean image patches as a way to regularize degraded patches. In th…
New equation approximates Kähler potentials using Hermitian-Yang-Mills metrics.
problem Approximating Kähler potentials in complex domains.
method New Wess-Zumino-Witten type equation and Berndtsson's theorem on direct image bundles.
result Approximation of Kähler potentials by Hermitian-Yang-Mills metrics.
Bayesian method improves EEG source imaging accuracy by estimating skull conductivity.
problem Sensitivity of EEG source imaging to skull conductivity modeling.
method Bayesian uncertainty modeling to estimate skull conductivity and focal sources.
result Clear improvements in source localization accuracy and feasible skull conductivity estimates.
This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale lossy autoencoder extracts the multi-scale image features to quantized variables a…
SML improves pancreatic mass diagnosis accuracy using CT images.
problem Improving accuracy in pancreatic mass screening using CT imaging.
method Spectral machine learning method trained on 30,000 images, choosing fundamental images based on eigenvectors and removing irrelevant pixels.
result Achieved 94.6% test accuracy in diagnosing 113 patients.
Paper tackles Bayesian image restoration in low-photon Poisson imaging problems.
problem Bayesian inference in challenging low-photon Poisson imaging problems.
method Plug-and-play (PnP) Langevin sampling strategies with accelerated methods and mirror sampling.
result Effective PnP Langevin sampling methods for low-photon Poisson imaging problems.
In generative modeling, the Wasserstein distance (WD) has emerged as a useful metric to measure the discrepancy between generated and real data distributions. Unfortunately, it is challenging to approximate the WD of high-dimensional distributions. In contrast, the sliced Wasserstein distance (SWD) factorizes high-dime…
A new ABC technique using Sliced-Wasserstein distance improves inference quality.
problem Intractable likelihood in generative models leads to loss of information in summary statistics.
method Proposes Sliced-Wasserstein ABC, a new ABC technique based on the Sliced-Wasserstein distance.
result Derives theoretical consistency results and demonstrates improved performance on synthetic and image denoising tasks.
Softmax cross-entropy optimizes mutual information in neural networks.
problem Understanding the relationship between mutual information and classification neural networks.
method Demonstrated that optimizing softmax cross-entropy maximizes mutual information between inputs and labels.
result Softmax cross-entropy can approximate mutual information and highlight relevant image regions.
This paper develops optimal transport methods on the roto-translation group SE2.
problem Optimal transport on the roto-translation group SE2 for image analysis.
method Develops a computational framework for optimal transportation over Lie groups, focusing on SE2. Uses Sinkhorn-like algorithm with efficient distance approximations.
result Advances in image barycentric interpolation, orientation field interpolation, and Wasserstein flows on SE2.
A new method learns latent space normalizing flow for approximate inference in generator models.
problem Approximate inference in generator models with complex posterior distributions.
method Jointly learns latent space normalizing flow and generator model using MCMC-based maximum likelihood.
result The short-run Langevin flow approximates the posterior and aligns with the normalizing flow prior.
New method approximates Ideal Observer using GANs and MCMC.
problem Intractable computation of Ideal Observer test statistic.
method Applying MCMC to SOMs learned by GANs.
result Extends applicability of MCMC for IO performance.
New method for scalable set encoding with unbiased gradient approximation.
problem Limited expressive power and large set training issues in set functions.
method Universally MBC (UMBC) class of set functions and efficient MBC training algorithm.
result Unbiased approximation of full set gradient with constant memory overhead.
End-to-end algorithm for W-2 distance using neural networks.
problem Training optimal transport mappings for W-2 distance.
method Input convex neural networks and cycle-consistency regularization.
result Algorithm scales well to high dimensions without bias.