LVTINO improves high-definition video restoration with consistent temporal details.
problem Restoring high-definition video with fine spatial detail and temporal consistency.
method LVTINO uses Video Consistency Models to bypass frame-by-frame image-based LDMs, achieving perceptual quality and computational efficiency.
result Significant perceptual improvements over current methods, achieving state-of-the-art quality with minimal evaluations.
A CNN method removes atmospheric distortion from video sequences.
problem Mitigating atmospheric distortion in video sequences.
method End-to-end supervised convolutional neural network (CNN) with residual learning.
result The method outperforms existing techniques in terms of image quality and speed.
Study subjective perception of low light restored images and develop an unsupervised QA model.
problem Lack of subjective QA for low light restored images and challenges in collecting human opinion scores.
method Create a dataset, conduct subjective QA study, develop self-supervised contrastive learning technique to extract features.
result Unsupervised NR QA model achieves state-of-the-art performance for low light restored images.
New image restoration method using localized patches and external databases.
problem Image restoration challenges.
method Localized structured prediction and non-linear multi-task learning for optimizing a penalized energy function.
result Strong statistical guarantees and practical effectiveness demonstrated on various image restoration problems.
Improved image restoration using frequency-guided sampling.
problem Restoring high-quality images from degraded observations with known degradation processes.
method Proposed a frequency-guided sampling approach for diffusion-based image restoration, incorporating a time-varying low-pass filter.
result Significantly improved performance on challenging image restoration tasks, including motion deblurring and image dehazing.
Unified method for multi-defect microscopy image restoration with limited training data.
problem Challenges in applying deep learning methods due to limited training data for multi-defect microscopy images.
method Two-stage approach: data augmentation with GAN and conditional GAN training.
result Proposed method gives comparable or superior results to existing methods in image quality restoration.
RGI improves robustness of GAN-inversion for image restoration and anomaly detection.
problem Robustness of GAN-inversion to unknown gross corruptions.
method Proposes RGI and R-RGI methods with provable robustness guarantees.
result Restored images and corrupted region masks converge to ground truth under mild assumptions.
Bayesian filtering approach identifies nonlinear restoring forces in dynamic systems.
problem Identification of nonlinear dynamic systems in engineering.
method Modeling the nonlinear restoring force as a Gaussian process, converting it to a state-space model, and inferring internal states and the nonlinear restoring force through filtering and smoothing.
result The approach effectively identifies nonlinear restoring forces in both simulated and experimental datasets.
Unified framework for image restoration using equivariant denoisers.
problem Restoring images with realistic priors and invariant transformations.
method Unified framework named ERED based on equivariant denoisers and stochastic optimization.
result Unified framework ERED converges and improves image restoration.
Proposes a new model for image restoration combining deep learning and total variation.
problem Restoring images from limited data with low-rank constraints insufficient.
method Regularized Deep Matrix Factorized (RDMF) model using deep neural network's low-rank bias and total variation.
result Outperforms state-of-the-art models in image restoration from few observations.
Generative models improve image restoration from unknown transformations.
problem Restoring images distorted by unknown transformations.
method Combining maximum a-posteriori probability with maximum likelihood estimation.
result Restores images without requiring exact knowledge of transformations.
Pyramid Attention Networks improve image restoration by leveraging self-similarities across scales.
problem Lack of full exploitation of self-similarities in image restoration by recent deep learning methods.
method Introduces a Pyramid Attention module that processes multi-scale feature correspondences to borrow clean signals from coarser levels.
result Pyramid Attention module achieves state-of-the-art results in various image restoration tasks.
The problem of image restoration in cryo-EM entails correcting for the effects of the Contrast Transfer Function (CTF) and noise. Popular methods for image restoration include `phase flipping', which corrects only for the Fourier phases but not amplitudes, and Wiener filtering, which requires the spectral signal to noi…
The paper develops algorithms to restore monotonicity in non-monotone functions.
problem Non-monotone solutions from heuristic algorithms need to be corrected.
method Develops algorithms to restore monotonicity with limited queries.
result Restores monotonicity while degrading the function value by at most ε.
Suppose a genus two handlebody is removed from a 3-manifold M and then a single meridian of the handlebody is restored. The result is a knot or link complement in M and it is natural to ask whether geometric properties of the link complement say something about the meridian that was restored. Here we consider what the …
New method restores source features for SFDA without source data.
problem Domain adaptation without access to source data.
method Feature Restoration (FR) and Bottom-Up Feature Restoration (BUFR).
result BUFR outperforms existing SFDA methods in accuracy, calibration, and data efficiency.
In this paper, we propose a new framework to remove parts of the systematic errors affecting popular restoration algorithms, with a special focus for image processing tasks. Generalizing ideas that emerged for ℓ1 regularization, we develop an approach re-fitting the results of standard methods towards the input d…
We present a time-dependent Langevin description of dynamics of stock prices. Based on a simple sliding-window algorithm, the fluctuation of stock prices is discussed in the view of a time-dependent linear restoring force which is the linear approximation of the drift parameter in Langevin equation estimated from the f…
A new transformer model corrects diacritics and typos in multiple languages.
problem Restoring diacritics and correcting typos in online communications.
method Employing a universal ByT5 transformer model trained on 12 languages, including Lithuanian.
result Achieves > 98% accuracy in diacritics restoration and typos correction.
A new method detects hallucinations in medical image restoration using Fourier Ring Correlation.
problem Detecting hallucinations in DL outputs for medical image restoration.
method sFRC (s(c)can FRC) over small patches of DL outputs and reference images.
result sFRC effectively detects hallucinations in CT and MRI restoration problems.
Proposes a cross-scale residual network for multiple image restoration tasks.
problem Image restoration tasks (super-resolution, denoising, deblocking) have strong correlations.
method Cross-scale residual network exploiting scale-related features and inter-task correlations.
result Outperforms state-of-the-art methods in multiple image restoration tasks.
Ground-A-Video edits videos without training, preserving intended changes.
problem Complex multi-attribute video editing with omitted or wrong changes.
method Grounding-guided video-to-video translation with Cross-Frame Gated Attention.
result Zero-shot multi-attribute video editing with improved accuracy and frame consistency.
SNORE applies denoiser only on images with noise of adequate level for image restoration.
problem Image restoration challenges with iterative algorithms and denoising.
method SNORE framework using stochastic regularization and stochastic gradient descent.
result SNORE is competitive with state-of-the-art methods on deblurring and inpainting tasks.
SLIC-UAV monitors forest recovery using UAVs and machine learning.
problem Challenges in monitoring forest recovery, especially in logged tropical forests.
method Novel pipeline for UAV imagery analysis, combining crown labelling, species classification, and superpixel segmentation.
result SLIC-UAV achieves high accuracy in species mapping, from 79.3% to 90.5%.
BP-DIP combines DIP and backprojection for image restoration.
problem Performance drop of deep learning methods due to mismatched observation models.
method Combines Deep Image Prior (DIP) and backprojection.
result BP-DIP outperforms DIP in deblurring tasks with higher PSNR and faster inference.
Aleatoric uncertainty is an intrinsic property of ill-posed inverse and imaging problems. Its quantification is vital for assessing the reliability of relevant point estimates. In this paper, we propose an efficient framework for quantifying aleatoric uncertainty for deep residual learning and showcase its significant …
CB-GLNs learn video data's complex dependencies via graph representation.
problem Capturing complex dependency structures in sequential data like videos.
method Represent video data as a graph, find compositional dependencies via graph-cut and message passing.
result CB-GLNs efficiently learn video data's semantic compositional structure.
The paper analyzes relationships between various image models for restoration.
problem Unclear relationships among popular image models for restoration.
method Theoretical analysis and experimental study of image models.
result Improved denoising performance by combining multiple image models.
RaMViD uses diffusion models for video prediction and infilling.
problem Predicting and infilling missing information in videos.
method Extends image diffusion models to videos using 3D convolutions and a new conditioning technique.
result Achieves state-of-the-art results on video prediction benchmarks.
Current deep learning results on video generation are limited while there are only a few first results on video prediction and no relevant significant results on video completion. This is due to the severe ill-posedness inherent in these three problems. In this paper, we focus on human action videos, and propose a gene…
This paper finds ReLU restores symmetry in SCL under class imbalances.
problem Symmetry break in SCL under class imbalances.
method Analytical proof and experiments with ReLU activation and batch selection.
result ReLU restores symmetry in SCL-learned representations without loss in test accuracy.
I2SB learns nonlinear diffusion processes between images.
problem Image restoration tasks, especially with limited structural information.
method Conditional diffusion models, Schrödinger bridge approach.
result I2SB outperforms standard models in various image restoration tasks. We build a collaborative filtering recommender system to restore images with impulse noise for which the noisy pixels have been previously identified. We define this recommender system in terms of a new color image representation using three matrices that depend on the noise-free pixels of the image to restore, and two…
Paper improves video categorization using temporal coherence.
problem Video categorization in multiple modalities.
method Temporal coherence-based regularization for multimodal models.
result Models with temporal coherence outperform state-of-the-art.
Improves video search by balancing text and visual modalities.
problem Modality imbalance in video search models, focusing mainly on text matching.
method Proposes MBVR with MS samples and DM to balance modalities.
result Empirically shows significant improvement in modality balance and search effectiveness.
A new video prediction model treats videos as continuous processes, reducing sampling steps and improving efficiency.
problem Efficiency and temporal coherence in video prediction models.
method Treats videos as a continuous multi-dimensional process, reducing sampling steps.
result Reduction of 75% sampling steps, state-of-the-art performance on benchmark datasets.
UDVD uses deep learning to denoise videos without supervision.
problem Lack of clean video data for training deep learning models.
method UDVD is a CNN trained solely on noisy video data, adapting to local motion.
result UDVD performs as well as supervised methods, even with limited training data.
SummaryNet automates video summarisation using deep learning.
problem Creating informative video summaries from videos.
method Two-stream convolutional network for spatial and temporal features, encoder-decoder model for salient features, sigmoid regression with LSTM for frame probability.
result SummaryNet achieves comparable or better results than state-of-the-art methods on benchmark datasets.
Duality restored in gauge theory, gravity, and string theory models.
problem Restoring duality invariance in theories coupled to matter.
method Extending phase space to allow for violations of the algebraic Bianchi identity and considering the axion as the duality current.
result Duality current in NS-NS gravity is the divergence of the axion.
Paper proposes SMFN for high-res spherical video super-resolution.
problem Super-resolution of 360-degree panoramic videos is expensive and challenging.
method Deformable convolutions, mixed attention mechanism, dual learning strategy, weighted mean square error loss function.
result The proposed SMFN method improves super-resolution of equatorial regions in 360-degree videos.
Paper proposes new principles and framework for AVC learning from user-generated videos.
problem Challenges in learning audio-visual correspondence from short-term user-generated videos.
method Introduced new principles and a framework to facilitate AVC learning from videos' themes.
result Proposed approach outperformed baseline by 23.15% on KWAI-AD-AudVis corpus.
The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and training stability, the generation becomes increasingly challenging with the incre…
Recent advances in deep generative models have lead to remarkable progress in synthesizing high quality images. Following their successful application in image processing and representation learning, an important next step is to consider videos. Learning generative models of video is a much harder task, requiring a mod…
Video classification is a challenging task in computer vision. Although Deep Neural Networks (DNNs) have achieved excellent performance in video classification, recent research shows adding imperceptible perturbations to clean videos can make the well-trained models output wrong labels with high confidence. In this pap…
Lower-dimensional video discriminators improve GAN performance.
problem High curvature in unconstrained video discriminator loss surfaces.
method Proposed Lower-Dimensional Video Discriminators (LDVD GANs).
result LDVD GANs double Temporal-GAN performance and achieve state-of-the-art performance.
Conventional sequential learning methods such as Recurrent Neural Networks (RNNs) focus on interactions between consecutive inputs, i.e. first-order Markovian dependency. However, most of sequential data, as seen with videos, have complex temporal dependencies that imply variable-length semantic flows and their composi…
With the growth of user-generated content, we observe the constant rise of the number of companies, such as search engines, content aggregators, etc., that operate with tremendous amounts of web content not being the services hosting it. Thus, aiming to locate the most important content and promote it to the users, the…
Detects and corrects adversarial images using image processing.
problem Vulnerability of deep neural networks to adversarial attacks.
method Image processing operations to detect and correct adversarial images.
result The method effectively detects and corrects adversarial images.