iTimER learns from reconstruction errors to represent irregularly sampled time series.
problem Learning from irregularly sampled time series with missing data.
method iTimER models reconstruction errors as a proxy for unobserved values, using a mixup strategy and a Wasserstein metric.
result iTimER outperforms state-of-the-art methods in classification, interpolation, and forecasting tasks.
Method calculates Shapley values for PCA reconstruction errors to explain anomaly detection.
problem Explaining PCA-based anomaly detection results.
method Utilizes probabilistic PCA view to compute Shapley values of reconstruction errors.
result Shapley values are more advantageous than raw errors for explaining anomalies.
Paper proposes RAN for better anomaly detection in time series data.
problem Anomaly detection algorithms often fail to accurately detect anomalies due to incomplete reconstruction of anomaly data.
method RAN uses adversarial learning and latent vector-constrained Autoencoder to ensure consistent reconstruction of anomaly data.
result RAN outperforms other algorithms in detecting meaningful anomalies with higher AUC-ROC scores.
CoRAS adapts image acquisition rates for accurate reconstruction.
problem Determining when enough measurements are collected for accurate image reconstruction.
method Adaptive acquisition rate selection based on reconstruction error probability.
result CoRAS achieves target stopping-time coverage with fewer measurements.
Paper improves MRI reconstruction by separating target labels and prediction error.
problem Improving MRI reconstruction accuracy by estimating prediction error.
method Proposes a novel method to estimate target labels and prediction error separately.
result Significantly better MRI reconstruction results achieved compared to state-of-the-art methods.
Probabilistic Autoencoder learns latent space weights' distribution.
problem Nonlinear model reconstruction error and sample quality.
method Normalizing flow for latent space weights' probability distribution.
result PAE achieves small reconstruction errors, high sample quality, and good performance.
DCAE learns compact latent representations for one-class novelty detection.
problem Learning compact latent representations for one-class novelty detection.
method DCAE learns compact and collapse-free latent representations through internal discriminative layers of GANs, reconstructing in-class data finely and exclusively.
result DCAE achieves state-of-the-art performance on novelty and adversarial example detection.
Sparse elasticity reconstruction from local displacements reduces error.
problem Reconstructing elasticity from limited data.
method Sparse elasticity reconstruction theory, local clustering, alternating optimization.
result Higher spatial resolution elasticity distribution estimation.
We propose a general framework for reconstructing and denoising single entries of incomplete and noisy entries. We describe: effective algorithms for deciding if and entry can be reconstructed and, if so, for reconstructing and denoising it; and a priori bounds on the error of each entry, individually. In the noiseless…
GCVAE improves disentanglement in VAEs while balancing reconstruction error.
problem Improving disentanglement in VAEs while maintaining low reconstruction error.
method Introduces three controllable Lagrangian hyperparameters to optimize reconstruction and KL divergence loss.
result GCVAE outperforms state-of-the-art models in disentanglement while balancing reconstruction.
RECol generates error columns to improve outlier detection.
problem Outlier detection in data with complex relationships.
method Generates reconstruction error columns for leave-one-out feature sets.
result Improves ROC-AUC and PR-AUC values of common outlier detection methods.
A new method for the unsupervised learning of sparse representations using autoencoders is proposed and implemented by ordering the output of the hidden units by their activation value and progressively reconstructing the input in this order. This can be done efficiently in parallel with the use of cumulative sums and …
New algorithm learns stable LDSs with lower error and better control performance.
problem Learning stable LDSs from data with minimal reconstruction error and stability constraints.
method Proposes an optimization method using a recent characterization of stable matrices, iteratively improving reconstruction error and ensuring stability.
result Achieves orders-of-magnitude improvement in reconstruction error compared to existing methods.
New anomaly score for generative models without manifold assumptions.
problem Reconstruction error's theoretical limitations for generative models.
method Defining a new anomaly score compatible with generative models.
result The new score is theoretically sound and practical for auto-encoders.
New method detects anomalies without bias, improving on autoencoder reconstruction errors.
problem Inherent biases in autoencoder-based anomaly detection methods.
method Introduces a Lipschitz anomaly discriminator trained to detect differences between training data and corruptions.
result Successfully detects anomalies with guarantees on certain Wasserstein distances.
Paper presents efficient algorithms for reconstructing noisy pooled data.
problem Reconstructing hidden states from noisy pooled data.
method Simple and efficient distributed algorithms for two noise models.
result Our algorithms reconstruct exact initial states with high probability.
Convolutional neural network improves MRE image reconstruction.
problem Reconstructing MRE images from displacement data is computationally intensive and costly.
method Proposes a CNN architecture to directly map MRE displacement data into elastograms, introducing a secondary loss for training.
result CNN-generated images compare favorably with nonlinear inversion methods.
Capsule models detect adversarial images by reconstructing from top-level capsules.
problem Detecting adversarial images that look like a typical member of the predicted class.
method Capsule models trained to reconstruct images from pose parameters and identity of the correct top-level capsule.
result Setting a threshold on reconstruction error effectively detects adversarial images.
Researchers improve spectrum reconstruction formula with proof.
problem Improving accuracy of spectrum estimation in PCA.
method Analytical derivation of approximation formula for PCA.
result Order of error for approximation formula is c-dependent. An axiomatic approach to signal reconstruction is formulated, involving a sample consistent set and a guiding set, describing desired reconstructions. New frame-less reconstruction methods are proposed, based on a novel concept of a reconstruction set, defined as a shortest pathway between the sample consistent set and…
Capsule networks detect and diagnose adversarial images better than CNNs.
problem Detecting and diagnosing adversarial images in neural networks.
method Class-conditional capsule reconstruction and reconstructive attack.
result Capsule networks outperform CNNs in detecting and diagnosing adversarial images.
This paper uses β-VAE for unsupervised anomaly detection in NSL-KDD.
problem Unsupervised anomaly detection in network traffic.
method β-VAE with latent space structure and reconstruction error.
result Latent space exploitation is more effective for classification tasks.
Adversarial autoencoders improve anomaly detection in images.
problem Anomaly detection in images is challenging when training data contains outliers.
method Adversarial autoencoders enforce a prior distribution on latent representations to identify and reject potential anomalies during training.
result Adversarial autoencoders significantly improve robustness to outliers during training.
Paper explores CapsNet for anomaly detection in images.
problem Detecting anomalies in unseen images using CapsNet.
method Developed prediction-probability and reconstruction-error based normality scores.
result CapsNet-based methods outperform benchmarks in anomaly detection.
This work analyzes the generalization properties of learned reconstruction methods for inverse problems.
problem Understanding the reliability and stability of learned reconstruction methods for inverse problems.
method Develops a general framework to interpret learned reconstruction methods in statistical learning context and performs their sample error analysis.
result Estimates the dependence of learned operators on training data, providing insights into their generalization properties.
Metalearning optimizes autoencoder dimensions for efficient data representation.
problem Selecting optimal dimension for autoencoder output to balance accuracy and complexity.
method Metalearning approach using actor-critic algorithm to dynamically adjust dimension.
result Automatic selection of minimum number of bases for optimal reconstruction.
The vast majority of network datasets contains errors and omissions, although this is rarely incorporated in traditional network analysis. Recently, an increasing effort has been made to fill this methodological gap by developing network reconstruction approaches based on Bayesian inference. These approaches, however, …
This paper aims to develop a new and robust approach to feature representation. Motivated by the success of Auto-Encoders, we first theoretical summarize the general properties of all algorithms that are based on traditional Auto-Encoders: 1) The reconstruction error of the input can not be lower than a lower bound, wh…
Algorithm reconstructs vertex positions in random geometric graphs with improved accuracy.
problem Reconstructing vertex positions in random geometric graphs with high accuracy.
method Hybrid of graph distances and short-range estimates based on common neighbors.
result Algorithm reconstructs vertex positions with error of O(nβ), improving over previous results. We introduce a new approach to unsupervised estimation of feature-rich semantic role labeling models. Our model consists of two components: (1) an encoding component: a semantic role labeling model which predicts roles given a rich set of syntactic and lexical features; (2) a reconstruction component: a tensor factoriz…
The VAE's reconstruction ability is studied using PAC-Bayes theory.
problem Understanding the performance of VAEs for unseen data.
method PAC-Bayes theory is applied to analyze VAE's reconstruction error.
result Generalization bounds on VAE's reconstruction error are provided.
Paper presents J-RFDL for robust DL in compressed space, improving data representation robustness and accuracy.
problem Improving data representation robustness and accuracy in the presence of noise and outliers.
method Joint Robust Factorization and Projective Dictionary Learning (J-RFDL) in a factorized compressed space.
result Delivers superior performance in data representation and classification over state-of-the-art methods.
Study reconstructs hidden perfect matchings in random graphs with specific edge weights.
problem Reconstructing hidden perfect matchings in random weighted bipartite graphs.
method Analyzes the maximum likelihood estimator for matching reconstruction under different probability distributions of edge weights.
result Sharp threshold and infinite-order phase transition in reconstruction error for different probability distributions.
Two derivations of PCA for distributional data.
problem PCA for datasets of distributions.
method Two derivations: variance maximization and reconstruction error minimization.
result Closed-form solution for distributional PCA.
Deep learning models reconstruct volatility surfaces from noisy data under no-arbitrage constraints.
problem Reconstructing implied volatility surfaces from sparse and noisy option quotes.
method Compared multiple neural architectures including Transformers, U-Nets, and variational autoencoders.
result Transformer and U-Net architectures achieve strong reconstruction accuracy, especially under sparse observation regimes.
ENSURE framework trains deep image recon algorithms without clean data.
problem Lack of clean, fully sampled ground-truth data for deep learning image reconstruction.
method Introduces ENSURE framework, a generalization of SURE and GSURE to random sampling patterns.
result ENSURE loss function is an unbiased estimate for true mean-square error.
A new method reduces dimensionality for better likelihood-free parameter estimation.
problem Estimating parameters from data with no closed-form likelihood.
method Combines reconstruction map estimation with dimension-reduction techniques.
result The proposed method outperforms existing techniques in accuracy and efficiency.
Improved neural network reconstruction from sparse measurements with theoretical guarantees.
problem Improving neural network performance in sparse signal reconstruction from few measurements.
method Combining iterative reconstruction algorithms with neural networks, analyzing generalization properties, and deriving a generalization bound.
result Theoretical guarantees for neural network reconstruction from compressive linear measurements, with generalization error scaling logarithmically in the number of layers and linearly in the number of measurements.
Paper proposes a new method to learn similarity from data.
problem Learning similarity from data without losing manifold structure.
method Minimizing reconstruction error of kernel matrices.
result Significant improvements in clustering tasks compared to state-of-the-art methods.
Proposes a new sparse recovery method using generalized error function.
problem Sparse recovery in signal processing and imaging.
method Introduces a penalty function with shape and scale parameters for sparse recovery.
result The method improves MRI reconstruction and is theoretically sound.
A novel approach is put forth that utilizes data similarity, quantified on a graph, to improve upon the reconstruction performance of principal component analysis. The tasks of data dimensionality reduction and reconstruction are formulated as graph filtering operations, that enable the exploitation of data node connec…
The paper explores how kernel eigenalignments affect generalization in KRR.
problem Achieving robust generalization in kernel methods.
method Direct connection between generalization and matrix eigenvectors/eigenvalues, focusing on finite-sample settings.
result Strong generalization requires increasing eigenvector alignment, eigenvalue magnitude, or gaps between eigenvalues.
Optimal defenses protect FL models from gradient reconstruction attacks.
problem Gradient reconstruction attacks compromise FL models by recovering original data from shared gradients.
method Derive a theoretical lower bound of reconstruction error, customize noise and pruning defenses, and achieve optimal trade-off between leakage and utility.
result Our methods outperform Gradient Noise and Pruning in protecting training data and maintaining model utility.
We develop mask iterative hard thresholding algorithms (mask IHT and mask DORE) for sparse image reconstruction of objects with known contour. The measurements follow a noisy underdetermined linear model common in the compressive sampling literature. Assuming that the contour of the object that we wish to reconstruct i…
New model reconstructs flow from sparse data with uncertainty quantification.
problem Reconstructing nonlinear flow from limited observations.
method Semi-Conditional Variational Autoencoder (SCVAE) for probabilistic flow reconstruction.
result SCVAE improves reconstruction accuracy compared to Gappy Proper Orthogonal Decomposition (GPOD).
DynamicVAE improves disentanglement and reconstruction accuracy without sacrificing one for the other.
problem The inherent trade-off between disentanglement and reconstruction accuracy in VAE models.
method DynamicVAE uses a modified incremental PI controller to dynamically adjust the weight β during training, decoupling disentanglement and reconstruction accuracy.
result DynamicVAE significantly improves reconstruction accuracy while maintaining disentanglement comparable to existing methods.
Improves model-based control and exploration by estimating model uncertainty.
problem Inaccuracies in model predictions lead to frequent re-planning, inefficiency, and unreliability.
method Estimates model uncertainty using reconstruction error and uses it for better control and active exploration.
result Improves control performance and exploration efficiency by choosing confident model predictions and planning for high uncertainty.
Unified theory explains and mitigates double descent in data reconstruction.
problem Understanding and mitigating double descent in reduced order modeling.
method Data-Noise Averaging theory, sufficient criteria, detailed risk curve prediction, regularization mechanisms.
result Detailed risk curves predicted at reduced computational cost, instability traced to individual sensors.