New method combines reinforcement learning approaches via shared low-dimensional encoding.
problem Efficient and robust reinforcement learning methods.
method Explicitly bridging model-free and model-based approaches via a shared low-dimensional learned encoding.
result Good generalization and computational efficiency with planning in a smaller latent state space.
Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an encoder, which maps a high-dimensional dataset and its low-dimensional embedding, and …
Model learns cancer tissue images onto a low-dimensional space revealing tissue characteristics.
problem Improving cancer diagnosis through high-fidelity digital pathology.
method Deep generative model using PathologyGAN to map real images onto a latent space.
result Latent space encodes morphological characteristics and reveals distinct tissue clusters.
Isometry regularizer improves autoencoder performance on manifold learning.
problem Bad generalization in autoencoders, especially extrinsic and intrinsic issues.
method Introduces an isometry regularizer that encourages the decoder to be an isometry and the encoder to be its pseudo-inverse.
result Isometry regularizer leads to better generalization and useful low-dimensional data representations.
CausalEGM estimates causal effects by encoding confounders, improving performance in high-dimensional settings.
problem Challenges in estimating causal effects with high-dimensional confounders.
method CausalEGM framework using generative modeling to decouple confounders and estimate causal effects.
result CausalEGM outperforms existing methods in binary and continuous treatment settings, especially with large sample sizes and high-dimensional confounders.
Improved reliability of machine learning predictions using variational auto-encoders.
problem Individual unreliability of machine learning models.
method Modified variational auto-encoders to identify a low-dimensional space for reliable classification.
result Improved reliability of predictions and robust identification of adversarial samples.
Latent FxLMS accelerates ANC by adapting along low-dimensional filter weights.
problem Improving active noise control with neural adaptive filters.
method Training an auto-encoder on filter coefficients, constraining weights to latent variables, and updating in latent space.
result Latent FxLMS converges in fewer steps with comparable error to standard FxLMS.
Paper analyzes dataset distillation for efficient encoding of task-relevant information.
problem Efficiently encoding task-relevant information from gradient-based learning of non-linear tasks.
method Theoretical analysis of dataset distillation applied to two-layer neural networks with gradient-based training.
result Low-dimensional structure of the problem is efficiently encoded into distilled data, reproducing a model with high generalization ability.
Improved RL value function approximation using graph-based feature learning.
problem Accurate value function approximation in high-dimensional state or action spaces.
method Representation policy iteration (RPI) with graph-based feature learning algorithms.
result Node2vec and Variational Graph Auto-Encoder outperform PVFs in low-dimensional feature space.
Regularized M-estimators are used in diverse areas of science and engineering to fit high-dimensional models with some low-dimensional structure. Usually the low-dimensional structure is encoded by the presence of the (unknown) parameters in some low-dimensional model subspace. In such settings, it is desirable for est…
CADGMM detects anomalies by capturing complex correlations in data.
problem Detecting anomalies in complex, unstructured data.
method CADGMM uses a graph structure to encode correlations, then a dual-encoder to learn low-dimensional latent space, followed by a Gaussian Mixture Model for anomaly detection.
result CADGMM effectively detects anomalies in real-world datasets.
This paper describes a method for learning low-dimensional approximations of nonlinear dynamical systems, based on neural-network approximations of the underlying Koopman operator. Extended Dynamic Mode Decomposition (EDMD) provides a useful data-driven approximation of the Koopman operator for analyzing dynamical syst…
Novelty search in low-dimensional space improves sample efficiency in exploration tasks.
problem Efficient exploration in complex environments with sparse rewards.
method Combines model-based and model-free objectives to learn a low-dimensional representation. Uses intrinsic novelty rewards based on nearest neighbor distances in this space.
result Our approach achieves more sample-efficient exploration compared to strong baselines on various tasks.
Unknot recognition is one of the fundamental questions in low dimensional topology. In this work, we show that this problem can be encoded as a validity problem in the existential fragment of the first-order theory of real closed fields. This encoding is derived using a well-known result on SU(2) representations of kno…
Cryo-em images are found to be low-dimensional.
problem Understanding the geometric structure of cryo-em data.
method Applied manifold learning techniques to CryoSBI representations.
result Cryo-em data inherently populate low-dimensional manifolds.
RED-SC improves deep subspace clustering efficiency.
problem Slow convergence in training deep subspace clustering models.
method Residual Encoder-Decoder network with skip-layer connections and self-expressive layer.
result Training converges much faster with RED-SC.
Paper proposes a new Autoencoder for robustly encoding white matter streamlines.
problem Limited Autoencoder architectures ignore global streamline geometry and lack interpretability.
method Introduces Differentiable Vector Quantized Variational Autoencoder (D-VQ-VAE) for entire streamline bundles.
result Demonstrates superior performance in encoding and synthesis compared to state-of-the-art Autoencoders.
VED framework learns low-dimensional latent representations of physical systems.
problem Learning latent representations of complex physical systems.
method Variational Encoder-Decoder (VED) framework with KL divergence and covariance regularization.
result VED achieves lower-dimensional latent representations with improved feature disentanglement.
Centroid-Encoder reduces high-dimensional data for better visualization.
problem Visualizing high-dimensional data efficiently and accurately.
method Centroid-Encoder integrates label information to keep similar objects close in reduced space.
result Centroid-Encoder outperforms other techniques in visualizing high-dimensional data.
Adaptive ML learns complex time-varying systems without new data.
problem Applying ML to time-varying systems with shifting distributions.
method Mapping high-dimensional inputs to low-dimensional latent space, actively tuning latent space based on feedback.
result Learning correlations and tracking system evolution in real-time without new data.
Low-dimensional vectors improve semantic understanding of music and language.
problem Noise in shared semantics due to individual brain biases.
method Jointly model multiple brains to learn low-dimensional vector embeddings.
result These embeddings outperform high-dimensional fMRI data in music and language classification.
HyperVAE encodes distributions of distributions using variational inference.
problem Modeling distributions of distributions efficiently and preserving information.
method Variational inference with Gaussian mixture models and matrix-network decoders.
result HyperVAE encodes parameters of a VAE in a low-dimensional Gaussian distribution, preserving more information.
New auto-encoder handles varying noise levels without retraining.
problem Auto-encoders degrade in noisy conditions.
method Formalized auto-encoders as transform learning, derived new architecture.
result Models generalize well to different noise levels.
New methods encode high-cardinality string variables efficiently.
problem Efficient encoding of high-cardinality string categorical variables.
method Two approaches: Gamma-Poisson matrix factorization and min-hash encoder.
result Improves supervised learning with high-cardinality categorical variables.
Adaptive tuning of latent space for non-stationary data.
problem Learning from large, non-stationary systems with quick characteristic changes.
method Adaptive tuning of low-dimensional latent space based on real-time feedback.
result Improved prediction of time-varying charged particle beam properties.
WeldNet reduces complex dynamics to simpler, manageable segments.
problem Complex, high-dimensional time-dependent datasets from physical processes are costly to simulate.
method Windowed Encoders for Learning Dynamics, splitting time domain into windows for nonlinear dimension reduction and propagator training.
result WeldNet captures nonlinear latent structures and dynamics, outperforming existing methods.
We would like to learn latent representations that are low-dimensional and highly interpretable. A model that has these characteristics is the Gaussian Process Latent Variable Model. The benefits and negative of the GP-LVM are complementary to the Variational Autoencoder, the former provides interpretable low-dimension…
How can we effectively encode evolving information over dynamic graphs into low-dimensional representations? In this paper, we propose DyRep, an inductive deep representation learning framework that learns a set of functions to efficiently produce low-dimensional node embeddings that evolves over time. The learned embe…
ACVAEs improve on CVAEs by learning more flexible latent correlations.
problem Learning latent representations with correlated structure.
method Adaptive prior distribution and belief propagation.
result ACVAEs outperform CVAEs in link prediction and hierarchical clustering.
Mercat preserves angles to create accurate low-dimensional embeddings.
problem Reconstructing global relationships in low-dimensional embeddings.
method Reconstructing angles between data points to preserve both local and global structures.
result Mercat yields good reconstruction across various experiments and metrics.
This paper will explore the use of autoencoders for semantic hashing in the context of Information Retrieval. This paper will summarize how to efficiently train an autoencoder in order to create meaningful and low-dimensional encodings of data. This paper will demonstrate how computing and storing the closest encodings…
This paper proposes an embedding-based neural network for more accurate investment return prediction.
problem Accurately predicting investment returns requires understanding industry knowledge and news, as well as leveraging relevant theories.
method The approach uses embedding to encode investment IDs into low-dimensional vectors, leveraging dual branches to separate different information, and employs the swish activation function.
result The proposed embedding-based dual branch model outperforms traditional machine learning models like Xgboost, Lightgbm, and Catboost on the Ubiquant Market Prediction dataset.
Smooth generative model of shapes with uncertainty from silhouette images.
problem Challenges in modeling shapes represented as silhouette images due to intractable posteriors.
method Gaussian Process Deep Belief Networks (GPDBN) that learn from small data and propagate uncertainty.
result Proposed model provides favorable results compared to state-of-the-art models.
The paper explores how invertibility affects the complexity of encoder models in VAEs.
problem The complexity of the encoder model in VAEs when the generative map is invertible.
method Formalizes the concept of strong invertibility and analyzes the complexity of the encoder model.
result Strongly invertible generative maps allow for simpler encoder models, while non-invertible maps require exponentially larger encoders.
Paper proves one observation suffices for Gaussian embedding.
problem Proving theoretical underpinnings for Gaussian embedding.
method Developed first theoretical results for exponential family embedding models.
result Learned embedding structure from one observation.
node2coords learns interpretable graph node representations robust to graph perturbations.
problem Need representations that capture graph structure and are robust to perturbations.
method Proposes a graph representation learning algorithm using Wasserstein barycenters.
result Learned representations are interpretable and stable to graph perturbations.
New algorithms extract low-dimensional representations from sequential data, revealing insights into complex processes.
problem Challenges in extracting low-dimensional representations from sequential, high-dimensional, sparse, and noisy data.
method Developed new clustering algorithms based on Block Markov Chains theory, validated on real-world data.
result These algorithms can successfully extract low-dimensional representations from real-world sequential data, revealing insights into complex processes.
A novel VAE called πVAE models complex data with stochastic processes.
problem Efficient inference of stochastic processes for Bayesian deep learning with big data.
method πVAE is a finitely exchangeable, Kolmogorov consistent, continuous stochastic process VAE.
result πVAE achieves state-of-the-art performance in tasks like spatial interpolation.
Bayesian encoding improves lead scoring for WeWork using conjugate models.
problem Encoding high-cardinality categorical features for machine learning.
method Conjugate Bayesian models for categorical features, ensemble learning.
result AUC improved from 0.87 to 0.97 for WeWork's lead scoring engine.
Deterministic training improves generative autoencoder performance.
problem Stochastic training limits generative autoencoder performance.
method Invertible layers for deterministic training.
result AEFs outperform VAEs in log-likelihood and sample quality.
The manifold hypothesis states that many kinds of high-dimensional data are concentrated near a low-dimensional manifold. If the topology of this data manifold is non-trivial, a continuous encoder network cannot embed it in a one-to-one manner without creating holes of low density in the latent space. This is at odds w…
DPA preserves data distribution in reduced dimensions.
problem Loss of data distribution in dimension reduction.
method DPA combines encoder and decoder to match data distribution.
result DPA successfully reconstructs data distribution.
Autoencoders learn compressed representations via mutual information maximization.
problem Learning efficient compressed representations of high-dimensional data.
method Proposes Uncertainty Autoencoders that treat latent representations as noisy projections and optimize mutual information.
result 32% improvement in statistical compressed sensing of high-dimensional datasets.
Acoustic Neighbor Embeddings map speech and text to fixed dimensions for phonetic confusability.
problem Mapping speech and text to fixed dimensions for phonetic confusability.
method Adapting SNE to sequential inputs, training two encoder neural networks.
result More accurate results with low-dimensional embeddings in word recognition tasks.
We consider the problem of efficiently approximating and encoding high-dimensional data sampled from a probability distribution ρ in RD, that is nearly supported on a d-dimensional set M - for example supported on a d-dimensional Riemannian manifold. Geometric Multi-Resolution Analysis (GM…
PriorVAE uses VAEs to efficiently encode spatial priors for small-area estimation.
problem Efficiently encoding spatial priors for small-area estimation using Gaussian processes.
method Approximating Gaussian process priors with a variational autoencoder (VAE).
result Efficient spatial inference through a low-dimensional latent Gaussian space representation.
This paper improves uncertainty characterization in neural networks by learning latent representations.
problem Challenges in quantifying uncertainty in high-dimensional neural network parameter spaces.
method Introduces a variational inference framework for Bayesian neural networks that encodes complex distributions in a low-dimensional latent space.
result Improves uncertainty characterization and model generalization compared to methods working directly in the parameter space.
VAEs struggle with low-dimensional data; this paper shows they can learn the correct manifold.
problem Training VAEs on low-dimensional data.
method Two-stage training algorithm based on conjecture of 0 variance generator.
result VAEs can learn generators with support equal to the ground truth manifold.