Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

90180270360 · Jun 202019922001200920172026
48 results for variational interpretation

VALC provides concept-level interpretations of FLMs, overcoming word-level limitations.

problem Lack of higher-level structure interpretation in FLMs' attention weights.
method Formal definition of conceptual interpretation, variational Bayesian framework (VALC).
result VALC finds optimal language concepts for FLM predictions, providing concept-level interpretations.

This work interprets SFA through variational inference, relaxing linearity constraints.

problem Recover non-linear SFA from variational inference.
method Probabilistic interpretation of SFA through variational inference, relaxing linearity constraints.
result Reinterprets SFA as a variational framework, allowing slowness as a regularizer to reconstruction loss.

DICCA maps multi-view data into a shared latent space with interpretable components.

problem Learning from multiple related but distinct data views.
method DICCA extends CCA to deep generative networks and uses sparsity-inducing priors for interpretability.
result DICCA effectively disentangles shared and view-specific variations in multi-view data.

We develop a framework for incorporating structured graphical models in the \emph{encoders} of variational autoencoders (VAEs) that allows us to induce interpretable representations through approximate variational inference. This allows us to both perform reasoning (e.g. classification) under the structural constraints…

2016-11-22abs ↗pdf ↗

IntroVAC learns interpretable latent subspaces for better image quality.

problem Difficulties in interpreting latent spaces and limitations in image generation.
method Introspective Variational Classifier (IntroVAC) using additional labels and adversarial training.
result Improved image quality and meaningful latent directions for fine-grained manipulation.

ISVAE enhances interpretability in time series clustering using a novel filter bank.

problem Improving interpretability in time series clustering models.
method Integrates a Filter Bank (FB) into a Variational Autoencoder (VAE) to enhance interpretability and clusterability.
result ISVAE produces a more interpretable and separable encoding with enhanced clusterability.

We characterize how to vary the Abel-Jacobi map in terms of Schiffer variation. From this characterization, we will interpret the relation of hyperellipticity of curves with Schiffer variation and describe the deformation of elliptic solitons under Schiffer variation.

2011-08-27abs ↗pdf ↗

ED-VAE improves VAEs by explicitly including entropy components in ELBO.

problem Limitations of traditional VAEs with ELBO in generating high-quality samples and interpreting latent spaces.
method Introduces ED-VAE, a re-formulation of ELBO that includes entropy and cross-entropy components.
result Significantly enhances model flexibility and improves interpretability and generative performance.

We propose a novel interpretation of the collapsed variational Bayes inference with a zero-order Taylor expansion approximation, called CVB0 inference, for latent Dirichlet allocation (LDA). We clarify the properties of the CVB0 inference by using the alpha-divergence. We show that the CVB0 inference is composed of two…

2012-06-27abs ↗pdf ↗

SVGP KAN integrates sparse variational GP with KANs for scalable probabilistic inference.

problem Lack of probabilistic outputs in standard KANs and cubic scaling of Gaussian Process methods.
method Sparse Variational GP-KAN combines KAN topology with sparse variational inference and permutation-based importance analysis.
result Enables probabilistic KANs to handle larger datasets with linear computational complexity.

Geometric interpretation improves VAE performance and robustness.

problem Improving Variational Autoencoder performance and robustness.
method Introducing a geometric perspective on VAEs, sampling from the Riemannian latent space.
result Improved generation and interpolations with competitive or better performance on benchmark datasets.

In the paper "On Truncated Variation of Brownian Motion with Drift" (Bull. Pol. Acad. Sci. Math. 56 (2008), no.4, 267 - 281) we defined truncated variation of Brownian motion with drift, Wt=Bt+μt,t0,W_t = B_t + μt, t\geq 0, where (Bt)(B_t) is a standard Brownian motion. Truncated variation differs from regular variation by neglect…

2009-12-23abs ↗pdf ↗

SVGP KAN integrates uncertainty quantification into Kolmogorov-Arnold networks.

problem Uncertainty quantification in scientific machine learning models.
method Sparse variational Gaussian process inference with Kolmogorov-Arnold topology.
result Demonstrated ability to distinguish aleatoric and epistemic uncertainty in various scientific applications.

VICE embeds concepts in a vector space using human data.

problem Developing numerical models for mental representations of object concepts.
method Variational Interpretable Concept Embeddings (VICE) using variational inference and triplet odd-one-out task data.
result VICE outperforms SPoSE at predicting human behavior and provides more reproducible object representations.

In this paper, we provide an information-theoretic interpretation of the Vector Quantized-Variational Autoencoder (VQ-VAE). We show that the loss function of the original VQ-VAE can be derived from the variational deterministic information bottleneck (VDIB) principle. On the other hand, the VQ-VAE trained by the Expect…

2018-08-02abs ↗pdf ↗

This paper refines human labeling as a measurement process, revealing four sources of variation.

problem Systematic variation in human labeling obscures model learning.
method Introduces a statistical framework to decompose labeling outcomes.
result Empirical evidence for four components of labeling variation.

Extends V-IP framework to use LLMs for generating task-relevant concepts, improving interpretability and performance.

problem Limited applicability of V-IP to small-scale tasks due to manual data annotation.
method Integrates Foundational Models with Large Language and Multimodal Models to generate and annotate concepts.
result FM+V-IP achieves better test performance with fewer concepts/queries compared to other frameworks.

Physics models integrated into VAEs improve generative performance and extrapolation.

problem Improving generative models with interpretability and robustness.
method Physics-based latent space in VAEs with regularized learning to balance physics and neural network components.
result Generative performance and extrapolation improvements demonstrated on synthetic and real-world datasets.

We show that unconverged stochastic gradient descent can be interpreted as a procedure that samples from a nonparametric variational approximate posterior distribution. This distribution is implicitly defined as the transformation of an initial distribution by a sequence of optimization updates. By tracking the change …

2015-04-06abs ↗pdf ↗

Method generates natural ECGs with 25 interpretable features.

problem Lack of labeled ECGs for supervised learning and automatic diagnostics.
method Variational autoencoder for ECG generation and feature extraction.
result Low Maximum Mean Discrepancy (0.00383) indicates good ECG generation quality.

Improved GPLVM model for single-cell RNA-seq data.

problem Lack of effective scalable models for clustering cell types in large-scale single-cell RNA-seq data.
method Introduces amortized stochastic variational Bayesian GPLVM (BGPLVM) tailored for single-cell RNA-seq.
result Matches the performance of scVI on synthetic and real-world datasets and reveals more interpretable latent structures.

p3^3VAE combines physics and machine learning for robust data representations.

problem Improving machine learning models' robustness to environmental factors of variation.
method Physics-informed variational autoencoder integrating physical knowledge with neural networks.
result p3^3VAE outperforms competing models in extrapolation and interpretability.

The paper studies stability of discrete planar curves using variational methods.

problem Stability of discrete planar curves under area constraints.
method Unified interpretation of discrete curvatures, determination of equilibrium curves, stability analysis.
result Equilibrium curves for the length functional under area-constraint conditions are determined and their stability is studied.

A new method for making interpretable predictions by sequentially asking questions, faster and more efficient.

problem Developing interpretable machine learning models for complex tasks.
method Variational Information Pursuit (V-IP) that bypasses the need for learning generative models.
result V-IP is 10-100x faster and finds shorter query chains compared to IP and reinforcement learning.

In this paper we continue the investigation of Loday's Leibniz cohomology as a new invariant for differentiable manifolds. In particular the Leibniz coboundary of a k-tensor (in the sense of differential geometry) is computed in a local coordinate chart and then interpreted in terms of the calculus of variations. For e…

1998-08-06abs ↗pdf ↗

We construct a function of the edge-lengths of a triangulated surface whose variation under a rescaling of all the edges that meet at a vertex is the defect angle at that vertex. We interpret this function as a gravitational effective action on the triangulation, and the variation as a trace anomaly.

2005-12-22abs ↗pdf ↗

New method uses VAEs to generate financial correlation matrices for credit portfolio VaR analysis.

problem Quantifying credit portfolio sensitivity to asset correlations.
method Employing Variational Autoencoders (VAEs) to generate synthetic financial correlation matrices.
result The VAE latent space captures crucial factors impacting portfolio diversification, especially in credit portfolio sensitivity to asset correlations.

A 'Liouville structure' is a structure isomorphic to a cotangent vector fibration. A Liouville structure is an essential ingredient of every variational formulation of a physical theory. For reasons of interpretation the Liouville structure can not be replaced by the corresponding cotangent fibration. We give a precise…

2008-06-08abs ↗pdf ↗

In this paper, the dual Orlicz curvature measure is proposed and its basic properties are provided. A variational formula for the dual Orlicz-quermassintegral is established in order to give a geometric interpretation of the dual Orlicz curvature measure. Based on the established variational formula, a solution to the …

2017-03-20abs ↗pdf ↗

SAVAE uses deep learning for survival analysis, improving model performance and interpretability.

problem Complex medical data with censoring and covariate interactions.
method SAVAE is a Variational Autoencoder tailored for survival analysis, using a novel ELBO formulation.
result SAVAE outperforms state-of-the-art techniques in various datasets, demonstrating robustness and interpretability.

A framework for disentangling class-related and class-independent factors in data.

problem Learning disentangled representations in variational autoencoders.
method Attention mechanism in latent space, mixture models, Bhattacharyya coefficient, semi-supervised training.
result Disentangles class-related and class-independent factors of variation.

The standard interpretation of importance-weighted autoencoders is that they maximize a tighter lower bound on the marginal likelihood than the standard evidence lower bound. We give an alternate interpretation of this procedure: that it optimizes the standard variational lower bound, but using a more complex distribut…

2017-04-10abs ↗pdf ↗

Proposes a new model for directed graphs combining deep learning and latent variable models.

problem Graph representation learning for directed graphs.
method Deep Latent Space Model (DLSM) integrating GCN encoder and stochastic decoder with hierarchical variational auto-encoder architecture.
result Achieves state-of-the-art performance on link prediction and community detection tasks.

VDA improves disentanglement of latent representations in complex signals.

problem Learning disentangled and interpretable representations in nonstationary, high-dimensional time-evolving signals.
method Variational decomposition autoencoding (VDA) framework, incorporating signal decomposition, contrastive self-supervised task, and variational prior approximation.
result DecVAEs surpass state-of-the-art VAE-based methods in disentanglement quality and generalization.

We develop a general variational inference method that preserves dependency among the latent variables. Our method uses copulas to augment the families of distributions used in mean-field and structured approximations. Copulas model the dependency that is not captured by the original variational distribution, and thus …

2015-06-10abs ↗pdf ↗

UT module refines VAE latent space, improving disentanglement and interpretability.

problem Irregular latent distributions cause posterior collapse and misalignment in VAEs.
method UT module uses G-KDE clustering, GM modeling, and PIT to transform latent space into uniform distribution.
result UT module enhances disentanglement and interpretability of latent representations.

Recent efforts on combining deep models with probabilistic graphical models are promising in providing flexible models that are also easy to interpret. We propose a variational message-passing algorithm for variational inference in such models. We make three contributions. First, we propose structured inference network…

2018-03-15abs ↗pdf ↗