Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

88177265353 · Jun 202019922001200920172026
48 results for latent knowledge

Semantic TrueLearn uses semantic graphs to improve educational recommendation systems.

problem Challenges in handling semantic and hierarchical structure in knowledge areas.
method Introduces a novel learner model that exploits semantic relatedness between knowledge components using a Wikipedia link graph.
result Achieves statistically significant improvements in predictive performance for educational engagement.

Paper presents new algorithms for causal discovery with latent variables and overlapping datasets.

problem Causal discovery with latent variables and overlapping datasets.
method Introduces tiered FCI and tIOD algorithms for constraint-based causal discovery.
result The tIOD algorithm is more efficient and informative than the IOD algorithm.

In most cases deep learning architectures are trained disregarding the amount of operations and energy consumption. However, some applications, like embedded systems, can be resource-constrained during inference. A popular approach to reduce the size of a deep learning architecture consists in distilling knowledge from…

2019-11-08abs ↗pdf ↗

Recent advances in analysis of subband amplitude envelopes of natural sounds have resulted in convincing synthesis, showing subband amplitudes to be a crucial component of perception. Probabilistic latent variable analysis is particularly revealing, but existing approaches don't incorporate prior knowledge about the ph…

2018-02-02abs ↗pdf ↗

New method uses cycle consistency to enforce invariance in latent space.

problem Learning meaningful and independent factors of variation in datasets.
method Two separate latent subspaces, cycle consistency constraints, deep information bottleneck.
result Identifies more meaningful factors leading to sparser and interpretable models.

Proposes a method to derive knowledge graphs from EHR data.

problem Challenges in deriving generalizable knowledge from EHR data.
method Infer conditional dependency structure via a latent graphical block model (LGBM).
result Perfect recovery of block structure demonstrated.

SLED improves factuality in LLMs without external knowledge.

problem Unreliable or factually incorrect outputs from large language models.
method Contrasts final layer logits with early layers' logits, uses approximate gradient to refine outputs.
result Consistently improves factual accuracy over existing methods.

Bayesian framework integrates prior and data knowledge for nonlinear dynamical systems.

problem Fusing diverse prior knowledge with data for accurate model learning.
method General-purpose Bayesian inference and learning framework combining explicit and implicit prior knowledge.
result Efficient parameter marginalization and closed-form densities for online and offline inference.

The paper proposes a deep generative model for complex disease trajectories.

problem Modeling and analyzing complex disease trajectories.
method Deep generative time series approach with semi-supervised latent processes.
result The model can discover novel aspects of diseases and cluster them into new sub-types.

TASID learns policies in high-dimensional settings with abstract simulator knowledge.

problem RL in high-dimensional settings with limited observation knowledge.
method TASID algorithm for transfer RL from abstract simulator with bounded perturbations.
result Sample complexity polynomial in horizon, independent of number of states.

MuVI models multi-view data with structured sparsity, integrating domain knowledge.

problem Disentangling variation across multiple data views in complex systems.
method Multi-view latent variable model with structured sparsity using a modified horseshoe prior.
result MuVI outperforms state-of-the-art methods in structured sparsity modeling and integrates noisy domain expertise.

Deep NLP models benefit from underlying structures in the data---e.g., parse trees---typically extracted using off-the-shelf parsers. Recent attempts to jointly learn the latent structure encounter a tradeoff: either make factorization assumptions that limit expressiveness, or sacrifice end-to-end differentiability. Us…

2018-09-03abs ↗pdf ↗

Relational machine learning studies methods for the statistical analysis of relational, or graph-structured, data. In this paper, we provide a review of how such statistical models can be "trained" on large knowledge graphs, and then used to predict new facts about the world (which is equivalent to predicting new edges…

2015-03-02abs ↗pdf ↗

New approach identifies latent properties from mechanisms, not just data.

problem Identifying latent properties from data generating processes.
method Equivariance perspective on identifiable representation learning.
result Identification of latent properties is possible up to shared equivariances in known mechanisms.

DBULL learns new clusters without forgetting past knowledge in streaming unlabelled data.

problem Challenges in Unsupervised Lifelong Learning with evolving data distributions and class labels.
method Bayesian framework for incremental learning, Deep Bayesian Unsupervised Lifelong Learning (DBULL) algorithm, knowledge preservation mechanism, automatic cluster discovery.
result DBULL can progressively discover new clusters without forgetting past knowledge in unlabelled data.

The abstract explains how word and relation representations capture semantic meaning.

problem Understanding how word and relation representations capture semantic meaning.
method Theoretical justification and extension of geometric relationships between word embeddings and knowledge graph representations.
result The geometric relationships between word embeddings correspond to semantic relations between words and entities in knowledge graphs.

Hybrid models combine domain knowledge and data-driven learning for Earth observation.

problem Challenges in modelling Earth observation data with either purely mechanistic or data-driven methods.
method Gaussian process convolution models, specifically latent force models (LFMs), integrating physical knowledge into multioutput GP models.
result Model automatically estimates soil moisture persistence and discovers latent forces related to precipitation.

Transfer learning for bandits with latent Lipschitz continuity.

problem Learning to transfer structural information from prior tasks to new tasks.
method Proposes a framework to estimate Lipschitz constant from prior tasks and apply it to new tasks.
result Regret bound close to oracle algorithm with full knowledge of Lipschitz constant under mild assumptions.

We analyze the necessary and sufficient conditions for exact inference of a latent model. In latent models, each entity is associated with a latent variable following some probability distribution. The challenging question we try to solve is: can we perform exact inference without observing the latent variables, even w…

2019-01-28abs ↗pdf ↗

Study improves interpretability in generative models by disentangling latent variables in scientific datasets.

problem Extracting generative factors from complex, high-dimensional datasets in unsupervised or semi-supervised settings.
method Introducing Aux-VAE, a novel architecture within the VAE framework, which disentangles latent variables by guiding them with auxiliary variables.
result Aux-VAE achieves disentanglement with minimal modifications to the standard VAE loss function, validated on multiple datasets.

Enhances OOD detection using latent diffusion for more robust and efficient training.

problem Improving reliability of machine learning models in real-world scenarios.
method Proposes Outlier-Aware Learning (OAL) framework that generates synthetic OOD data in latent space and uses MICL and KD modules.
result Demonstrates superior performance on benchmark datasets.

AGFN improves causal discovery by integrating expert feedback and handling latent confounding.

problem Inaccurate causal discovery due to unreliable expert knowledge and latent confounding.
method Ancestral GFlowNet (AGFN) is a reinforcement learning algorithm that iteratively refines a policy based on noisy expert feedback to infer ancestral graphs.
result AGFN converges to the true ancestral graph given accurate expert responses and outperforms baselines in structural Hamming distance and Bayesian Information Criterion.

Random geometric graphs are a popular choice for a latent points generative model for networks. Their definition is based on a sample of nn points X1,X2,,XnX_1,X_2,\cdots,X_n on the Euclidean sphere~Sd1\mathbb{S}^{d-1} which represents the latent positions of nodes of the network. The connection probabilities between the node…

2019-09-15abs ↗pdf ↗

Knowledge graphs, on top of entities and their relationships, contain other important elements: literals. Literals encode interesting properties (e.g. the height) of entities that are not captured by links between entities alone. Most of the existing work on embedding (or latent feature) based knowledge graph analysis …

2018-02-03abs ↗pdf ↗

Observed associations in a database may be due in whole or part to variations in unrecorded (latent) variables. Identifying such variables and their causal relationships with one another is a principal goal in many scientific and practical domains. Previous work shows that, given a partition of observed variables such …

2012-10-19abs ↗pdf ↗

Bayesian model enhances phenotype discovery in asthma EHRs.

problem Lack of interpretability in unsupervised learning phenotyping of EHR data.
method Operationalized a Bayesian latent class framework with clinical knowledge priors.
result Identified an asthma sub-phenotype with elevated eosinophil levels and allergy markers.

Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as targets waiting to be solved. Most existing efforts tackle target domains separa…

2017-11-09abs ↗pdf ↗

Researchers identify latent variables and causal structures from nonlinear hierarchical models.

problem Challenging task of identifying latent variables and causal structures from observational data, especially when relationships are nonlinear.
method Investigated nonlinear latent hierarchical causal models, developed identification criterion, and constructed an estimation procedure.
result Identifiability of causal structures and latent variables achieved under mild assumptions.

Multitask Gaussian process (MTGP) is powerful for joint learning of multiple tasks with complicated correlation patterns. However, due to the assembling of additive independent latent functions, all current MTGPs including the salient linear model of coregionalization (LMC) and convolution frameworks cannot effectively…

2018-08-03abs ↗pdf ↗

While physics conveys knowledge of nature built from an interplay between observations and theory, it has been considered less importantly in deep neural networks. Especially, there are few works leveraging physics behaviors when the knowledge is given less explicitly. In this work, we propose a novel architecture call…

2019-02-08abs ↗pdf ↗

Unified framework for disentangled VAEs improves latent space interpretability.

problem Challenges in evaluating and interpreting latent representations, especially for diverse data types.
method Unified bfVAE framework, FVH-LT, DBSR-LS, GAS, LSSI.
result bfVAE provides more favorable trade-off between disentanglement and reconstruction.

Proposes a method to generate realistic counterfactuals by learning relationships.

problem Counterfactual explanations often ignore intrinsic relationships between data attributes.
method Uses a variational auto-encoder to learn relationships and perturb the latent space.
result The model preserves relationships and generates realistic counterfactuals.