A new method learns outcome-aware spectral features for causal effect estimation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A Python package solves source duplication in single channel LVMs using spectral regularisation.
Spectral feature learning improves IV regression for causal effect estimation.
Spectral learning extends matrix methods to tensors for better latent variable modeling.
Spectral methods have greatly advanced the estimation of latent variable models, generating a sequence of novel and efficient algorithms with strong theoretical guarantees. However, current spectral algorithms are largely restricted to mixtures of discrete or Gaussian distributions. In this paper, we propose a kernel m…
This work considers the problem of learning the structure of multivariate linear tree models, which include a variety of directed tree graphical models with continuous, discrete, and mixed latent variables such as linear-Gaussian models, hidden Markov models, Gaussian mixture models, and Markov evolutionary trees. The …
A novel graph spectral method for mixed categorical and numerical data.
We introduce a general setting for multidimensional dispersionless integrable hierarchy in terms of differential -form with the coefficients satisfying the Plücker relations, which is gauge-invariantly closed and its gauge-invariant coordinates (ratios of coefficients) are (locally) holomorphic with respect to…
Spectral sparsification improves Gaussian graphical models under MTP2 constraints.
In this work, the possibility of clustering correlated random variables was examined, both because of their mutual similarity and because of their similarity to the principal components. The k-means algorithm and spectral algorithms were used for clustering. For spectral methods, the similarity matrix was both the matr…
Estimates linear model from noisy covariates and instruments using spectral regularization.
The paper analyzes graph Laplacians on manifolds with curvature bounds and applies to non-collapsed spaces.
Spectral variability is one of the major issue when conducting hyperspectral unmixing. Within a given image composed of some elementary materials (herein referred to as endmember classes), the spectral signature characterizing these classes may spatially vary due to intrinsic component fluctuations or external factors …
We show that, when considering the scaling factor as an affine variable, the coefficients of the asymptotic expansion of the spectral action on a (Euclidean) Robertson-Walker spacetime are periods of mixed Tate motives, involving relative motives of complements of unions of hyperplanes and quadric hypersurfaces and div…
We study the problem of selecting a subset of k random variables from a large set, in order to obtain the best linear prediction of another variable of interest. This problem can be viewed in the context of both feature selection and sparse approximation. We analyze the performance of widely used greedy heuristics, usi…
A common assumption in multiple scientific applications is that the distribution of observed data can be modeled by a latent tree graphical model. An important example is phylogenetics, where the tree models the evolutionary lineages of a set of observed organisms. Given a set of independent realizations of the random …
We prove two-sided inequalities for the -norm of a pushforward or pullback (with respect to an orientation-preserving diffeomorphism) on oriented volume and Riemannian manifolds. For a function or density on a volume manifold, these bounds depend only on the Jacobian determinant, which arises through the change of…
Paper combines geometry and time-series analysis for spatiotemporal data.
This paper presents an algorithm for the unsupervised learning of latent variable models from unlabeled sets of data. We base our technique on spectral decomposition, providing a technique that proves to be robust both in theory and in practice. We also describe how to use this algorithm to learn the parameters of two …
Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or belongs to a parametric family. In this paper, we study the estimation of an $m…
Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to design a new kernel for MOGPs, by modeling cross channel dependencies through cross convolution of t…
Develops methods to estimate high rank tensors from noisy data.
We take a look the changes of different asset prices over variable periods, using both traditional and spectral methods, and discover universality phenomena which hold (in some cases) across asset classes.
We use refined spectral sequence arguments to calculate known and previously unknown bi-Hamiltonian cohomology groups, which govern the deformation theory of semi-simple bi-Hamiltonian pencils of hydrodynamic type with one independent and \( N\) dependent variables. In particular, we rederive the result of Dubrovin-Liu…
Supervised topic models simultaneously model the latent topic structure of large collections of documents and a response variable associated with each document. Existing inference methods are based on variational approximation or Monte Carlo sampling, which often suffers from the local minimum defect. Spectral methods …
A new polynomial invariant for strongly involutive links.
New algorithm learns low-rank matrices with linear number of samples.
Spectral Graph Convolutional Networks (GCNs) are a generalization of convolutional networks to learning on graph-structured data. Applications of spectral GCNs have been successful, but limited to a few problems where the graph is fixed, such as shape correspondence and node classification. In this work, we address thi…
We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive) latent variable models such as hidden Markov models, POMDPs are more challenging…
We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive) latent variable models such as hidden Markov models, POMDPs are more challenging…
The dictionary-aided sparse regression (SR) approach has recently emerged as a promising alternative to hyperspectral unmixing (HU) in remote sensing. By using an available spectral library as a dictionary, the SR approach identifies the underlying materials in a given hyperspectral image by selecting a small subset of…
Learning general latent-variable probabilistic graphical models is a key theoretical challenge in machine learning and artificial intelligence. All previous methods, including the EM algorithm and the spectral algorithms, face severe limitations that largely restrict their applicability and affect their performance. In…
New method optimizes portfolios for non-stationary markets.
Study confirms learning rates for vector-valued spectral algorithms, proving consistency.
Neural Chaos uses neural networks instead of polynomials for stochastic modeling.
This paper re-visits the spectral method for learning latent variable models defined in terms of observable operators. We give a new perspective on the method, showing that operators can be recovered by minimizing a loss defined on a finite subset of the domain. A non-convex optimization similar to the spectral method …
In this paper, we study the confounder detection problem in the linear model, where the target variable is predicted using its potential causes . Based on an assumption of rotation invariant generating process of the model, recent study shows that the spectral measure induced by the regress…
This paper concerns the numerical solution of the finite-horizon Optimal Investment problem with transaction costs under Potential Utility. The problem is initially posed in terms of an evolutive HJB equation with gradient constraints. In Finite-Horizon Optimal Investment with Transaction Costs: A Parabolic Double Obst…
In this paper, we propose guaranteed spectral methods for learning a broad range of topic models, which generalize the popular Latent Dirichlet Allocation (LDA). We overcome the limitation of LDA to incorporate arbitrary topic correlations, by assuming that the hidden topic proportions are drawn from a flexible class o…
We develop a latent variable model and an efficient spectral algorithm motivated by the recent emergence of very large data sets of chromatin marks from multiple human cell types. A natural model for chromatin data in one cell type is a Hidden Markov Model (HMM); we model the relationship between multiple cell types by…
New method compresses non-Gaussian distributions exponentially.
Framework clusters noisy MTS with robust fuzzy clustering, improving accuracy over existing methods.
Enhances GPLVM for multi-view data with scalable latent representation learning.
Current studies about motor imagery based rehabilitation training systems for stroke subjects lack an appropriate analytic method, which can achieve a considerable classification accuracy, at the same time detects gradual changes of imagery patterns during rehabilitation process and disinters potential mechanisms about…
We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency under relatively mild conditions on the design matrix. We then demonstrate that t…
A novel 3D shape registration method using spectral graph embedding and probabilistic matching.
The paper tackles model collapse in GPLVMs by improving kernel flexibility and projection variance.
This paper proposes a new Nystrom-based clustering algorithm for large-scale data.