Proposes a method to enhance multi-view learning by maximizing higher order correlations.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Biological neurons learn tensor decompositions of higher-order correlations using nonlinear Hebbian plasticity.
Many nonlinear extensions of the Kalman filter, e.g., the extended and the unscented Kalman filter, reduce the state densities to Gaussian densities. This approximation gives sufficient results in many cases. However, this filters only estimate states that are correlated with the observation. Therefore, sequential esti…
TGCCA analyzes higher-order tensors using orthogonal rank-R CP decomposition.
A new method captures higher-order interactions in data clusters.
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
Neural networks learn faster with correlated latent variables.
This work generalizes transformer attention to capture higher-order correlations efficiently.
Study quantifies how LLMs capture higher-order statistical structure using cumulant expansion.
New tensor framework connects Fisher information, hypergraphs, and multi-observable correlations.
The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order corr…
First passage models, where corporate assets undergo correlated random walks and a company defaults if its assets fall below a threshold provide an attractive framework for modeling the default process. Typical one year default correlations are small, i.e., of order a few percent, but nonetheless including correlations…
Study neural networks by mapping correlations, revealing essential statistics.
For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two primary drawbacks: they either lack the ability to model high-order correlations…
Study higher-order spin glass models for social network behavior with peer-group effects.
To date, the instability of prognostic predictors in a sparse high dimensional model, which hinders their clinical adoption, has received little attention. Stable prediction is often overlooked in favour of performance. Yet, stability prevails as key when adopting models in critical areas as healthcare. Our study propo…
Dynamic Vine Copulas detect and quantify time-varying higher-order interactions in multivariate systems.
This paper improves multi-label classification by leveraging high-order label correlations.
Memory capacity of DAM scales exponentially with feature separation, unaffected by correlations.
In an efficient stock market, the log-returns and their time-dependent variances are often jointly modelled by stochastic volatility models (SVMs). Many SVMs assume that errors in log-return and latent volatility process are uncorrelated, which is unrealistic. It turns out that if a non-zero correlation is included in …
Neural networks can learn from higher-order cumulants efficiently, requiring quadratic samples.
Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations are correlated according to an undirected network. Under this model, we develop a …
The paper describes correlations of spectra for higher rank Anosov representations.
RFMs transition from linear to nonlinear under specific input-label correlation.
The moments of spatial probabilistic systems are often given by an infinite hierarchy of coupled differential equations. Moment closure methods are used to approximate a subset of low order moments by terminating the hierarchy at some order and replacing higher order terms with functions of lower order ones. For a give…
Study examines NFT market dynamics using correlation and noise analysis.
New method interprets quantum many-body snapshots for phase detection.
New method combines hypergraph structure and node attributes for better community detection.
Study reveals structural differences in financial networks near and far from crises using balance theory.
Study on martingale property and moment explosions in signature volatility models.
Feature selection has attracted significant attention in data mining and machine learning in the past decades. Many existing feature selection methods eliminate redundancy by measuring pairwise inter-correlation of features, whereas the complementariness of features and higher inter-correlation among more than two feat…
The correlated stochastic volatility models constitute a natural extension of the Black and Scholes-Merton framework: here the volatility is not a constant, but a stochastic process correlated with the price log-return one. At present, several stochastic volatility models are discussed in the literature, differing in t…
A two-layer neural network model that systematically includes correlations among input variables to arbitrary order and is designed to implement Bayes inference has been adapted to classify breast cancer tumors as malignant or benign, assigning a probability for either outcome. The inputs to the network represent measu…
We consider a market model that consists of financial investors and producers of a commodity. Producers optionally store some production for future sale and go short on forward contracts to hedge the uncertainty of the future commodity price. Financial investors take positions in these contracts in order to diversify t…
Weak correlations explain linear dynamics in deep learning models.
Overcomplete latent representations have been very popular for unsupervised feature learning in recent years. In this paper, we specify which overcomplete models can be identified given observable moments of a certain order. We consider probabilistic admixture or topic models in the overcomplete regime, where the numbe…
In many real-world applications, data are often unlabeled and comprised of different representations/views which often provide information complementary to each other. Although several multi-view clustering methods have been proposed, most of them routinely assume one weight for one view of features, and thus inter-vie…
In this paper we provide evidence that financial option markets for equity indices give rise to non-trivial dependency structures between its constituents. Thus, if the individual constituent distributions of an equity index are inferred from the single-stock option markets and combined via a Gaussian copula, for examp…
The diagonal effect of orders is well documented in different markets, which states that orders are more likely to be followed by orders of the same aggressiveness and implies the presence of short-term correlations in order flows. Based on the order flow data of 43 Chinese stocks, we investigate if there are long-rang…
In this paper we build on previous work which uses inferences techniques, in particular Markov Chain Monte Carlo (MCMC) methods, to solve parameterized control problems. We propose a number of modifications in order to make this approach more practical in general, higher-dimensional spaces. We first introduce a new tar…
New method shows fully-connected networks can learn convolutional structures from data.
We analyze daily prices of 29 commodities and 2449 stocks, each over a period of years. We find that the price fluctuations for commodities have a significantly broader multifractal spectrum than for stocks. We also propose that multifractal properties of both stocks and commodities can be attributed mainl…
Paper proposes a new LSTM model for spatio-temporal learning.
We develop a normative framework for hierarchical model-based policy optimization based on applying second-order methods in the space of all possible state-action paths. The resulting natural path gradient performs policy updates in a manner which is sensitive to the long-range correlational structure of the induced st…
In this study, we tested the interaction effect of multimodal datasets using a novel method called the kernel method for detecting higher order interactions among biologically relevant mulit-view data. Using a semiparametric method on a reproducing kernel Hilbert space (RKHS), we used a standard mixed-effects linear mo…
The generalized correlation approach, which has been successfully used in statistical radio physics to describe non-Gaussian random processes, is proposed to describe stochastic financial processes. The generalized correlation approach has been used to describe a non-Gaussian random walk with independent, identically d…
In topic modeling, many algorithms that guarantee identifiability of the topics have been developed under the premise that there exist anchor words -- i.e., words that only appear (with positive probability) in one topic. Follow-up work has resorted to three or higher-order statistics of the data corpus to relax the an…
Proposes a new framework to manage venture capital portfolio risk by focusing on deal-level correlations.