We show how to analyze and interpret the correlation structures, the conditional expectation values and correlation coefficients of exchangeable Bernoulli random variables. We study implied default distributions for the iTraxx-CJ tranches and some popular probabilistic models, including the Gaussian copula model, Beta …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “structured correlation”
CSTS benchmarks time series clustering by evaluating correlation structures.
problem Lack of validated ground truth for objectively assessing clustering quality.
method Synthetic benchmark CSTS for evaluating correlation structures in multivariate time series data.
result CSTS enables precise diagnosis of methodological limitations in correlation-based time series clustering.
Zooming into market statesq-fin.ST
We analyze the daily stock data of the Nasdaq Composite index in the 22-year period 1992-2013 and identify market states as clusters of correlation matrices with similar correlation structures. We investigate the stability of the correlation structure of each state by estimating the statistical fluctuations of correlat…
This study analyzes the correlation structure of global agricultural futures markets using RMT.
problem Understanding the complex correlation structure of global agricultural futures markets.
method Random Matrix Theory (RMT) applied to analyze correlation coefficients and eigenvalues.
result The correlation structure is asymmetric and right skewed, with significant eigenvalues indicating market effects and commodity groups.
Proposes a multi-view VAE for imputing missing data from correlated sources.
problem Imputing missing data from multi-view sources with latent space correlation.
method Enforces a joint prior with latent space correlation between VAEs trained on each view.
result More strongly correlated latent spaces are uncovered, enabling effective imputation.
Study analyzes correlation structure in two-factor Hull-White model for XVA calculations.
problem Capturing the correlation structure in two-factor Hull-White model for accurate XVA calculations.
method Combination of approximation formula and Monte-Carlo simulation to investigate correlation structure.
result Hull-White model effectively captures de-correlation of the yield curve under specific parameter conditions.
The evolution with time of the correlation structure of equity returns is studied by means of a filtered network approach investigating persistences and recurrences and their implications for risk diversification strategies. We build dynamically Planar Maximally Filtered Graphs from the correlation structure over a rol…
Model explains Netflix Prize success with structured correlation.
problem Understanding structured correlation in high-dimensional data.
method Developed a new statistical learning model.
result Characterized learnability in terms of VCN-dimension.
Paper defines conditions for feasible correlation matrices from factor structures.
problem Feasibility of option implied correlation matrices in non-FX markets.
method Quantitative and economic approaches to solve the nearest correlation matrix problem.
result Introduces methods to ensure feasible correlation matrices from factor structures.
Graph Canonical Correlation Analysis improves CCA for multiomics datasets.
problem Limited ability of conventional CCA methods to incorporate structured patterns in cross-correlation matrices.
method Graph Canonical Correlation Analysis (gCCA) calculates canonical correlations based on the graph structure of cross-correlation matrices.
result gCCA outperforms competing CCA methods in simulations and multiomics dataset analysis.
We report evidence of a deep interplay between cross-correlations hierarchical properties and multifractality of New York Stock Exchange daily stock returns. The degree of multifractality displayed by different stocks is found to be positively correlated to their depth in the hierarchy of cross-correlations. We propose…
Spectral denoising recovers meaningful network structure from noisy financial correlations.
problem Noise in empirical correlation matrices from financial returns obscures genuine interactions.
method Spectral decomposition to separate structured and random components.
result Structured networks derived from 10-16 eigenmodes exhibit stronger core-periphery organization and scale-free degree distributions.
This paper analyzes correlations in patterns of trading of different members of the London Stock Exchange. The collection of strategies associated with a member institution is defined by the sequence of signs of net volume traded by that institution in hour intervals. Using several methods we show that there are signif…
Efficient algorithm for matching graphs with community structure.
problem Graph matching between correlated stochastic block models with constant correlation.
method Partition trees rooted from each vertex, comparing edge statistics to different communities.
result First low-order polynomial-time algorithm achieving exact matching with high probability in dense graphs.
A trend in compressed sensing (CS) is to exploit structure for improved reconstruction performance. In the basic CS model, exploiting the clustering structure among nonzero elements in the solution vector has drawn much attention, and many algorithms have been proposed. However, few algorithms explicitly consider corre…
New methods test correlation between network structure and node features.
problem Assessing correlation between network structure and node-level covariates.
method Four novel methods based on linear models and canonical correlation analysis.
result Theoretical guarantees and computational efficiency for testing network dependency.
We study the structure of locational marginal prices in day-ahead and real-time wholesale electricity markets. In particular, we consider the case of two North American markets and show that the price correlations contain information on the locational structure of the grid. We study various clustering methods and intro…
Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed Correlated Variational Auto-Encoders (CVAEs), which employ a structured mixture model as …
New trees-based models handle correlated data better.
problem Standard trees-based models ignore correlation structure.
method Explicitly accounts for correlation structure in splitting criterion, stopping rules, and fitted values.
result New approach superior to standard models in simulations and real data.
Clusters cryptocurrency market states via cross correlation analysis.
problem Analyse cryptocurrency market dynamics.
method Cross correlation structure analysis over 5 years.
result Cryptocurrency market clusters into 4 states.
Proposes a model to detect changes in multivariate time series data.
problem Detect abrupt changes in multivariate time series data considering dependencies and correlations.
method Integrates graph neural networks into an encoder-decoder framework to model correlation structures and dynamics.
result Advantageous performance on CPD tasks over strong baselines, classifying changes as correlation or independent.
Review of correlation-based financial networks and entropy measures.
problem Understanding the dynamics of financial markets through correlation networks.
method Analysis of empirical correlation matrices and entropy measures.
result Entropy measures help in continuous monitoring of financial networks.
Unified framework for generating data by modeling causal and correlational dependencies.
problem Modeling both causal and correlational dependencies among latent factors.
method Causal-Correlation Variational Autoencoder (C2VAE) framework.
result Improves generation quality, disentanglement, and intervention fidelity.
CaLoNet integrates spatial and local correlations for multivariate time series classification.
problem Ignoring spatial and local correlations in multivariate time series classification.
method Model spatial correlations using causality modeling, extract local correlations, integrate into graph neural network.
result Competitive performance compared to state-of-the-art methods on UEA datasets.
Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the correlations between data points, which might be crucial for learning latent representa…
With the random matrix theory, we study the spatial structure of the Chinese stock market, American stock market and global market indices. After taking into account the signs of the components in the eigenvectors of the cross-correlation matrix, we detect the subsector structure of the financial systems. The positive …
We study power-law correlations properties of the Google search queries for Dow Jones Industrial Average (DJIA) component stocks. Examining the daily data of the searched terms with a combination of the rescaled range and rescaled variance tests together with the detrended fluctuation analysis, we show that the searche…
Model forecasts market structure from financial networks using machine learning.
problem Predicting market correlation structure from financial networks.
method Dynamic Asset Graph (DAG), Dynamic Minimal Spanning Tree (DMST), Dynamic Threshold Networks (DTN).
result Model improves market structure forecasting by up to 40% over benchmarks.
The study analyzes XRP transaction networks to understand market dynamics.
problem Understanding market dynamics of XRP through transaction data.
method Weekly weighted directed networks are embedded into a vector space using network embedding techniques. A correlation tensor is calculated and analyzed using singular value decomposition.
result The correlation tensor provides insights into the system's behavior and dependence on model parameters.
For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two primary drawbacks: they either lack the ability to model high-order correlations…
Extension of SBL Algorithms for the Recovery of Block Sparse Signals with Intra-Block Correlationstat.ML
We examine the recovery of block sparse signals and extend the framework in two important directions; one by exploiting signals' intra-block correlation and the other by generalizing signals' block structure. We propose two families of algorithms based on the framework of block sparse Bayesian learning (BSBL). One fami…
A model for correlations in stock marketscond-mat.stat-mech
We propose a group model for correlations in stock markets. In the group model the markets are composed of several groups, within which the stock price fluctuations are correlated. The spectral properties of empirical correlation matrices reported in [Phys. Rev. Lett. {\bf 83}, 1467 (1999); Phys. Rev. Lett. {\bf 83}, 1…
Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations are correlated according to an undirected network. Under this model, we develop a …
Correlation matrices are omnipresent in multivariate data analysis. When the number d of variables is large, the sample estimates of correlation matrices are typically noisy and conceal underlying dependence patterns. We consider the case when the variables can be grouped into K clusters with exchangeable dependence; t…
This study analyzes cryptocurrency market dynamics using a novel -dependent detrended cross-correlation method.
problem Capturing correlations at varying fluctuation amplitudes and time scales in complex systems.
method Extends traditional metrics with -dependent detrended cross-correlation coefficient ρ(q,s) and MSTs.
result Significant shifts in network structures during major disruptions, leading to decentralized correlations.
Financial markets are highly correlated systems that reveal both the inter-market dependencies and the correlations among their different components. Standard analyzing techniques include correlation coefficients for pairs of signals and correlation matrices for rich multivariate data. In the latter case one constructs…
Bayesian method for dynamic correlation matrices improves accuracy and responsiveness.
problem Challenges in estimating time-varying correlation matrices, including slow adaptation, insufficient regularization, and diffuse uncertainty.
method Low-rank factor representation with dynamic shrinkage prior and multivariate factor stochastic volatility model.
result Improved accuracy and responsiveness compared to competing methods in various challenging scenarios.
The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order corr…
The paper analyzes Nordic stock markets' correlation structures and regime shifts.
problem Understanding and exploiting regime shifts in Nordic stock markets.
method Examined two decades of daily data for OMXS30, OMXC20, and OMXH25 universes; proposed an adaptive portfolio allocation framework.
result Documented pronounced regime dependence in rolling correlation matrices; proposed an adaptive portfolio allocation framework.
DynMSA detects market clusters for better portfolio allocation.
problem Identifying stable market clusters for effective portfolio management.
method Combining Random Matrix Theory with modularity optimization and spectral clustering.
result DynMSA outperforms baseline models in intra- and inter-cluster correlation differences.
We present an extension of sparse Canonical Correlation Analysis (CCA) designed for finding multiple-to-multiple linear correlations within a single set of variables. Unlike CCA, which finds correlations between two sets of data where the rows are matched exactly but the columns represent separate sets of variables, th…
Multivariate functional data from a complex system are naturally high-dimensional and have complex cross-correlation structure. The complexity of data structure can be observed as that (1) some functions are strongly correlated with similar features, while some others may have almost no cross-correlations with quite di…
Recent advances in topic models have explored complicated structured distributions to represent topic correlation. For example, the pachinko allocation model (PAM) captures arbitrary, nested, and possibly sparse correlations between topics using a directed acyclic graph (DAG). While PAM provides more flexibility and gr…
A New Method to Estimate the Noise in Financial Correlation Matricescond-mat.stat-mech
Financial correlation matrices measure the unsystematic correlations between stocks. Such information is important for risk management. The correlation matrices are known to be ``noise dressed''. We develop a new and alternative method to estimate this noise. To this end, we simulate certain time series and random matr…
FACTM combines FA with correlated topic modeling for structured data integration.
problem Integrating structured data modalities like text and single cell sequencing.
method Bayesian FACTM model combining FA and correlated topic modeling with variational inference.
result FACTM outperforms other methods in identifying clusters in structured data and integrating them with simple modalities.
Study on cryptocurrency trading patterns using multifractal analysis.
problem Lack of systematic study on temporal structure of cryptocurrency trading.
method Multifractal detrended cross-correlation analysis of price returns, trades, and volume.
result All analyzed quantities exhibit multifractal structure, both univariate and bivariate.
In this paper we provide evidence that financial option markets for equity indices give rise to non-trivial dependency structures between its constituents. Thus, if the individual constituent distributions of an equity index are inferred from the single-stock option markets and combined via a Gaussian copula, for examp…
Coarse graining correlation matrices according to macrostructures: Financial markets as a paradigmq-fin.ST
Financial markets analyzed by reducing correlation matrix complexity.
problem Understanding complex financial market correlations.
method Coarse graining Pearson correlation matrices into Guhr matrices by market sectors.
result Significant reduction in the number of relevant variables.