A new estimator minimizes non-zero coefficients with a budget on feature-residual correlation.
problem Sparse linear model estimation with feature-residual correlation constraints.
method Mixed Integer Linear Optimization (MILO) for certifiably optimal global solutions.
result Discrete Dantzig Selector provides globally optimal solutions faster than existing methods.
New bounds on ReLU networks for low-regular functions.
problem Bounding approximation error for ReLU networks on low-regular functions.
method Complexity analysis of Fourier features residual networks to ReLU networks.
result Approximation error bound proportional to target function norm and inversely proportional to network width and depth.
New method improves feature importance assessment in random forests.
problem Improving feature importance measures for random forests.
method Hypothesis testing via self-normalized feature-residual correlation test (FACT).
result The method provides theoretically justified feature importance tests with controlled type I error and appealing power.
RFRBoost uses random features to boost deep residual neural networks, improving performance and computational efficiency.
problem Improving performance of deep residual neural networks (RFNNs) while preserving convex optimization benefits.
method Random Feature Representation Boosting (RFRBoost) using boosting theory and random features at each layer.
result RFRBoost significantly outperforms RFNNs and end-to-end trained MLP ResNets in small- to medium-scale tabular datasets.
HTGCN improves community detection in dynamic, heterogeneous graphs.
problem Challenges in detecting communities in graphs with varying features and temporal dynamics.
method Designs HTGCN combining heterogeneous GCN and residual compressed aggregation for dynamic feature representation.
result HTGCN outperforms existing methods on DBLP and IMDB datasets.
CIRCE measures conditional independence for learning invariant features.
problem Learning invariant features while being conditionally independent of a distractor.
method CIRCE is a measure of conditional independence applied as a regularizer in feature learning.
result CIRCE provides a zero value if and only if features are conditionally independent of the distractor given the target.
Method uses random forest with distance covariance for transfer learning in healthcare.
problem Transfer learning in random forests with sparse differences between source and target.
method Distance covariance-based feature weights in residual random forest.
result Upper bound on mean square error rate for transfer learning in RF.
IITNet learns sleep stages from raw EEG using sub-epoch features and temporal contexts.
problem Automatic sleep scoring from raw single-channel EEG.
method IITNet uses a residual neural network to extract sub-epoch features and bidirectional LSTM to capture intra- and inter-epoch temporal contexts.
result IITNet achieves comparable performance to state-of-the-art methods, especially with longer sequence lengths.
Estimates potential correlations using hypercontractivity.
problem Discovering hidden correlations from data.
method Postulated natural axioms, hypercontractivity coefficient, novel estimator.
result Estimator discovers potential correlations robustly.
This work optimizes induced correlation in joint graph embeddings.
problem Optimizing correlation across embedded networks in joint graph embeddings.
method Developed corr2Omni algorithm to estimate optimal Omnibus weights.
result corr2Omni algorithm improves inference fidelity compared to classical Omnibus construction.
Letter analyzes cryptocurrency correlations with financial assets.
problem Understanding correlations among cryptocurrencies and financial assets.
method Used a generalized DCC class model to analyze conditional correlations.
result Cryptocurrency correlations are positive but vary over time.
In this paper we use wavelet concepts to show that correlation coefficient between two financial data's is not constant but varies with scale from high correlation value to strongly anti-correlation value This studies is important because correlation coefficient is used to quantify degree of independence between two va…
We analyze the daily stock data of the Nasdaq Composite index in the 22-year period 1992-2013 and identify market states as clusters of correlation matrices with similar correlation structures. We investigate the stability of the correlation structure of each state by estimating the statistical fluctuations of correlat…
This study uses local Gaussian correlation to analyze stock return tails, revealing more sensitive network properties.
problem Misleading results from Pearson correlation in financial networks.
method Local Gaussian correlation coefficient for capturing nonlinear dependence and heavy-tailed distributions.
result Local Gaussian correlation network among negative tails is more sensitive to stock market risks.
The study uses DCC for financial market analysis, revealing hidden correlations.
problem Identifying hidden nonlinear correlations in financial markets.
method Agglomerative hierarchical clustering with distance correlation coefficient.
result DCC reveals more information than Pearson correlation for financial data.
Correlated noise improves deep CNN performance on occluded images.
problem Understanding and leveraging correlated variability in neural networks.
method Implemented correlated noise models in deep convolutional neural networks, defined as a function of neuron selectivity and distance.
result Correlated noise models often improve performance on occluded images compared to other regularization techniques.
Polynomial time algorithm matches correlated Gaussian matrices without vanishing correlation.
problem Matching vertices in two correlated Erdős-Rényi graphs.
method Iterative matching algorithm for correlated Gaussian Wigner matrices.
result First polynomial time algorithm for graph matching with arbitrarily small constant correlation.
This paper treats the problem of screening for variables with high correlations in high dimensional data in which there can be many fewer samples than variables. We focus on threshold-based correlation screening methods for three related applications: screening for variables with large correlations within a single trea…
Deep LSTMs learn correlated representations of time-series data.
problem Learning nonlinear transformations and correlated embeddings of variable-length sequences.
method Use LSTMs to transform multi-view time-series data, then correlate outputs to find a fixed-dimensional representation.
result Deep LSTMs can effectively learn and project correlated representations of time-series data.
This paper introduces anti-correlation networks to study China's stock market.
problem Previous studies ignored anti-correlation in financial networks.
method Constructed weighted temporal anti-correlation and positive correlation networks.
result Unveiled differences in topological measurements between anti-correlation and positive correlation networks.
The study shows how trade uncertainty affects stock-bond correlations over time.
problem Impact of trade policy uncertainty on stock-bond correlations.
method Daily data analysis using GARCH-based models (CCC, STCC, DCC) with TPU and political dummy variables.
result Time-varying correlation models better capture the dynamics of stock-bond correlations than constant models.
Infinite CNNs lose spatial correlations, but can be restored by correlated weights.
problem Infinite CNNs lose spatial correlations, which are crucial for their performance.
method Introduced correlated weights to restore spatial correlations in infinite CNNs.
result Optimal performance is achieved with a moderate level of weight correlation.
We discuss some methods to quantitatively investigate the properties of correlation matrices. Correlation matrices play an important role in portfolio optimization and in several other quantitative descriptions of asset price dynamics in financial markets. Specifically, we discuss how to define and obtain hierarchical …
This research examines rare spurious correlations in neural networks and their impact on accuracy and privacy.
problem Rare spurious correlations in neural networks and their privacy risks.
method Introducing spurious patterns correlated with a fixed class to a few training examples, analyzing ℓ2 regularization and Gaussian noise. result Rare spurious correlations can significantly impact neural network accuracy and privacy, and specific mitigation methods can be effective.
CVAEs improve VAEs by accounting for correlations in latent representations.
problem VAEs fail to account for correlations between data points, limiting their effectiveness.
method CVAEs incorporate correlation structure into VAEs using a prior and tractable approximations.
result CVAEs outperform baseline algorithms in matching and link prediction tasks.
The study reveals how synaptic correlations promote dimension reduction in neural networks.
problem Understanding how synaptic correlations affect neural correlations and dimension reduction in deep neural networks.
method A simplified model of dimension reduction considering pairwise correlations among synapses, using mathematical self-consistency for both binary and continuous synapses.
result Weakly-correlated synapses encourage dimension reduction compared to orthogonal synapses, and they also slow down the decorrelation process.
A factor model for stress-testing correlations, focusing on large portfolios.
problem Stress-testing correlations in large portfolios to assess risk.
method Factor model using Mahalanobis distance for identifying adverse scenarios.
result Demonstrated how correlation and volatility stress tests can be combined.
Proposes PSCCA for estimating correlations and canonical correlations in sparse count data.
problem Estimating correlations and canonical correlations in sparse count data from next-generation sequencing.
method Probabilistic approach for sparse count data sets (PSCCA).
result PSCCA outperforms other methods in estimating true correlations and canonical correlations at the natural parameter level.
Develops a theory of common decomposition for correlated Brownian motions.
problem Tackles the modeling of correlated Brownian motions in financial applications.
method Uses change of time method to represent correlated Brownian motions as a triplet of processes.
result Shows equivalent conditions for the triplet being independent and proposes a new method for constructing correlated Brownian motions.
Study examines NFT market dynamics using correlation and noise analysis.
problem Understanding correlations and noise in NFT market.
method Used detrended correlation coefficient and correlation matrix analysis.
result Correlation strength in NFT market is lower than in cryptocurrency markets.
Polynomial-time algorithm matches correlated random graphs with non-vanishing correlation.
problem Matching correlated random graphs with non-vanishing edge correlation.
method Iterative algorithm for polynomial-time recovery of latent matching.
result Algorithm succeeds in recovering latent matching as long as edge correlation is non-vanishing.
Proposes a multi-view VAE for imputing missing data from correlated sources.
problem Imputing missing data from multi-view sources with latent space correlation.
method Enforces a joint prior with latent space correlation between VAEs trained on each view.
result More strongly correlated latent spaces are uncovered, enabling effective imputation.
Enhances community detection in correlated networks with node attributes.
problem Community detection in multiple networks with correlated node attributes and edges.
method Introduced the correlated Contextual Stochastic Block Model (CSBM), developed a two-step matching procedure.
result Algorithm recovers exact node correspondence, enabling enhanced community detection.
New method detects intrinsic cross-correlations in non-stationary time series affected by common factors.
problem Bias in cross-correlation analysis due to common external factors.
method Multifractal temporally weighted detrended partial cross-correlation analysis (MF-TWDPCCA).
result MF-TWDPCCA accurately detects intrinsic cross-correlations between non-stationary time series.
Develops correlation number for specific potentials and Hitchin representations.
problem Analyzing correlation numbers for potentials with entropy gaps and Hitchin representations.
method Defines a correlation number for pairs of cusped Hitchin representations and explores its connection to the Manhattan curve.
result Establishes a connection between the correlation number and the Manhattan curve, revealing rigidity properties.
The study finds significant power-law cross correlations in Bitcoin's return-volatility dynamics.
problem Investigating asymmetry in Bitcoin's return-volatility relationships.
method Analysis of daily and high-frequency Bitcoin data to identify cross correlations.
result Power-law cross correlations between returns and future volatilities are observed, indicating long-range dependencies.
New framework generalizes distance correlation for detecting dependencies.
problem Detecting general dependencies in complex data.
method Develops Multiscale Graph Correlation (MGC) using characteristic functions and nearest neighbor machinery.
result MGC is universally consistent for dependence testing against all joint distributions of finite moments.
Fast online algorithm for nonparametric correlations.
problem Computing nonparametric correlations on streaming data.
method Novel online algorithm with O(1) time and memory complexity.
result 10 to 1,000 times faster than batch algorithms.
We study power-law correlations properties of the Google search queries for Dow Jones Industrial Average (DJIA) component stocks. Examining the daily data of the searched terms with a combination of the rescaled range and rescaled variance tests together with the detrended fluctuation analysis, we show that the searche…
Financial markets analyzed by reducing correlation matrix complexity.
problem Understanding complex financial market correlations.
method Coarse graining Pearson correlation matrices into Guhr matrices by market sectors.
result Significant reduction in the number of relevant variables.
This paper analyzes correlations in patterns of trading of different members of the London Stock Exchange. The collection of strategies associated with a member institution is defined by the sequence of signs of net volume traded by that institution in hour intervals. Using several methods we show that there are signif…
Improved portfolio optimization using Kendall-like correlation coefficients.
problem Accurate estimation of eigenvectors in data-poor regimes for portfolio optimization.
method Developed generalized correlation coefficients based on Kendall's rank correlation.
result Markowitz portfolios with lower out-of-sample risk using these coefficients.
Paper proposes a method to reliably find correlations in categorical data.
problem Discovering reliable correlations in categorical data without distribution assumptions.
method Proposes a corrected-for-chance, consistent, and efficient estimator for normalized total correlation.
result Empirical evaluation shows low-regret optimization outcomes and effective algorithms for both small and large data.
Neural networks predict scientific correlations from text descriptions.
problem Predicting untested scientific correlations to guide research and resource allocation.
method Trained neural network on 170k correlational findings from social science journals.
result Neural network can accurately predict reported correlations from text descriptions.
The study finds that asset correlations underestimated when exposure pools are not homogeneous.
problem Systematic error in estimating asset correlations from default data due to exposure pool inhomogeneity.
method Investigates the effect of exposure pool homogeneity on asset correlation estimation from default time series.
result Asset correlation is systematically underestimated when exposure pools are inhomogeneous, especially if PD is spread out.
Study examines changes in Chinese stock market correlation structure around 2008 crisis.
problem Analyzing changes in market correlation structure around the 2008 crisis.
method Comparative analysis of high-frequency stock returns using random matrix analysis.
result Stronger average correlation and partial correlation in 2008 compared to 2007, with significant market effect.
Study of stock market sectors' correlations over 8 years.
problem Understanding correlations in Indian stock market sectors.
method Direct model-free analysis of daily returns of sectors over 8 years.
result Significant auto-correlation and cross-correlation among sectors.
New study shows FTRL mechanism works with correlated events.
problem Forecasting competitions with correlated events.
method Introduces block correlation and uses FTRL mechanism.
result FTRL mechanism retains ε-optimal guarantee with O(b2log(n)/ε2) events for correlated events.