Infinite CNNs lose spatial correlations, but can be restored by correlated weights.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New method improves convergence of spatial filters in neural networks.
The study examines correlations of logarithms of integers at different scalings.
We discuss a weighted estimation of correlation and covariance matrices from historical financial data. To this end, we introduce a weighting scheme that accounts for similarity of previous market conditions to the present one. The resulting estimators are less biased and show lower variance than either unweighted or e…
Standardizes weighted ranking correlation coefficients to maintain zero expected value.
Bayesian priors for neural networks are improved by incorporating weight correlations and tail behavior.
The strength of association between a pair of data vectors is represented by a nonnegative real number, called matching weight. For dimensionality reduction, we consider a linear transformation of data vectors, and define a matching error as the weighted sum of squared distances between transformed vectors with respect…
Abstract result on correlations of pairs in exponentially growing discrete subsets.
Losaw improves FI scores by decorrelating features in ML models.
Probabilistic neural networks are typically modeled with independent weight priors, which do not capture weight correlations in the prior and do not provide a parsimonious interface to express properties in function space. A desirable class of priors would represent weights compactly, capture correlations between weigh…
New method detects intrinsic cross-correlations in non-stationary time series affected by common factors.
Given two data matrices and , sparse canonical correlation analysis (SCCA) is to seek two sparse canonical vectors and to maximize the correlation between and . However, classical and sparse CCA models consider the contribution of all the samples of data matrices and thus cannot identify an unde…
Improves Lasso's stability in correlated predictor settings.
We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based c…
A new algorithm removes unexpected correlations in biased data for better clustering.
Improved multiclass classification with class-weighted nearest neighbors.
New method speeds up neural network training by preprocessing weight-data correlation.
Non-negative matrix factorization is a basic tool for decomposing data into the feature and weight matrices under non-negativity constraints, and in practice is often solved in the alternating minimization framework. However, it is unclear whether such algorithms can recover the ground-truth feature matrix when the wei…
Modern deep neural networks require a tremendous amount of data to train, often needing hundreds or thousands of labeled examples to learn an effective representation. For these networks to work with less data, more structure must be built into their architectures or learned from previous experience. The learned weight…
Gradient descent aligns neural feature matrices with pre-activation tangent features.
Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is critical to the interpretability of a learned model. Much of the current literature…
Interpretable machine-learning models can be unstable under multicollinearity, leading to oscillatory weights that do not reflect meaningful contributions.
CDEFs reduce model complexity and uncover time correlations.
New method embeds correlation networks to reveal underlying time series patterns.
Study on MC dropout in wide neural networks and its convergence to Gaussian processes.
Research examines correlations of complex logarithms of lattice points, showing level repulsion and Poissonian behavior.
We analyze correlations among stock returns via a series of widely adopted parameters which we refer to as explanatory variables. We subsequently exploit the results to propose a long only quantitative adaptive technique to construct a profitable portfolio of assets which exhibits minor drawdowns and higher recoveries …
The instability of historical risk factor correlations renders their use in estimating portfolio risk extremely questionable. In periods of market stress correlations of risk factors have a tendency to quickly go well beyond estimated values. For instance, in times of severe market stress, one would expect with certain…
With the widespread engineering applications ranging from artificial intelligence and big data decision-making, originally a lot of tedious financial data processing, processing and analysis have become more and more convenient and effective. This paper aims to improve the accuracy of stock price forecasting. It improv…
Residual Network (ResNet) is the state-of-the-art architecture that realizes successful training of really deep neural network. It is also known that good weight initialization of neural network avoids problem of vanishing/exploding gradients. In this paper, simplified models of ResNets are analyzed. We argue that good…
Develops a new random forest method for clustered data with improved prediction and inference.
A new method for faster prediction in distributed Gaussian processes.
We describe a new optimization scheme for finding high-quality correlation clusterings in planar graphs that uses weighted perfect matching as a subroutine. Our method provides lower-bounds on the energy of the optimal correlation clustering that are typically fast to compute and tight in practice. We demonstrate our a…
A new methodology has been introduced to clean the correlation matrix of single stocks returns based on a constrained principal component analysis using financial data. Portfolios were introduced, namely "Fundamental Maximum Variance Portfolios", to capture in an optimal way the risks defined by financial criteria ("Bo…
This paper studies ordered weighted L1 (OWL) norm regularization for sparse estimation problems with strongly correlated variables. We prove sufficient conditions for clustering based on the correlation/colinearity of variables using the OWL norm, of which the so-called OSCAR is a particular case. Our results extend pr…
We analyze a new spectral graph matching algorithm, GRAph Matching by Pairwise eigen-Alignments (GRAMPA), for recovering the latent vertex correspondence between two unlabeled, edge-correlated weighted graphs. Extending the exact recovery guarantees established in the companion paper for Gaussian weights, in this work,…
The study analyzes XRP transaction networks to understand market dynamics.
New method improves portfolio allocation using local Gaussian correlation.
Novel method decorrelates neurons for better deep learning model generalization.
This paper introduces anti-correlation networks to study China's stock market.
This paper explores the relationships between migration and trade using a complex-network approach. We show that: (i) both weighted and binary versions of the networks of international migration and trade are strongly correlated; (ii) such correlations can be mostly explained by country economic/demographic size and ge…
A new weighted MLMC method improves efficiency in Monte Carlo simulations.
We formulate learning of a binary autoencoder as a biconvex optimization problem which learns from the pairwise correlations between encoded and decoded bits. Among all possible algorithms that use this information, ours finds the autoencoder that reconstructs its inputs with worst-case optimal loss. The optimal decode…
New tensor framework connects Fisher information, hypergraphs, and multi-observable correlations.
A new methodology for incorporating LGD correlation effects into the Basel II risk weight functions is introduced. This methodology is based on modelling of LGD and default event with a single loss variable. The resulting formulas for capital charges are numerically compared to the current proposals by the Basel Commit…
New feature selection method DRPT reduces genomic datasets by removing irrelevant features and detecting correlations.
We study graph matching with correlated Gaussian features and find thresholds for exact recovery.
Develops method to construct Lie algebra weight system kernel using Vogel algebra.