Many research fields codify their findings in standard formats, often by reporting correlations between quantities of interest. But the space of all testable correlates is far larger than scientific resources can currently address, so the ability to accurately predict correlations would be useful to plan research and a…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Predictive correlations”
New method handles correlated genes for better genomic prediction.
problem Technical issues with highly correlated genes in prediction models.
method Grouping algorithm that treats correlated genes as a group and uses their common patterns.
result Significantly outperforms standard models in prediction and feature selection.
This paper benchmarks Bayesian models' ability to estimate predictive correlations, especially for active learning.
problem Benchmarking how accurately Bayesian models estimate predictive correlations, especially in active learning.
method Considered transductive active learning as a benchmark, introduced meta-correlations and cross-normalized likelihoods.
result Meta-correlations and cross-normalized likelihoods can efficiently evaluate predictive correlations and are consistent with TAL performance.
It is well-known that exploiting label correlations is crucially important to multi-label learning. Most of the existing approaches take label correlations as prior knowledge, which may not correctly characterize the real relationships among labels. Besides, label correlations are normally used to regularize the hypoth…
Predictive Correlation Screening: Application to Two-stage Predictor Design in High Dimensionstat.ML
We introduce a new approach to variable selection, called Predictive Correlation Screening, for predictor design. Predictive Correlation Screening (PCS) implements false positive control on the selected variables, is well suited to small sample sizes, and is scalable to high dimensions. We establish asymptotic bounds f…
Predicting the price correlation of two assets for future time periods is important in portfolio optimization. We apply LSTM recurrent neural networks (RNN) in predicting the stock price correlation coefficient of two individual stocks. RNNs are competent in understanding temporal dependencies. The use of LSTM cells fu…
We study the dynamics of the linear and non-linear serial dependencies in financial time series in a rolling window framework. In particular, we focus on the detection of episodes of statistically significant two- and three-point correlations in the returns of several leading currency exchange rates that could offer so…
For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two primary drawbacks: they either lack the ability to model high-order correlations…
Deep learning reveals lagged correlations in stock markets, showing accuracy decreases with shorter prediction horizons.
problem Capturing non-linear interactions in financial prediction problems using large-scale datasets.
method Applying deep learning to econometrically constructed gradients to learn and exploit lagged correlations among S&P 500 stocks.
result Model accuracies decrease with shorter prediction horizons, but remain significant in both stable and volatile markets.
Although the Lasso has been extensively studied, the relationship between its prediction performance and the correlations of the covariates is not fully understood. In this paper, we give new insights into this relationship in the context of multiple linear regression. We show, in particular, that the incorporation of …
The Gaussian Neural Processstat.ML
GNP models predictive correlations and outperforms NPs.
problem Training and understanding of Neural Processes.
method Proposed a new model, Gaussian Neural Process (GNP), which incorporates translation equivariance and provides universal approximation guarantees.
result Demonstrates encouraging performance and provides universal approximation guarantees.
LaCIM avoids spurious correlation by modeling latent causal factors.
problem Avoiding spurious correlation in supervised learning.
method Introducing latent variables for causal prediction and optimizing over latent space.
result Improved interpretability, robustness, and prediction power on OOD scenarios.
Transformer predicts Ethereum prices using cross-currency correlation and sentiment analysis.
problem Predicting Ethereum cryptocurrency prices with limited data.
method Transformer-based neural network with cross-currency correlation and sentiment analysis.
result Transformer model outperforms other models on some parameters.
The paper proposes a method to construct well-calibrated prediction sets for correlated target variables.
problem Constructing well-calibrated prediction sets for correlated target variables.
method The method uses vine copulas to estimate the joint cumulative distribution function of non-conformity scores and improves the asymptotic efficiency of the quantile estimate.
result The method guarantees asymptotically exact coverage and competitive efficiency on real-world regression problems.
Gaining more comprehensive knowledge about drug-drug interactions (DDIs) is one of the most important tasks in drug development and medical practice. Recently graph neural networks have achieved great success in this task by modeling drugs as nodes and drug-drug interactions as links and casting DDI predictions as link…
Study predicts climate data at distant locations using machine learning.
problem Predict climate variables at distant locations where comprehensive data collection is not feasible.
method Uses reservoir computing and vector autoregression models for prediction.
result Machine learning improves prediction accuracy for highly correlated data.
Model predicts epileptic seizures with high accuracy using EEG signals.
problem Predicting epileptic seizures with high accuracy for diagnosis and treatment.
method Pearson's product-moment correlation coefficient with a linear classifier on generalized Gaussian modeling.
result 100% effectiveness for sensitivity and specificity greater than 83%.
The study reveals how synaptic correlations promote dimension reduction in neural networks.
problem Understanding how synaptic correlations affect neural correlations and dimension reduction in deep neural networks.
method A simplified model of dimension reduction considering pairwise correlations among synapses, using mathematical self-consistency for both binary and continuous synapses.
result Weakly-correlated synapses encourage dimension reduction compared to orthogonal synapses, and they also slow down the decorrelation process.
Multivariate boosted trees improve forecasting and control by capturing correlated predictions.
problem Capturing multivariate target cross-correlations and applying structured penalties to predictions.
method A computationally efficient algorithm for fitting multivariate boosted trees.
result Multivariate trees outperform univariate counterparts in correlated prediction scenarios.
Preformer improves Transformer for long-term time series forecasting.
problem Transformer's quadratic complexity and lack of context-awareness for long-term forecasting.
method Introduces Multi-Scale Segment-Correlation mechanism for efficient time series segmentation and context-aware attention.
result Preformer outperforms other Transformer-based methods in long-term time series forecasting.
The paper uses distance correlation for brain connectivity and a novel multi-task learning model for age prediction.
problem Estimating age-related gender differences in brain functional connectivity.
method Estimates functional connectivity using distance correlation and proposes a non-convex multi-task learning model.
result The proposed non-convex multi-task learning model outperforms other models in age prediction and gender-specific connectivity.
We compare two models of corporate default by calculating the Jeffreys-Kullback-Leibler divergence between their predicted default probabilities when asset correlations are either high or low. Our main results show that the divergence between the two models increases in highly correlated, volatile, and large markets, b…
CopulaGNN integrates graph representational and correlational roles for better node-level predictions.
problem Graphs encode diverse roles in node-level prediction tasks, but GNNs struggle with correlational information.
method Copula theory to describe multivariate dependence, integrating representational and correlational graph information.
result CopulaGNN improves GNN performance on regression tasks by leveraging both types of graph information.
Paper presents a copula-based method to efficiently generate correlated sample paths from multi-step time series models.
problem Generating realistic correlation structures in multi-step forecast sample paths is expensive and time-consuming.
method Copula-based approach to generate correlated sample paths in one forward pass.
result Improved sample path quality and significant speedup over autoregressive sampling.
New insights into ridge regression with correlated data, improving risk prediction.
problem Understanding and predicting risk in ridge regression with correlated samples.
method Random matrix theory and free probability for asymptotic analysis; modified GCV estimator (CorrGCV) for unbiased prediction.
result GCV estimator fails for out-of-sample risk with correlated data; CorrGCV provides an unbiased estimator.
Two methods are proposed to filter correlations in DCC-GARCH residuals for foreign exchange rates.
problem Filtering correlations in DCC-GARCH residuals for accurate foreign exchange rate prediction.
method Two approaches: estimating correlation matrix as a parameter and using eigenvalue decomposition.
result The DCC-GARCH residual can be almost independent using these methods.
Study examines challenges in variable importance ranking due to feature correlation.
problem Challenges in variable importance ranking under correlation.
method Simulation study and theoretical analysis of feature knockoffs and conditional predictive impact (CPI).
result Highly correlated features increase the correlation of knockoff variables, posing a limitation for CPI.
We introduce a method to predict which correlation matrix coefficients are likely to change their signs in the future in the high-dimensional regime, i.e. when the number of features is larger than the number of samples per feature. The stability of correlation signs, two-by-two relationships, is found to depend on thr…
A new method for faster prediction in distributed Gaussian processes.
problem Inefficient aggregation of distributed Gaussian processes with correlations.
method Proposes a novel approach for aggregated prediction in distributed GPs that incorporates correlations among experts.
result Results in more stable predictions in less time compared to state-of-the-art methods.
The Interpretability of LSTM Models for Predicting Oil Company Stocks: Impact of Correlated Featuresq-fin.ST
Study shows adding correlated features doesn't improve LSTM model interpretability for oil stocks.
problem Improving interpretability of LSTM models for predicting oil company stocks.
method Designed and trained Standard LSTM networks using various correlated datasets.
result Adding correlated features does not enhance LSTM model interpretability.
Distributional Correlation--Aware Knowledge Distillation for Stock Trading Volume Predictionq-fin.TR
A new distillation framework predicts stock trading volumes more accurately with less model size.
problem Predicting stock trading volumes using regression models without class correlations.
method Transformed regression model into a probabilistic forecasting model, matching distributions and correlational relationships.
result Framework achieves superior prediction accuracy with significantly smaller model size.
New neural network captures spatial correlations in wind speed predictions.
problem Uncertainty quantification in neural network predictions for high-dimensional, correlated data.
method Training neural networks with multidimensional Gaussian loss, preserving spatial correlation and computational tractability.
result Demonstrated super-resolution of surface wind speed with explicit correlation modeling.
Paper proposes a GAN-based approach for RTLMP prediction.
problem Predicting real-time locational marginal prices (RTLMPs) in power markets.
method GAN-based video prediction model for spatio-temporal correlations.
result Proposed method accurately predicts RTLMPs without confidential information.
GRU-PFG model extracts inter-stock correlations from stock factors using graph neural networks.
problem Limited effectiveness of models relying solely on stock factors for capturing stock correlations.
method Project stock factors into a graph and use graph neural networks to extract inter-stock correlations.
result Achieves better prediction results than models relying solely on stock factors and comparable to second category models.
Paper forecasts stock correlations using a hybrid model combining graph neural networks and transformers.
problem Improving stock correlation forecasts for better portfolio management.
method Hybrid model combining Transformer and graph attention networks for forecasting residual deviations from historical data.
result The hybrid model reduces correlation forecasting error compared to rolling-window estimates.
Paper forecasts corporate default risk using Particle MCMC with expert opinions.
problem Predicting corporate default risk in the U.S. market.
method Bayesian approach with Particle Markov Chain Monte Carlo (Particle MCMC) algorithm.
result Volatility and mean reversion of hidden factor significantly impact default intensities.
We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Such data often exhibit {\em longitudinal correlation} (LC) (correlations among observations for each individual over time), {\em cluster correlation…
Trend change prediction in complex systems with a large number of noisy time series is a problem with many applications for real-world phenomena, with stock markets as a notoriously difficult to predict example of such systems. We approach predictions of directional trend changes via complex lagged correlations between…
This study investigates empirically whether the degree of stock market efficiency is related to the prediction power of future price change using the indices of twenty seven stock markets. Efficiency refers to weak-form efficient market hypothesis (EMH) in terms of the information of past price changes. The prediction …
A new model predicts financial volatility across firms using spatial correlations.
problem Predicting financial volatility across firms in a network.
method Heterogeneous spatiotemporal GARCH model with local likelihood estimation.
result The model captures spatial spillovers and contagion effects in financial networks.
Predicting missing links via correlation between nodesphysics.soc-ph
As a fundamental problem in many different fields, link prediction aims to estimate the likelihood of an existing link between two nodes based on the observed information. Since this problem is related to many applications ranging from uncovering missing data to predicting the evolution of networks, link prediction has…
A new method for Gaussian Processes handles mixed continuous and categorical inputs.
problem Modeling cross-correlations between continuous and categorical data.
method Low-Rank Correlation (LRC) method for Gaussian Processes with flexible rank approximation.
result LRC outperforms existing methods in estimating cross-correlations and predicting response surfaces.
Similarity measure for Gaussian process predictive distributions.
problem Comparing predictive distributions of Gaussian processes for correlated functions.
method Developed a similarity metric to compare predictive distributions of Gaussian processes.
result Gaussian process predictive distributions can be compared and one is enough to model two correlated functions.
Proposes integrating random effects into deep neural networks for better predictive performance.
problem Correlated data in real-life applications are not handled well by traditional deep neural networks.
method Uses mixed models with random effects to handle correlations in deep neural networks, minimizing Gaussian negative log-likelihood with SGD.
result Improves predictive performance over natural competitors in various correlation scenarios.
Subspace Perspective on Canonical Correlation Analysis: Dimension Reduction and Minimax Ratesmath.ST
Canonical correlation analysis (CCA) is a fundamental statistical tool for exploring the correlation structure between two sets of random variables. In this paper, motivated by recent success of applying CCA to learn low dimensional representations of high dimensional objects, we propose to quantify the estimation loss…
Causal Explainability of Machine Learning in Heart Failure Prediction from Electronic Health Recordsstat.ML
The paper investigates causal relationships in heart failure prediction using machine learning.
problem Understanding the causal relationships between clinical variables and heart failure.
method Proposes a new computational framework for causal structure discovery (CSD) of mixed-type clinical variables for binary disease outcomes.
result Feature importance from nonlinear classifiers strongly correlates with causal strength of variables, but not differentiating cause and effect.
A new GNN model predicts stock trends by learning historical and future correlations.
problem Limited improvement in stock trend prediction models due to ignoring future patterns.
method DishFT-GNN framework that trains a teacher and student model to capture historical and future data correlations.
result State-of-the-art performance on real-world datasets.
What predicts the evolution over time of subjective well-being? We correlate the trends of subjective well-being with the trends of social capital and/or GDP. We find that in the long and medium run social capital largely predicts the trends of subjective wellbeing in our sample of countries. In the short-term this rel…