Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

90179269358 · Jun 202019922001200920172026
48 results for correlated errors

Large language models correlate in errors, even with different architectures and providers.

problem Lack of empirical evidence on whether different large language models differ meaningfully.
method Empirical evaluation of over 350 large language models using two leaderboards and a resume-screening task.
result Large language models have substantial correlation in errors, even with distinct architectures and providers.

A possible data source for the estimation of asset correlations is default time series. This study investigates the systematic error that is made if the exposure pool underlying a default time series is assumed to be homogeneous when in reality it is not. We find that the asset correlation will always be underestimated…

2017-01-08abs ↗pdf ↗

The paper introduces a method to model error correlations in multivariate time series forecasting.

problem Accurate modeling of error correlations for reliable uncertainty quantification.
method Plug-and-play method that learns error covariance over multiple steps using low-rank-plus-diagonal and independent latent temporal processes.
result Improves predictive accuracy and uncertainty quantification without significantly increasing parameter size.

Overparameterized models can worsen minority group errors even when overall test error improves.

problem Overparameterization exacerbates spurious correlations, harming minority groups.
method Simulations and experiments on image datasets, theoretical analysis of linear models.
result Subsampling the majority group can achieve low minority error in overparameterized models.

Bayesian method improves segmentation accuracy with noisy labels.

problem Annotation errors in semantic segmentation due to mislabeling and spatial correlations.
method Approximate Bayesian estimation with spatially correlated discrete distributions and variational inference.
result The method achieves performance comparable to clean labels under moderate noise levels.

While the objective in traditional multi-armed bandit problems is to find the arm with the highest mean, in many settings, finding an arm that best captures information about other arms is of interest. This objective, however, requires learning the underlying correlation structure and not just the means of the arms. Se…

2019-02-08abs ↗pdf ↗

In their seminal work Carr and Lee (2008) show how to robustly price and replicate a variety of claims written on the quadratic variation of a risky asset under the assumption that the asset's volatility process is independent of the Brownian motion that drives the asset's price. Additionally, they propose a correlatio…

2018-09-26abs ↗pdf ↗

K-fold cross-validation (CV) with squared error loss is widely used for evaluating predictive models, especially when strong distributional assumptions cannot be taken. However, CV with squared error loss is not free from distributional assumptions, in particular in cases involving non-i.i.d. data. This paper analyzes …

2019-04-04abs ↗pdf ↗

Existing guarantees in terms of rigorous upper bounds on the generalization error for the original random forest algorithm, one of the most frequently used machine learning methods, are unsatisfying. We discuss and evaluate various PAC-Bayesian approaches to derive such bounds. The bounds do not require additional hold…

2018-10-23abs ↗pdf ↗

Autonomy and adaptation of machines requires that they be able to measure their own errors. We consider the advantages and limitations of such an approach when a machine has to measure the error in a regression task. How can a machine measure the error of regression sub-components when it does not have the ground truth…

2019-06-17abs ↗pdf ↗

New DP methods for estimating means and frequencies with varying privacy demands.

problem Estimating statistics with users having different privacy requirements.
method Proposes algorithms for empirical mean and frequency estimation under heterogeneous privacy constraints, considering both correlated and permuted datasets.
result Establishes theoretical performance guarantees for algorithms, achieving minimax optimality.

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

problem Finding linear relationships across multiple datasets with sparse loading vectors.
method Formulated as generalized eigenvalue problems, used a thresholded gradient descent algorithm.
result Proposed algorithm yields tight estimation error bounds and demonstrates effectiveness on synthetic datasets.

We study the relationship between catastrophic forgetting and properties of task sequences. In particular, given a sequence of tasks, we would like to understand which properties of this sequence influence the error rates of continual learning algorithms trained on the sequence. To this end, we propose a new procedure …

2019-08-02abs ↗pdf ↗

The risk of a credit portfolio depends crucially on correlations between the probability of default (PD) in different economic sectors. Often, PD correlations have to be estimated from relatively short time series of default rates, and the resulting estimation error hinders the detection of a signal. We present statist…

2004-01-19abs ↗pdf ↗

The paper studies statistical properties of CART regression trees.

problem Understanding the statistical properties of CART regression trees.
method The paper constructs a prior distribution on split points and solves a nonlinear optimization problem to bound the Pearson correlation between the optimal decision stump and response data.
result CART with cost-complexity pruning achieves an optimal complexity/goodness-of-fit tradeoff when the depth scales with the logarithm of the sample size.

The study corrects measurement error in evaluating health effects of multiple pollutants.

problem Bias in estimating health effects of air pollution constituents due to mismeasurement.
method Used a linear regression calibration model and extended DML approach to correct for measurement error.
result Identified two PM2.5 constituents (Br and Mn) that show a negative causal effect on cognitive function after correction.

A visualization aids in comparing regression models by highlighting errors and correlations.

problem Comparing regression models is difficult due to varying hyper-parameters and metrics.
method Introduces a novel visualization approach using 2D residual space, Mahalanobis distance, and colormaps.
result Enhanced understanding of regression model performance differences and error distributions.

Paper develops streaming algorithms to estimate classifier accuracy on unlabeled data.

problem Estimating classifier accuracy on unlabeled data with noisy decisions.
method Two algebraic evaluators: majority voting and a novel method to handle correlated classifiers.
result The novel method can be as accurate as 1% when handling small amounts of correlation.

Kernel methods linked to feature subspaces and maximal correlation kernels.

problem Understanding kernel methods and their relationship to feature extraction.
method Established a correspondence between feature subspaces and kernels, introduced maximal correlation kernels, and demonstrated their optimality.
result Kernel SVM on maximal correlation kernel achieves minimum prediction error.

Redundancy in AI perception systems doesn't guarantee independent error occurrences.

problem Lack of direct statistical evidence of super-human automated driving performance.
method Investigated the effectiveness of redundancy in neural networks for independent error occurrences.
result Errors in neural networks for computer vision tasks are correlated, not independent.

We solve matrix denoising with both row and column correlations, setting limits and designing optimal methods.

problem Matrix denoising with doubly heteroscedastic noise (both row and column correlations).
method Established information-theoretic and algorithmic limits, designed a novel spectral estimator with optimality guarantees.
result The novel spectral estimator achieves positive correlation with the signal and Bayes-optimal error under one-sided heteroscedasticity.

Geostatistical learning faces unique challenges due to spatial correlation and covariate shifts.

problem Challenges in applying statistical learning to geospatial data.
method Assessing generalization error under covariate shift and spatial correlation.
result No classical learning methods are adequate for model selection in geospatial contexts.

Improved deep probabilistic time series forecasting by learning error autocorrelation.

problem Simplification of time-independent error process and lack of serial correlation in existing models.
method Proposes a training method that incorporates error autocorrelation to enhance probabilistic forecasting accuracy.
result Improves predictive accuracy and uncertainty quantification across multiple datasets.

Alpha-based performance evaluation may fail to capture correlated residuals due to model errors. This paper proposes using the Generalized Information Ratio (GIR) to measure performance under misspecified benchmarks. Motivated by the theoretical link between abnormal returns and residual covariance matrix, GIR is deriv…

2018-03-04abs ↗pdf ↗

Data mining techniques on the biological analysis are spreading for most of the areas including the health care and medical information. We have applied the data mining techniques, such as KNN, SVM, MLP or decision trees over a unique dataset, which is collected from 16,380 analysis results for a year. Furthermore we h…

2014-01-25abs ↗pdf ↗

A new method selects models for ensemble learning to maximize mutual information, outperforming existing approaches.

problem Selecting models for ensemble learning to improve performance and reduce correlation issues.
method Formulate budgeted ensemble selection as maximizing mutual information, use Gaussian-copula to model correlated errors, propose a greedy mutual-information selection algorithm.
result Our method consistently outperforms strong baselines across multiple datasets.

Efficient algorithm for graph matching in correlated stochastic block models.

problem Graph matching in correlated stochastic block models with balanced communities.
method Extends previous work on centered subgraph counts to handle estimation errors and edge correlation.
result First efficient algorithm for graph matching in the logarithmic average degree regime, matching all but a vanishing fraction of vertices with high probability.

This paper sets thresholds for recovering vertex correspondences in partially correlated graphs.

problem Recovering hidden vertex correspondences in partially correlated graphs.
method Proposed partially correlated Erdős-Rényi graphs model; information-theoretic thresholds; correlated functional digraphs.
result Optimal rates for partial and exact recovery of vertex correspondences.

Proposes a method to select features for deep learning in noisy, high-dimensional data.

problem Feature selection for deep learning in ultra-high dimensional and highly correlated data.
method Data-adaptive multi-resolutional screening and cleaning with deep learning.
result Achieves high power while keeping false discovery rate low.

Paper forecasts stock correlations using a hybrid model combining graph neural networks and transformers.

problem Improving stock correlation forecasts for better portfolio management.
method Hybrid model combining Transformer and graph attention networks for forecasting residual deviations from historical data.
result The hybrid model reduces correlation forecasting error compared to rolling-window estimates.

We demonstrate that the lowest possible price change (tick-size) has a large impact on the structure of financial return distributions. It induces a microstructure as well as it can alter the tail behavior. On small return intervals, the tick-size can distort the calculation of correlations. This especially occurs on s…

2010-01-28abs ↗pdf ↗