Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

85170255340 · Jun 202019922001200920182026
48 results for True Randomness

Study finds no significant difference in neural network weights with quantum random numbers.

problem Effects of biased quantum random numbers on neural network initialization.
method Empirical study using quantum hardware and classical pseudo-random numbers.
result No statistically significant difference found between quantum random numbers and other types.

Improved estimator for least squares using random projections achieves smaller error.

problem Improving the accuracy of least squares solutions for large-scale problems.
method James-Stein estimator applied to Gaussian sketching of least squares problems.
result Upper and lower bounds match when SNR is small and data matrix is well-conditioned.

We find a remarkable agreement between the statistics of a randomly divided interval and the observed statistical patterns and distributions found in horse racing betting markets. We compare the distribution of implied winning odds, the average true winning probabilities, the implied odds conditional on a win, and the …

2016-12-08abs ↗pdf ↗

Study connects covariance cleaning theory to information theory for heavy-tailed distributions.

problem Optimizing covariance matrices for heavy-tailed distributions using information theory.
method Minimizing Frobenius norm and information loss between true and estimated covariance matrices.
result Asymptotic regime of large matrices minimizes information loss for Student's t distributions.

The paper analyzes kk-means clustering for missing data, proving statistical guarantees under MCAR.

problem Statistical guarantees for kk-means clustering with missing data, especially under Missing Completely at Random (MCAR).
method Established n\sqrt{n}-excess risk bound and consistency of cluster centers under general missing mechanisms; derived n\sqrt{n}-convergence rate and asymptotic normality for MCAR.
result Achieving n\sqrt{n}-rate and converging to true cluster centers requires distinct true cluster centers in every dimension under MCAR.

A random group contains many subgroups which are isomorphic to the fundamental group of a compact hyperbolic 3-manifold with totally geodesic boundary. These subgroups can be taken to be quasi-isometrically embedded. This is true both in the few relators model, and the density model of random groups (at any density les…

2014-04-28abs ↗pdf ↗

The paper equidistributes zeros of random polynomials and sections on manifolds.

problem Equidistribution of zeros of random polynomials and sections on manifolds.
method Weighted pluripotential theory, asymptotic Bernstein-Markov measures, variance estimation.
result Equidistribution holds for non-i.i.d. random coefficients and non-homogeneous manifolds.

New methods protect privacy while providing accurate prediction sets.

problem Privacy-preserving conformal prediction for untrusted aggregators.
method Two LDP approaches: k-ary randomized response and binary search response.
result Finite-sample coverage guarantees and robust coverage under randomization.

We consider a network of agents that aim to learn some unknown state of the world using private observations and exchange of beliefs. At each time, agents observe private signals generated based on the true unknown state. Each agent might not be able to distinguish the true state based only on her private observations.…

2015-09-14abs ↗pdf ↗

Proposes DP-MERF for privacy-preserving synthetic data generation.

problem Privacy-preserving data generation for synthetic datasets.
method Differentially private mean embeddings with random features.
result Achieves better privacy-utility trade-offs than existing methods.

We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend …

2016-03-14abs ↗pdf ↗

Guided Evolutionary Strategies uses surrogate gradients to improve optimization.

problem Optimizing functions with unknown true gradients but available surrogate gradients.
method Combines random search with a search distribution elongated along surrogate gradient directions.
result Improves optimization performance over standard evolutionary strategies and first-order methods.

The true online TD(λ) algorithm has recently been proposed (van Seijen and Sutton, 2014) as a universal replacement for the popular TD(λ) algorithm, in temporal-difference learning and reinforcement learning. True online TD(λ) has better theoretical properties than conventional TD(λ), and the expectation is that it als…

2015-07-01abs ↗pdf ↗

LMs perform poorly in true few-shot learning without held-out examples.

problem Evaluating few-shot performance of language models without access to held-out examples.
method Evaluated two model selection criteria (cross-validation and minimum description length) for choosing LM prompts and hyperparameters in true few-shot learning.
result Selection criteria often prefer models that perform worse than random selection, suggesting overestimation of few-shot ability.

Bayesian nonparametric approach for scalable learning without assuming model truth.

problem Bayesian learning's assumption of model truth is problematic in complex data environments.
method Nonparametric Bayesian learning using Monte Carlo sampling.
result Proves better scalability and accuracy compared to parametric models.

Study analyzes accuracy of tensor deflation in noisy conditions.

problem Analyzing accuracy of tensor deflation in noisy conditions.
method Asymptotic study of Hotelling-type tensor deflation in large tensor dimensions.
result Characterization of estimated singular values and singular vector alignments.

Randomized predictions ensure fair and accurate individual calibration in machine learning.

problem Systematic bias in typical calibration methods leads to unfair predictions for certain subgroups.
method Randomization of predictions to enforce individual calibration, trading off bias with variance.
result Randomized regression functions are more calibrated for arbitrary subgroups and achieve higher utility.

Investors with asymmetric information play a game to optimize their portfolios.

problem Two investors with different information levels compete in portfolio selection.
method Modelled as a Stackelberg game with entropy-regularized mean-variance objectives.
result Equilibria exist where follower's strategy depends on leader's actions.

A new model combines diffusion and random features for better interpretability and comparable performance.

problem Lack of theoretical justification and computational expense in diffusion models, and limited interpretability in random feature models.
method Developed a deep random feature model inspired by diffusion models, derived generalization bounds using score matching.
result The model achieves comparable performance to fully connected neural networks and provides theoretical generalization bounds.

Solves community detection in sparse hypergraphs above a threshold.

problem Community detection in sparse hypergraphs.
method Generalization of Massoulié's method for sparse random graphs to random hypergraphs.
result Above the threshold, a spectral algorithm constructs a partition correlated with the true partition.

Efficient algorithms identify true hypothesis from many options with minimal actions.

problem Identifying true hypothesis from a large set of options with minimal actions.
method Greedy approximation algorithms for active sequential hypothesis testing.
result First approximation guarantees for ASHT, independent of the number of hypotheses.

New method shows Hessian estimator from random samples converges to true Hessian on complex manifolds.

problem Uncertainty in Hessian estimator accuracy on complex manifolds with boundaries and nonuniform sampling.
method Locally fitting quadratic polynomials, rigorous theoretical analysis under mild conditions.
result The Hessian estimator asymptotically converges to the true Hessian, even near boundaries.

Paper studies tensor models using random matrix theory.

problem Analyzing asymmetric order-d spiked tensor models with Gaussian noise.
method Uses variational definition of singular vectors and values, constructs equivalent spiked symmetric block-wise random matrix from tensor contractions.
result Characterizes asymptotic singular values and alignments of singular vectors with true spike components.

For n4n\geq 4 we show that generic closed Riemannian nn-manifolds have no nontrivial totally geodesic submanifolds, answering a question of Spivak. An immediate consequence is a severe restriction on the isometry group of a generic Riemannian metric. Both results are widely believed to be true, but we are not aware of…

2017-03-27abs ↗pdf ↗

A new method for estimating large-scale linear models with improved precision.

problem Estimating large-scale linear statistical models efficiently.
method Sequential Least-Squares Estimators with Fast Randomized Sketching (SLSE-FRS), integrating Sketch-and-Solve and Iterative-Sketching methods.
result SLSE-FRS produces high-precision estimators, outperforming state-of-the-art methods.

In markets for online advertising, some advertisers pay only when users respond to ads. So publishers estimate ad response rates and multiply by advertiser bids to estimate expected revenue for showing ads. Since these estimates may be inaccurate, the publisher risks not selecting the ad for each ad call that would max…

2015-06-05abs ↗pdf ↗

We present a general method to detect and extract from a finite time sample statistically meaningful correlations between input and output variables of large dimensionality. Our central result is derived from the theory of free random matrices, and gives an explicit expression for the interval where singular values are…

2005-12-10abs ↗pdf ↗

Proposes an EM method for learning from positive and unlabeled data with random selection assumption.

problem Learning from positive and unlabeled data with random selection assumption.
method Proposes an EM method to learn under the assumption that positive examples are selected at random, conditioned on some attributes.
result The proposed method outperforms state-of-the-art methods for learning under the selected completely at random assumption.

SALSA efficiently approximates leverage scores for big data, improving ARMA model fitting.

problem Efficiently approximating leverage scores for large matrices.
method Sequential approximate leverage-score algorithm (SALSA) using randomized numerical linear algebra.
result SALSA approximates leverage scores within (1+O(ε))(1 + O({\varepsilon})) with high probability.

New proof shows how to identify DAGs with weakly increasing errors.

problem Identifying the true DAG in models with weakly increasing error variances.
method Minimum-trace DAG method and hill climbing algorithm with R2R neighborhood.
result Hill climbing algorithm without strict local optima under weakly increasing error variances.

Estimates metric tensor on neuromanifolds using Fisher information and random methods.

problem Computing the metric tensor on high-dimensional neuromanifolds efficiently and accurately.
method Deterministic bounds and unbiased random estimators based on Hutchinson's trace method.
result An efficient random estimator with bounded standard deviation.