Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2815628421,123 · Jun 202019922001200920172026
48 results for random set theory

Random forests are a type of ensemble method which makes predictions by combining the results of several independent trees. However, the theory of random forests has long been outpaced by their application. In this paper, we propose a novel random forests algorithm based on cooperative game theory. Banzhaf power index …

2015-07-22abs ↗pdf ↗

The paper deals with distribution of singular values of product of random matrices arising in the analysis of deep neural networks. The matrices resemble the product analogs of the sample covariance matrices, however, an important difference is that the population covariance matrices, which are assumed to be non-random…

2020-01-17abs ↗pdf ↗

PAC-Bayesian theory applied to data-dependent hypothesis sets yields uniform generalization bounds.

problem Proving uniform generalization bounds for data-dependent hypothesis sets.
method Applying PAC-Bayesian framework on 'random sets' and considering data-dependent hypothesis sets.
result Data-dependent uniform generalization bounds are proven, providing tighter and unified results.

Machine learning model predicts DFT total energy to complete basis set limit.

problem Finding a model to extrapolate DFT calculations to complete basis set limit.
method Quantile-random-forest model trained on binary solids data.
result Random-forest model achieves <25% symmetric MAPE for both DFT codes.

Random matrix theory predicts neural representations generalize well.

problem Understanding why neural representations generalize well in practice.
method Applied random matrix theory to kernel regression and neural networks.
result GCV estimator accurately predicts generalization risk in overparameterized settings.

This paper explains CART random forests using stochastic control theory.

problem Understanding the inner workings of CART random forests.
method Developed a stochastic-control perspective on CART random forests, interpreting feature subsampling as a random feasible action set and the split rule as a policy.
result Established that the CART policy is locally stabilizing but globally suboptimal for the forest objective.

We investigate the random dynamics of polynomial maps on the Riemann sphere and the dynamics of semigroups of polynomial maps on the Riemann sphere. In particular, the dynamics of a semigroup GG of polynomials whose planar postcritical set is bounded and the associated random dynamics are studied. In general, the Juli…

2011-04-19abs ↗pdf ↗

Paper analyzes error bounds for learning with vector-valued RF, improving existing analyses.

problem Learning with vector-valued random features in infinite-dimensional settings.
method Direct analysis of risk functional, avoiding random matrix theory.
result Strong consistency and minimax optimal convergence rates established.

We analyze generalization in deep learning models using random matrix theory.

problem Understanding the generalization error in deep learning models with random feature representations.
method Applying Random Matrix Theory to derive asymptotic generalization error formulas for various architectures.
result Linear ESNs are equivalent to ridge regression with exponentially time-weighted input covariance, revealing an inductive bias towards recent inputs.

Random utility theory models an agent's preferences on alternatives by drawing a real-valued score on each alternative (typically independently) from a parameterized distribution, and then ranking the alternatives according to scores. A special case that has received significant attention is the Plackett-Luce model, fo…

2012-11-11abs ↗pdf ↗

Rule-based classifiers quantify uncertainty using Bernoulli random variables.

problem Quantifying the uncertainty of precision estimates for rule-based text classifiers.
method Treat partitions of sub-strings as Bernoulli random variables, compare means using statistical tests, and combine classifiers using Dempster-Shafer theory.
result The approach can be used to combine binary classifiers into a multi-label classifier.

Research proves the semi-classical limit of Liouville conformal field theory, describing deterministic geometry from random fluctuations.

problem Proving the semi-classical limit of Liouville conformal field theory.
method Probabilistic definition of Liouville theory, proving existence of semi-classical limit, defining classical stress-energy tensor.
result Existence and description of the semi-classical limit in terms of a massive Gaussian free field with Robin boundary conditions.

Analyzes biased random walks and corrupted intervals in adversarial settings.

problem Learning thresholds and intervals in adversarial conditions.
method Analyzes biased random walks and corrupted intervals under adversarial design.
result Analyzes the expected behavior of biased random walks and corrupted intervals.

The paper equidistributes zeros of random polynomials and sections on manifolds.

problem Equidistribution of zeros of random polynomials and sections on manifolds.
method Weighted pluripotential theory, asymptotic Bernstein-Markov measures, variance estimation.
result Equidistribution holds for non-i.i.d. random coefficients and non-homogeneous manifolds.

We develop time-uniform confidence spheres for estimating means of random vectors.

problem Sequential mean estimation in high-dimensional spaces.
method Derive time-uniform confidence sphere sequences (CSSs) for various types of random vectors.
result Optimal CSSs for log-concave, sub-Gaussian, and sub-ψψ random vectors.

We prove that, under low noise assumptions, the support vector machine with NmN\ll m random features (RFSVM) can achieve the learning rate faster than O(1/m)O(1/\sqrt{m}) on a training set with mm samples when an optimized feature map is used. Our work extends the previous fast rate analysis of random features method from…

2018-09-12abs ↗pdf ↗

New framework improves worst-case generalization bounds for stochastic optimization.

problem Challenges in providing generalization guarantees for stochastic optimization algorithms.
method Introduces random set stability and empirically relevant complexity measures to avoid intractable mutual information terms.
result Bounded worst-case generalization error in terms of random set stability and empirically relevant complexity measures.

Reconstruct spacetime from order and number of points.

problem Reconstruct spacetime from chronological relations and i.i.d. samples.
method Relaxing hypotheses of Gromov reconstruction theorem, using random adjacency matrices and chronological relations.
result Spacetime can be recovered by only knowing 'order' and 'number' of its points.

We analyze in this paper a random feature map based on a theory of invariance I-theory introduced recently. More specifically, a group invariant signal signature is obtained through cumulative distributions of group transformed random projections. Our analysis bridges invariant feature learning with kernel methods, as …

2015-06-08abs ↗pdf ↗

This paper examines the impact of random initialization in neural networks using NTK theory.

problem Understanding the impact of random initialization in neural networks using NTK theory.
method Analyzes the convergence of training dynamics and generalization error of wide neural networks with random initialization.
result The generalization error of wide neural networks trained by gradient descent is \( \Omega(n^{-\frac{3}{d+3}}) \), highlighting the benefits of mirror initialization and suggesting limitations of NTK theory.

We consider the "partial information decomposition" (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique components. In the first part of this paper, we propose a general framework for …

2019-08-23abs ↗pdf ↗

Study reveals a universal formula for knotting in random equilateral polygons.

problem Probability of knotting in equilateral random polygons.
method Extensive Monte Carlo simulations with improved algorithms and knot invariants.
result A universal scaling formula for knotting probability with number of edges, involving exponential and power law factors.

Paper argues for using functional theory of randomness for better understanding of data exchangeability and conformal prediction.

problem Understanding relationships between IID data assumptions and data exchangeability.
method Translation of conformal prediction results into the language of functional theory of randomness.
result Every confidence predictor valid for IID data can be transformed to a conformal predictor without losing much predictive efficiency.

The paper develops a theory for random forests, separating variance components and providing methods for estimating prediction intervals.

problem Understanding the variance and uncertainty in random forest predictions.
method Design-based theory, Monte Carlo averaging, PASR resampling.
result The floor of prediction uncertainty is positive and persists even without observation overlap, providing conservative prediction intervals.

Unified analysis of generalization curves in large models using gradient flow.

problem Analyzing generalization error curves in simple learning models.
method Gradient flow in the Gaussian covariate model, using random matrix theory.
result Unified understanding of multiple descent structures in learning curves.

The paper addresses uncertainties in spectral clustering of corrupted data.

problem Uncertainties in spectral clustering due to measurement errors and missing data.
method Mathematical framework based on random set theory for Monte Carlo approximation of expected clusterings.
result Consistent quantities of interest for evaluating clusterings in corrupted data.

The purpose of this work is to explore the role that random arbitrage opportunities play in pricing financial derivatives. We use a non-equilibrium model to set up a stochastic portfolio, and for the random arbitrage return, we choose a stationary ergodic random process rapidly varying in time. We exploit the fact that…

2004-05-27abs ↗pdf ↗

Study on random matrices in deep neural networks with IID entries.

problem Distribution of singular values in product of random matrices for deep neural networks.
method Random matrix theory with a streamlined approach for non-Gaussian data.
result Generalization of macroscopic universality property to non-Gaussian data.

Diffusion models' consistency across splits explained by random matrix theory.

problem Consistency of diffusion models trained on non-overlapping subsets.
method Random matrix theory framework to quantify dataset effects on denoiser and sampling map.
result The theory explains and predicts cross-split disagreement in diffusion models.

Ridge regression reveals surprising high-dimensional behaviors via random matrix theory.

problem Understanding power-law scalings in high-dimensional regression models.
method Random matrix theory and free probability.
result Analytic formulas for training and generalization errors derived from SS-transform.

The article studies random infinite ideal hyperbolic polyhedra and their dual graphs, establishing new boundary theories.

problem Uniformization and boundary theory of random infinite ideal hyperbolic polyhedra and their dual graphs.
method Combinatorics, geometry, analysis, and random walks perspectives.
result Characterization of the ICP type of IAG and convergence of simple random walk to the boundary.

Persistence diagrams from random matrices follow RMT universality, offering a new spectral diagnostic.

problem Understanding spectral properties of random matrices using topological data analysis.
method Applying Morse theory to persistence diagrams of quadratic forms restricted to unit spheres.
result Persistence entropy outperforms traditional level spacing ratios in discriminating random matrix ensembles.