Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4998147196 · Jun 202019922001200920172026
48 results for Fat-Shattering Dimension

Estimates fat-shattering dimension of aggregated function classes.

problem Understanding the complexity of aggregated function classes.
method Analyzes fat-shattering dimension of kk-fold aggregations of real-valued function classes.
result Provides upper and lower bounds on fat-shattering dimension for linear and affine function classes.

New learning rule for quantum measurement classes overcomes uniform convergence issues.

problem Characterizing learnability of POVM hypothesis classes in quantum settings.
method Introduced a new learning rule called denoised ERM to address uniform convergence issues.
result Characterized learnability conditions and sample complexity bounds for POVM classes.

Study robust regression learning under adversarial attacks.

problem Understanding which function classes are learnable in the presence of adversarial attacks.
method Introduced a novel agnostic sample compression scheme and used fat-shattering dimension to construct adversarially robust sample compression schemes.
result Finite fat-shattering dimension classes are learnable in both realizable and agnostic settings.

The study provides a sample complexity estimate for multi-category classifiers with bounded variation.

problem Controlling the deviation between empirical and generalization performances of multi-category classifiers.
method Using the empirical L1-norm covering number and fat-shattering dimension, the study derives a sample size estimate for classifiers of bounded variation.
result The sample size estimate is sufficient for the performances to be close with high probability, improving the dependency on the number of classes.

Characterizes statistical complexity of realizable regression in PAC and online learning.

problem Understanding the statistical complexity of realizable regression in both PAC and online learning settings.
method Introduces minimax instance optimal learners, novel and combinatorial dimensions to characterize learnability.
result Characterizes which classes of real-valued predictors are learnable and provides necessary conditions for learnability.

We obtain the first positive results for bounded sample compression in the agnostic regression setting with the p\ell_p loss, where p[1,]p\in [1,\infty]. We construct a generic approximate sample compression scheme for real-valued function classes exhibiting exponential size in the fat-shattering dimension but independen…

2018-10-03abs ↗pdf ↗

New algorithms achieve near-optimal cumulative loss in nonparametric online learning and games.

problem Fast rates of convergence in nonparametric online regression and classification.
method Randomized proper learning algorithms, hierarchical aggregation, multi-scale extension, stability proof.
result Achieved near-optimal cumulative loss bounds for real-valued and binary games.

New algorithm for learning functions with bounds on error and sample complexity.

problem Learning [0,1][0,1]-valued functions in a prediction model.
method General-purpose algorithm with upper and lower bounds on expected error and sample complexity.
result Improved bounds on sample complexity and agnostic learning conditions.

General lower bounds on neural network approximation in L^p norm.

problem Fundamental limits of neural network expressivity.
method General lower bound proof on approximation in L^p norm, applied to feed-forward neural networks.
result Neural networks can't approximate certain functions as well as previously thought.

New algorithm learns regression models privately under growth condition.

problem Private learning of nonparametric regression models.
method Novel filtering procedure to output stable hypotheses for nonparametric function classes.
result Established first nonparametric private learnability guarantee for diverging fat shattering dimensions.

This article deals with the generalization performance of margin multi-category classifiers, when minimal learnability hypotheses are made. In that context, the derivation of a guaranteed risk is based on the handling of capacity measures belonging to three main families: Rademacher/Gaussian complexities, metric entrop…

2018-09-19abs ↗pdf ↗

New findings on neural networks with non-negative weights and low training error.

problem Does a low training error imply a small outer norm for two-layer neural networks?
method Covering number argument and fat-shattering dimension analysis.
result For non-negative output weights, low training error guarantees a well-controlled outer norm.

Characterizes sample complexity for outcome indistinguishability in machine learning.

problem Outcome indistinguishability in machine learning, focusing on distinguishers and predictors.
method Sample complexity characterized by metric entropy of predictor and distinguisher classes, using dual Minkowski norms.
result Equivalence and tightness of sample complexity characterizations in distribution-specific and distribution-free settings.

We introduce a simple framework for designing private boosting algorithms. We give natural conditions under which these algorithms are differentially private, efficient, and noise-tolerant PAC learners. To demonstrate our framework, we use it to construct noise-tolerant and private PAC learners for large-margin halfspa…

2020-02-04abs ↗pdf ↗

Recent advances in large-margin classification of data residing in general metric spaces (rather than Hilbert spaces) enable classification under various natural metrics, such as string edit and earthmover distance. A general framework developed for this purpose by von Luxburg and Bousquet [JMLR, 2004] left open the qu…

2013-06-11abs ↗pdf ↗

In response to a 1997 problem of M. Vidyasagar, we state a criterion for PAC learnability of a concept class C\mathscr C under the family of all non-atomic (diffuse) measures on the domain ΩΩ. The uniform Glivenko--Cantelli property with respect to non-atomic measures is no longer a necessary condition, and consisten…

2011-05-27abs ↗pdf ↗

Comparative learning combines realizable and agnostic settings for two hypothesis classes, reducing sample complexity.

problem Learning with two hypothesis classes in a more general setting than single hypothesis classes.
method Introduces comparative learning, defines mutual VC dimension and Littlestone dimension, and applies insights to multiaccuracy and multicalibration.
result Sample complexity of comparative learning is characterized by mutual VC dimension and Littlestone dimension.

Quantum machine learning has received significant attention in recent years, and promising progress has been made in the development of quantum algorithms to speed up traditional machine learning tasks. In this work, however, we focus on investigating the information-theoretic upper bounds of sample complexity - how ma…

2015-01-03abs ↗pdf ↗

New algorithm reduces online learning error for unknown feature distributions.

problem Oracle-efficient hybrid online learning with unknown feature and label distributions.
method Computational efficient online predictor using ERM oracle for finite-VC and fat-shattering classes.
result Oracle-efficient sublinear regret bounds for hybrid online learning with unknown feature generation.

New algorithm reduces prediction error in online learning without knowing base measure.

problem Smoothed online learning without knowledge of base measure.
method R-Cover algorithm based on recursive coverings.
result First algorithm to guarantee sublinear regret for agnostic smoothed online learning without prior knowledge of base measure.

Study public-data assisted private stochastic optimization with labeled or unlabeled public data.

problem Limits and capability of public-data assisted differentially private (PA-DP) algorithms in stochastic convex optimization.
method Lower bounds for PA-DP mean estimation and novel methods for leveraging public data in private supervised learning.
result Achieved dimension independent rate for GLM with unlabeled public data, showing optimality.

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a robust classifier, which will be tested on future adversarial examples. The adversar…

2018-10-04abs ↗pdf ↗

Defines and classifies Thurston geometries and connects simplicial volume to Kodaira dimension.

problem Classifying Thurston geometries and understanding their properties.
method Introduces an axiomatic definition for the Kodaira dimension and studies its compatibility with traditional notions.
result Establishes a connection between the simplicial volume and the holomorphic Kodaira dimension, showing implications for smooth Kähler 3-folds.

Paper relates asymptotic dimension to cofinal dimension using coarse proximities.

problem Relating asymptotic dimension to cofinal dimension in metric spaces.
method Introducing coarse proximities and inverse limit constructions.
result Asymptotic dimension is bounded by coarse cofinal dimension and cofinal dimension of Higson corona.

Our goal in this paper is to develop an effective estimator of fractal dimension. We survey existing ideas in dimension estimation, with a focus on the currently popular method of Grassberger and Procaccia for the estimation of correlation dimension. There are two major difficulties in estimation based on this method. …

2013-12-09abs ↗pdf ↗

We introduce a new quasi-isometry invariant of metric spaces called the hyperbolic dimension, hypdim, which is a version of the Gromov's asymptotic dimension, asdim. The hyperbolic dimension is at most the asymptotic dimension, however, unlike the asymptotic dimension, the hyperbolic dimension of any Euclidean space R^…

2004-04-29abs ↗pdf ↗

In the first part of the paper we show how to relate several dimension theories (asymptotic dimension with Higson property, asymptotic dimension of Gromov, and capacity dimension of Buyalo \cite{Buyalo1}) to Nagata-Assouad dimension. This is done by applying two functors on the Lipschitz category of metric spaces: micr…

2006-01-10abs ↗pdf ↗

This paper studies three aspects around dimension datum: (1), a generalization of the dimension datum, which we call the tau-dimension datum; (2), dimension data of disconnected subgroups; (3), compactness of isospectral sets of normal homogeneous spaces.

2018-03-16abs ↗pdf ↗

Random walks on Fuchsian Schottky groups have harmonic measures with lower dimension.

problem Understanding the dimensionality of harmonic measures for random walks.
method Analyzing finite range random walks on Fuchsian Schottky groups.
result Harmonic measures have dimension strictly less than the limit set's Hausdorff dimension.

Given a metric space XX of finite asymptotic dimension, we consider a quasi-isometric invariant of the space called dimension function. The space is said to have asymptotic Assouad-Nagata dimension less or equal nn if there is a linear dimension function in this dimension. We prove that if XX is a tree-graded space …

2009-10-13abs ↗pdf ↗

The study finds limits on dimensions of certain scales and fields for conformal manifolds.

problem Limits on dimensions of almost Einstein scales and normal conformal Killing fields for conformal manifolds.
method Analyzes the submaximal dimensions of spaces of almost Einstein scales and normal conformal Killing fields for connected conformal manifolds, considering different signatures and dimensions.
result Upper bounds on dimensions of almost Einstein scales and normal conformal Killing fields are determined, with examples provided for submaximal dimensions.

Model complexity is an important factor to consider when selecting among graphical models. When all variables are observed, the complexity of a model can be measured by its standard dimension, i.e. the number of independent parameters. When hidden variables are present, however, standard dimension might no longer be ap…

2012-12-12abs ↗pdf ↗

Many 0/1 datasets have a very large number of variables; on the other hand, they are sparse and the dependency structure of the variables is simpler than the number of variables would suggest. Defining the effective dimensionality of such a dataset is a nontrivial problem. We consider the problem of defining a robust m…

2019-02-04abs ↗pdf ↗

We prove that for geometrically finite groups cohomological dimension of the direct product of a group with itself equals 2 times the cohomological dimension dimension of the group.

2019-02-08abs ↗pdf ↗

Estimates dimension of subsets from random samples, proving consistency.

problem Estimating the dimension of a compact subset from random samples.
method Consistency proofs for Minkowski, correlation, and pointwise dimensions using empirical volume function.
result Statistical consistency of estimators for various dimension notions.

The action dimension of a group G is the minimal dimension of a contractible manifold that G acts on properly discontinuously. We show that if G acts properly and cocompactly on a thick Euclidean building, then the action dimension is bounded below by twice the dimension of the building. We also compute the action dime…

2017-03-02abs ↗pdf ↗