Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

95190284379 · Jun 202019922001200920172026
48 results for agnostic approximability

Study agnostic RL in large state spaces with weak function approximation.

problem Statistical intractability of agnostic policy learning in various environments.
method Investigates agnostic policy learning with different forms of environment access.
result Agnostic policy learning remains statistically intractable with certain forms of environment access.

New insights into RL with weak function approximation.

problem Statistical complexity of RL with function approximation in large state spaces.
method Agnostic policy learning framework, exploring environment access, coverage, and representational conditions.
result Characterization of fundamental performance bounds and statistical separations.

First proper learning algorithm for Gaussian halfspaces with matching sample and computational complexity.

problem Agnostically learning halfspaces under Gaussian distribution.
method First proper learning algorithm with matching sample and computational complexity.
result First proper learning algorithm for agnostically learning halfspaces under Gaussian distribution with matching sample and computational complexity.

New algorithm finds optimal policy with polynomial trajectories in deterministic systems.

problem Finding optimal policy in deterministic systems with function approximation.
method Novel recursion-based algorithm with tight bounds on error and sample complexity.
result Optimal policy found using O(dimE)O(\dim_E) trajectories with $δ= O\left(ρ/\sqrt{\dim_E} ight)$.

Efficiently learns Single-Index Models with constant factor approximation.

problem Learning Single-Index Models under L22L_2^2 loss with unknown link functions.
method An efficient algorithm using alignment sharpness for optimization.
result Achieves constant factor approximation to optimal loss for various distributions and link functions.

We obtain the first positive results for bounded sample compression in the agnostic regression setting with the p\ell_p loss, where p[1,]p\in [1,\infty]. We construct a generic approximate sample compression scheme for real-valued function classes exhibiting exponential size in the fat-shattering dimension but independen…

2018-10-03abs ↗pdf ↗

The study optimizes polynomial regression for learning under Gaussian distributions.

problem Agnostic learning of Boolean and real-valued functions under Gaussian distributions.
method LP duality and polynomial degree analysis for L1L^1-regression.
result Optimal SQ lower bounds for various function classes.

New SQ lower bound shows complexity nearly matches known upper bound for smoothed agnostic learning.

problem Smoothed agnostic learning of halfspaces under subgaussian distributions.
method Statistical Query (SQ) lower bound using moment-matching hard distribution and linear programming duality.
result First non-trivial lower bound on complexity nearly matches known upper bound.

Study shows depth improves generalization in deep learning models.

problem Understanding why and when depth improves generalization in deep learning.
method Implementation-agnostic state-transition model to analyze depth and generalization.
result Identifies geometric and semigroup mechanisms that keep entropy contribution saturated or polynomial, clarifying depth's statistical advantage.

New algorithm learns halfspaces over hypercube with random bit flips.

problem Agnostic learning of Boolean halfspaces over discrete domains is computationally hard.
method Smoothed analysis with random bit flips for discrete inputs.
result First efficient algorithm for smoothed agnostic learning of halfspaces over Boolean hypercube.

Study selective classification with halfspaces, achieving error bounds under Gaussian distributions.

problem Modeling relationships in subsets of data defined by selection rules.
method Sparse linear classifiers for subsets defined by halfspaces, focusing on Gaussian feature distributions.
result First PAC-learning algorithm for homogeneous halfspace selectors with error guarantee $\bigO*{\sqrt{\mathrm{opt}}}$.

Study shows transductive learning is equivalent to PAC learning for most natural loss functions.

problem Understanding the relationship between transductive and PAC learning models.
method Extending existing results and developing new techniques to analyze the equivalence of the two models.
result Transductive learning is essentially equivalent to PAC learning for realizable learning with most natural loss functions.

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning method. The proposed method combines scalable gradient-based meta-learning with non…

2018-06-11abs ↗pdf ↗

Study learning and refutation in non-interactive LDP, showing sample complexity equivalence.

problem Characterize sample complexity for learning and refutation in non-interactive LDP.
method Characterize sample complexity for agnostic PAC learning in non-interactive LDP protocols.
result Optimal sample complexity for any concept class is captured by the approximate γ2γ_2~norm of a natural matrix associated with the class.

Develops a transparent surrogate model for complex data.

problem Balancing accuracy and transparency in complex decision-making models.
method Partial dependence effects for feature engineering, smart segmentation, and GLM fitting.
result The maidrr GLM closely approximates a black box model and outperforms benchmarks.

A new method learns fair classifiers without sacrificing accuracy.

problem Designing fair classifiers that do not discriminate based on sensitive attributes.
method A model-agnostic multi-objective architecture using a differentiable relaxation of fairness notions.
result Our method achieves lower loss of accuracy compared to current debiasing algorithms.

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an interpretable model. We demonstrate the flexibility of CLE by explaining different models…

2019-10-02abs ↗pdf ↗

A new framework for brain mapping using statistical agnostic methods.

problem Estimating brain connectivity with limited data and controlling false positives.
method Statistical Agnostic Mapping (SAM) based on concentration inequalities.
result Relieves instability and provides less conservative p-value correction.

A new method approximates posterior for VAEs without iterative training.

problem Inference models in VAEs are poor early on, leading to suboptimal models.
method Train generative and inference models independently, using a model-agnostic posterior approximation (MAPA).
result MAPA approximates the true posterior deterministically and can improve density estimation.

New research shows logistic regression can achieve optimal error rate for agnostic learning of halfspaces.

problem Agnostic learning of homogeneous halfspaces with logistic loss.
method Constructing a well-behaved distribution and using logistic regression with additional convex optimization steps.
result Logistic regression can achieve Ω(extrmOPT)Ω(\sqrt{ extrm{OPT}}) misclassification risk, matching the upper bound.

Our research proves neural collapse in deep ResNets and transformers is globally optimal.

problem Understanding neural collapse in deep learning models.
method Analysis of deep regularized transformers and ResNets trained with cross entropy or mean squared error loss.
result Global optima of deep regularized transformers and ResNets are approximately collapsed, becoming more prominent as depth increases.

The paper corrects Bayesian neural network approximations to improve decision quality.

problem Inaccurate posterior approximations in Bayesian neural networks lead to suboptimal decisions.
method Develops methods to calibrate approximate posterior predictive distributions for better decision making.
result Empirically produces higher quality decisions compared to previous methods.

New algorithm learns disjunctions faster than previous methods.

problem Learning Boolean disjunctions in the agnostic PAC model.
method Developed an agnostic learner with complexity 2ildeO(n1/3)2^{ ilde{O}(n^{1/3})}.
result First separation between SQ and CSQ models in distribution-free agnostic learning.

New method for private density estimation of high-dimensional Gaussian mixtures.

problem Private density estimation for mixtures of unrestricted high-dimensional Gaussians.
method Exploits list global stability to prove upper bound on sample complexity.
result First upper bound on sample complexity for agnostic private density estimation.

LUNO linearizes neural operators to quantify their predictive uncertainty.

problem Quantifying the predictive error of neural operators for high-stakes simulations.
method Model linearization to push weight-space uncertainty forward to predictions.
result LUNO provides a practical and theoretically sound way to apply Bayesian methods to neural operators.

Recent work in model-agnostic explanations of black-box machine learning has demonstrated that interpretability of complex models does not have to come at the cost of accuracy or model flexibility. However, it is not clear what kind of explanations, such as linear models, decision trees, and rule lists, are the appropr…

2016-11-22abs ↗pdf ↗

New algorithms save computation in agnostic learning with membership queries.

problem Efficiently learning touchstone classes with membership queries.
method Designing agnostic learning algorithms for circuits with sublinear gates.
result Agnostic learning algorithms for circuits with sublinear gates achieve significant computational savings.

New algorithms improve label complexity for active multi-distribution learning.

problem Active multi-distribution learning with improved label complexity.
method Developed new algorithms for active multi-distribution learning and established improved label complexity upper and lower bounds.
result Improved label complexity upper and lower bounds for active multi-distribution learning.

We consider the problem of estimating the mean and covariance of a distribution from iid samples in Rn\mathbb{R}^n, in the presence of an ηη fraction of malicious noise; this is in contrast to much recent work where the noise itself is assumed to be from a distribution of known type. The agnostic problem includes many…

2016-04-24abs ↗pdf ↗

We revisit the problem of differentially private release of classification queries. In this problem, the goal is to design an algorithm that can accurately answer a sequence of classification queries based on a private training set while ensuring differential privacy. We formally study this problem in the agnostic PAC …

2019-07-31abs ↗pdf ↗

Query access significantly speeds up learning Multi-Index Models under Gaussian distribution.

problem Agnostically learning Multi-Index Models (MIMs) under Gaussian distribution.
method Query access for MIMs with complexity O(k)poly(1/ε)  poly(d)O(k)^{\mathrm{poly}(1/ε)} \; \mathrm{poly}(d) under standard regularity assumptions.
result Query access gives significant runtime improvements over random examples for agnostically learning MIMs.

Boosting with unlabeled data achieves optimal sample complexity in agnostic settings.

problem Boosting's sample inefficiency in agnostic learning.
method Designing an agnostic boosting algorithm with unlabeled data to match ERM's sample complexity.
result The total sample complexity is optimal, with a vanishing fraction needing to be labeled.

Proposes class-agnostic object detection to handle all objects without class labels.

problem Difficulty and cost in creating annotated datasets limit conventional object detection models to specific object types.
method Proposes class-agnostic object detection as a new problem and proposes training and evaluation protocols. Uses adversarial learning to exclude class-specific information.
result Adversarial learning improves class-agnostic detection efficacy.