Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4489133177 · Jun 202019922001200920172026
48 results for iterative peeling

One-Class Boundary Peeling detects outliers efficiently and robustly.

problem Unsupervised outlier detection in diverse data distributions.
method One-Class Boundary Peeling uses flexible boundaries generated by one-class SVMs and iteratively peels them.
result One-Class Boundary Peeling outperforms state-of-the-art methods in synthetic data simulations.

In this paper we study an experimentally-observed connection between two seemingly unrelated processes, one from computational geometry and the other from differential geometry. The first one (which we call "grid peeling") is the convex-layer decomposition of subsets GZ2G\subset \mathbb Z^2 of the integer grid, previous…

2017-10-11abs ↗pdf ↗

Study peels tensor equations on Schwarzschild spacetime.

problem Analyzing the asymptotic behavior of tensorial wave equations on Schwarzschild spacetime.
method Combining conformal compactification and vector field techniques to estimate tensorial field energies.
result Obtains optimal initial data for peeling at all orders.

New model explains neural collapse and limits on minority classes in imbalanced datasets.

problem Understanding and predicting performance limits of deep learning models on imbalanced datasets.
method Layer-Peeled Model, a nonconvex optimization program isolating top layers and applying constraints.
result Reveals a new phenomenon called Minority Collapse that limits deep learning models on minority classes.

New method for causal discovery using peeling algorithms for various data types.

problem Challenges in causal discovery due to unmeasured confounders.
method Two peeling algorithms (bottom-up and top-down) for causal discovery with generalized structural equation models.
result Valid discovery of causal relationships and parent-child effects in diverse data types.

New supervised and unsupervised NFLTs for elliptical distributions.

problem Understanding unsupervised No Free Lunch Theorems for elliptical distributions.
method Proved two equally optimal strategies for elliptical distributions, inspired PRIM-based bump-hunting algorithms.
result Optimal strategies for selecting principal components based on variance or volume.

Faster algorithm for generalized mean densest subgraph problem.

problem Finding subgraphs with highest average pp-th-power degree.
method GENPEEL++ algorithm, which yields (2(p+1))1/p(2(p+1))^{1/p}-approximation for p[1,+)p \in [1, +\infty) with time complexity O(m(logn))O(m(\log n)).
result GENPEEL++ algorithm provides faster and more efficient solution for generalized mean densest subgraph problem.

The paper uncovers symmetries in large language models through layer-peeled optimization.

problem Understanding geometric structure in large language model weights and context embeddings.
method Constrained layer-peeled optimization program to analyze symmetries in next-token distributions.
result Symmetries in target next-token distributions are transferred to optimal model weights and context embeddings.

This paper investigates graph clustering in the planted cluster model in the presence of {\em small clusters}. Traditional results dictate that for an algorithm to provably correctly recover the clusters, {\em all} clusters must be sufficiently large (in particular, Ω~(n)\tildeΩ(\sqrt{n}) where nn is the number of nodes …

2013-02-19abs ↗pdf ↗

Study of Bondi-Sachs formalism for massless scalar field with zero cosmological constant.

problem Analyzing the Bondi-Sachs formalism for Einstein's massless scalar field equations.
method Asymptotic expansions and peeling property for Bondi-Sachs metrics and scalar fields.
result Positivity of Bondi energy-momentum under specific conditions.

Paper explains neural collapse in neural networks using a new model.

problem Understanding neural collapse in neural networks during training.
method Introducing the unconstrained layer-peeled model (ULPM) to prove gradient flow convergence to critical points of a minimum-norm separation problem.
result Proves that all critical points are strict saddle points except the global minimizers exhibiting neural collapse.

The paper develops a robust algorithm for contextual bandits with heavy-tailed rewards.

problem Contextual bandits with heavy-tailed rewards.
method Develops an algorithm based on Catoni's estimator for robust statistics, applying it to contextual bandits with general function approximation.
result Establishes regret bounds that depend on cumulative reward variance and logarithmically on the reward range and number of rounds.

Significant improvements in regret analysis for adaptive online learning problems.

problem Exploiting low variance in online learning problems without known variances.
method Novel peeling-based regret analysis leveraging elliptical potential `count` lemma.
result Significant improvements in regret bounds for linear bandits and linear mixture MDPs.

A lamination of a graph embedded on a surface is a collection of pairwise disjoint non-contractible simple closed curves drawn on the graph. In the case when the surface is a sphere with three punctures (a.k.a. a pair of pants), we first identify the lamination space of a graph embedded on that surface as a lattice pol…

2018-04-05abs ↗pdf ↗

The Sample Compression Conjecture of Littlestone & Warmuth has remained unsolved for over two decades. This paper presents a systematic geometric investigation of the compression of finite maximum concept classes. Simple arrangements of hyperplanes in Hyperbolic space, and Piecewise-Linear hyperplane arrangements, are …

2009-11-18abs ↗pdf ↗

Starting from an arbitrary sequence of polygons whose total perimeter is 2n2n, we can build an (oriented) surface by pairing their sides in a uniform fashion. Chmutov and Pittel (arXiv:1503.01816) have shown that, regardless of the configuration of polygons we started with, the degree sequence of the graph obtained thi…

2019-02-04abs ↗pdf ↗

Paper proposes a privacy-preserving method to control false discoveries.

problem Protecting individual information in hypothesis tests while controlling false discoveries.
method Differentially private adaptive FDR control method with privacy guarantee.
result The method controls the FDR metric exactly at a user-specified level with privacy.

Mixtures of Mallows models are a popular generative model for ranking data coming from a heterogeneous population. They have a variety of applications including social choice, recommendation systems and natural language processing. Here we give the first polynomial time algorithm for provably learning the parameters of…

2018-08-17abs ↗pdf ↗

The paper analyzes generalization in deep contrastive learning.

problem Generalization analysis for unsupervised deep contrastive representation learning.
method Parameter-counting and norm-based bounds derived for neural networks of varying sizes and depths.
result Bounds are independent of network depth and size, reducing dependency on matrix norms.

Study explains how noisyGD with DP improves feature learning despite high dimensionality.

problem Improving feature learning in differential privacy settings with noisyGD.
method Layer-peeled model in representation learning, error bound analysis, feature normalization, PCA.
result Misclassification error is independent of dimension in NC, and PCA improves testing accuracy.

Paper analyzes iterates in high-dimensional linear models and proposes estimators for their generalization error.

problem Analyzing iterates in high-dimensional linear models with comparable feature and sample sizes.
method Novel estimators for generalization error, debiasing corrections, and valid confidence intervals.
result Estimators are n\sqrt{n}-consistent and can be used for early stopping.

Paper analyzes iterative learning for concept classes and learns half-spaces.

problem Learning concept classes efficiently with iterative learners.
method Analyzes various settings of iterative learning and provides a constructive algorithm for half-spaces.
result Constructive iterative algorithm for learning half-spaces from informant.

WaveFit uses fixed-point iteration to create high-quality neural vocoders.

problem Creating high-quality neural vocoders with fast inference.
method Integrates GANs' adversarial training into a DDPM-like iterative framework based on fixed-point iteration.
result WaveFit synthesizes speech with naturalness comparable to human speech, and is significantly faster than existing methods.

In this paper, we introduce the notions of an iterated planar Lefschetz fibration and an iterated planar open book decomposition and prove the Weinstein conjecture for contact manifolds supporting an open book that has iterated planar pages. For n1n\geq 1, we show that a (2n+1)(2n+1)-dimensional contact manifold MM suppor…

2017-10-20abs ↗pdf ↗

Sharp analysis of power iteration for tensor PCA, improving convergence and stopping criteria.

problem Analyzing the power iteration algorithm for tensor PCA to improve convergence and stopping criteria.
method Sharp bounds on the number of iterations, revealing a smaller algorithmic threshold, proposing a stopping criterion.
result Sharp bounds on the number of iterations required for power method to converge, revealing a smaller algorithmic threshold than previously conjectured.

We deduce from the work of Chen, that the restriction morphism from closed free iterated integrals to closed iterated integrals on loops is onto. We use this to show that the module of higher order invariants of smooth functions is generated by free closed iterated integrals.

2010-11-15abs ↗pdf ↗

Adaptive optimal control of nonlinear dynamic systems with deterministic and known dynamics under a known undiscounted infinite-horizon cost function is investigated. Policy iteration scheme initiated using a stabilizing initial control is analyzed in solving the problem. The convergence of the iterations and the optim…

2015-05-20abs ↗pdf ↗

Iterative method learns unknown constraints for MPC control.

problem Learning to satisfy unknown polyhedral state constraints in iterative MPC.
method Collects and improves estimates of unknown constraints using collected data, designs an MPC controller to satisfy the estimated constraints.
result Robust and probabilistic guarantees of constraint satisfaction as a function of task iterations.

Value iteration is a fixed point iteration technique utilized to obtain the optimal value function and policy in a discounted reward Markov Decision Process (MDP). Here, a contraction operator is constructed and applied repeatedly to arrive at the optimal solution. Value iteration is a first order method and therefore …

2019-05-10abs ↗pdf ↗

In this paper we investigate what kind of manifolds arise as the total spaces of iterated S1S^1-bundles. A real Bott tower studied in \cite{CMO}, \cite{KM} and \cite{KN} is an example of an iterated S1S^1-bundle. We show that the total space of an iterated S1S^1-bundle is homeomorphic to an infra-nilmanifold. A real Bo…

2011-08-01abs ↗pdf ↗

Improved generalization with iterate averaging and adaptive algorithms.

problem Enhancing model generalization performance in high-dimensional settings.
method Gaussian process perturbation model, combine IA with large learning rates and regularisation, less frequent averaging, adaptive gradient methods.
result Iterate averaging with adaptive algorithms significantly outperforms SGD on various datasets.

DSPI connects natural policy gradient to policy iteration, proving global convergence.

problem Optimizing policies in reinforcement learning.
method DSPI framework, combining smoothed policy iteration and natural policy gradient.
result DSPI achieves geometric convergence and optimal complexity for policy optimization.