Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4999148197 · Jun 202019922001200920172026
48 results for subquadratic steps

New method trains shallow neural networks with subquadratic width scaling.

problem Training shallow neural networks with optimal width scaling.
method Polyak-Lojasiewicz condition, smoothness, standard data assumptions, random matrix theory.
result Subquadratic scaling on network width with standard initialization strategies.

New findings show GD converges to a linear interpolator even with quadratic loss function under certain conditions.

problem Understanding convergence of Gradient Descent with quadratic loss functions.
method Parameterized linear regression with quadratic loss function, empirical and theoretical analysis.
result Gradient Descent converges to a linear interpolator even with quadratic loss function under the Edge of Stability regime.

We prove an interior Schauder estimate for the Laplacian on metric products of two dimensional cones with a Euclidean factor, generalizing the work of Donaldson and reproving the Schauder estimate of Guo-Song. We characterize the space of homogeneous subquadratic harmonic functions on products of cones, and identify sc…

2020-02-18abs ↗pdf ↗

LoLCATs improves linearized LLM quality with less memory and compute.

problem Linearizing large language models (LLMs) often degrades model quality and requires expensive training.
method Two-step method: attention transfer and low-rank adaptation.
result Significant improvement in linearizing quality with 20+ points on 5-shot MMLU.

Improved efficient robust regression with near-linear time and subquadratic samples.

problem Robust linear regression with unknown covariance matrix under Gaussian covariates.
method Near-linear time algorithm using subquadratic samples, complemented by SQ and polynomial lower bounds.
result Achieves prediction error O(εκ)O(\sqrt{εκ}) for εκ1εκ\lesssim 1, improving over prior works.

We study the number and the length of systoles on complete finite area orientable hyperbolic surfaces. In particular, we prove upper bounds on the number of systoles that a surface can have (the so-called kissing number for hyperbolic surfaces). Our main result is a bound which only depends on the topology of the surfa…

2014-08-26abs ↗pdf ↗

When performing regression on a dataset with pp variables, it is often of interest to go beyond using main linear effects and include interactions as products between individual variables. For small-scale problems, these interactions can be computed explicitly but this leads to a computational complexity of at least $…

2016-10-17abs ↗pdf ↗

This work addresses dynamic KDE data structures with robustness to adversarial queries.

problem Efficient KDE data structures for dynamic changing data distributions.
method Developed a theoretical framework for KDE data structures that support subquadratic space, sublinear updates, and adaptive queries.
result Theoretical framework and practical implementation of KDE data structures robust to adversarial queries.

Research shows quadratic growth in derivative maxima for certain interval diffeos with parabolic fixed points.

problem Analyzing the growth of derivative maxima for C2C^2 interval diffeomorphisms with parabolic fixed points.
method Examining C2C^2 diffeomorphisms with only parabolic fixed points, focusing on tangency and repelling behavior.
result Maximal growth of derivative maxima is exactly quadratic for diffeomorphisms with a non-quadratic tangency to identity at a repelling fixed point.

Entity resolution seeks to merge databases as to remove duplicate entries where unique identifiers are typically unknown. We review modern blocking approaches for entity resolution, focusing on those based upon locality sensitive hashing (LSH). First, we introduce kk-means locality sensitive hashing (KLSH), which is b…

2018-10-11abs ↗pdf ↗

New algorithms speed up attention computation for large models by limiting matrix entries.

problem Efficiently compute attention matrices for large language models.
method Developed algorithms that exploit the structure of the attention matrix AA to achieve subquadratic time complexity.
result There is a sharp transition at B=Θ(logn)B = Θ(\sqrt{\log n}) for efficient computation of attention matrices.

We study the non Ricci flat gradient steady Kähler Ricci soliton with non-negative Ricci curvature and weak integrability condition of the scalar curvature SS, namely limrr1BrS=0\underline{\lim}_{r\to \infty} r^{-1}\int_{B_r} S=0, and show that it is a quotient of Σ×Cn1k×NkΣ\times \mathbb{C}^{n-1-k}\times N^k, where ΣΣ and NN denot…

2019-08-27abs ↗pdf ↗

In this paper we propose a Bayesian nonparametric approach to modelling sparse time-varying networks. A positive parameter is associated to each node of a network, which models the sociability of that node. Sociabilities are assumed to evolve over time, and are modelled via a dynamic point process model. The model is a…

2016-07-06abs ↗pdf ↗

The paper extends a Liouville theorem to biharmonic functions on manifolds with nonnegative Ricci curvature.

problem Proving that biharmonic functions with certain growth conditions are constant or harmonic.
method Using a new local L2L^2 estimate for the Laplacian of biharmonic functions combined with a mean value inequality.
result Any biharmonic function of subquadratic growth on a manifold with nonnegative Ricci curvature must be harmonic, and any of sublinear growth must be constant.

A general class of Lorentzian metrics, M0xR2M_0 x R^2, ds2=<.,.>+2dudv+H(x,u)du2ds^2 = <.,.> + 2 du dv + H(x,u) du^2, with (M0,<.,.>(M_0, <.,.> any Riemannian manifold, is introduced in order to generalize classical exact plane fronted waves. Here, we start a systematic study of their main geodesic properties: geodesic completeness, geodesic connected…

2002-11-05abs ↗pdf ↗

New algorithm solves unbalanced optimal transport on trees in quasi-linear time.

problem Efficiently solving unbalanced optimal transport problems on trees.
method Proposed an algorithm that solves a more general unbalanced optimal transport problem exactly in quasi-linear time on a tree metric.
result Solves unbalanced optimal transport on trees in quasi-linear time (less than one second for a tree with one million nodes).

LaPSRL achieves optimal regret for isoperimetric RL distributions.

problem Designing RL algorithms with sublinear regret for non-log-concave distributions.
method Posterior Sampling (PSRL) and Langevin sampling (LaPSRL) for isoperimetric distributions.
result LaPSRL achieves order-optimal regret and subquadratic complexity.

The study proves manifolds with positive scalar curvature can be decomposed into spherical and toroidal pieces.

problem Proving manifolds with positive scalar curvature can be decomposed into simpler pieces.
method Using a topological approach, the researchers prove a decomposition theorem for manifolds with positive scalar curvature and subquadratic decay.
result The manifold MM carries a complete Riemannian metric of uniformly positive scalar curvature, answering a conjecture of Gromov.

The paper examines functional properties on manifolds with very negative curvature.

problem Functional properties on manifolds with very negative curvature.
method New Hardy-type inequalities and first and second order inequalities.
result Functional properties typically hold in manifolds with polynomially growing negative curvature.

We improve prediction risk estimation for large datasets using sketching and ridge regression.

problem Estimating prediction risks for large datasets efficiently and accurately.
method Random matrix theory, generalized cross validation, sketched ridge regression ensembles, and ensemble trick.
result Consistent risk estimation and prediction intervals for large-scale datasets.

We consider the problem of performing linear regression over a stream of dd-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without memory constraints. Specifically, consider a sequence of labeled examples $(a_1,b_1)…

2019-04-18abs ↗pdf ↗

Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems. Theoretical guarantees for Alternating Minimization have been hard to come by and are still poorly understood. This is in part because the heuristic is iterative and non-conve…

2013-12-03abs ↗pdf ↗

This paper examines how adversarial perturbations affect model performance and equilibrium learning.

problem Adversarial perturbations and covariate shifts impact model performance and equilibrium learning.
method Characterizes the extrapolation region in regression and classification, analyzes dynamics of adversarial learning games.
result Establishes two directional convergence results: a blessing in regression and a curse in classification.

Implicit Q-learning and SARSA adjust step-sizes automatically, improving stability and performance.

problem Numerical instability and slow progress in Q-learning and SARSA due to step-size calibration.
method Reformulate iterative updates as fixed-point equations, scaling step-sizes inversely with feature norms.
result Implicit methods maintain stability over broader step-size ranges and achieve comparable convergence rates.

Dance Dance Revolution (DDR) is a popular rhythm-based video game. Players perform steps on a dance platform in synchronization with music as directed by on-screen step charts. While many step charts are available in standardized packs, players may grow tired of existing charts, or wish to dance to a song for which no …

2017-03-20abs ↗pdf ↗

The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the algorithm, where the importance of each step decreases with time. This article studies …

2012-12-01abs ↗pdf ↗

The paper explores efficient graph algorithms on geometric graphs and their computational limits.

problem Efficiently solving spectral graph theory problems on geometric graphs.
method Investigates algorithms and hardness results for multiplying vectors, finding spectral sparsifiers, and solving Laplacian systems on K\mathsf{K}-graphs.
result Formal limitations on subquadratic time algorithms for spectral graph theory problems on geometric graphs, including the Gaussian kernel and Neural tangent kernels.

Step decay schedules improve convergence in non-convex optimization.

problem Improving convergence in non-convex optimization problems.
method Analyzing convergence rates of step decay schedules in non-convex, convex, and strongly convex problems.
result Step decay schedules achieve O(lnT/T)\mathcal{O}(\ln T/\sqrt{T}) convergence rates in various optimization scenarios.

We construct a deep portfolio theory. By building on Markowitz's classic risk-return trade-off, we develop a self-contained four-step routine of encode, calibrate, validate and verify to formulate an automated and general portfolio selection process. At the heart of our algorithm are deep hierarchical compositions of p…

2016-05-23abs ↗pdf ↗

In its simplest form, the traffic flow prediction problem is restricted to predicting a single time-step into the future. Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the future based on some finite history is of interest. This problem is significantly mor…

2018-03-04abs ↗pdf ↗

Note on instabilities in super-time-stepping methods for Heston model.

problem Instabilities in super-time-stepping methods applied to Heston model.
method Exploration of explicit super-time-stepping schemes (RK-Chebyshev, RK-Legendre) for Heston model.
result Relevance of stability remarks beyond super-time-stepping schemes.

Study on holonomy of Obata connection on specific nilmanifolds.

problem Characterizing holonomy of Obata connection on 2-step hypercomplex nilmanifolds.
method Explicitly computed curvature tensor to determine conditions for flatness.
result Holonomy algebra of Obata connection is always abelian subalgebra of sl(n,H)\mathfrak{sl}(n, \mathbb{H}).

The study characterizes G₂-structures on 2-step nilpotent Lie groups.

problem Characterizing G₂-structures on 2-step nilpotent Lie groups.
method Analyzing left-invariant purely coclosed G₂-structures on 7-dimensional 2-step nilpotent Lie groups.
result Criteria for Riemannian metrics induced by these structures and determination of isomorphism classes.