Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

244488731975 · Jun 202019922001200920172026
48 results for local function approximation

A new method automatically and dynamically sets learning rates in deep learning.

problem Determining the appropriate learning rate in deep learning tasks is challenging and often subjective.
method Local Quadratic Approximation (LQA) to automatically and dynamically set learning rates.
result The proposed method leads to nearly optimal learning rates in a computationally efficient way.

The study explores various localized bases and their duals for scattered data approximation.

problem Scattered data approximation using radial basis functions.
method Examines different localized bases including Lagrange, Newton, and multiresolution versions, and their duals.
result Localized orthogonal bases, such as the Newton basis, offer symmetric preconditioners and are feasible for scattered data approximation.

Efficient local planning with linear approximations for agents with limited simulator access.

problem Planning with limited simulator access in reinforcement learning.
method Confident Monte Carlo Least Square Policy Iteration (Confident MC-LSPI) and Politex (Confident MC-Politex) algorithms.
result The algorithms can learn the optimal policy with local simulator access, even for linear Q-functions.

Given a graphical model (GM), computing its partition function is the most essential inference task, but it is computationally intractable in general. To address the issue, iterative approximation algorithms exploring certain local structure/consistency of GM have been investigated as popular choices in practice. Howev…

2019-05-14abs ↗pdf ↗

We consider a defaultable asset whose risk-neutral pricing dynamics are described by an exponential Lévy-type martingale. This class of models allows for a local volatility, local default intensity and a locally dependent Lévy measure. We present a pricing method for Bermudan options based on an analytical approximatio…

2016-04-29abs ↗pdf ↗

This paper introduces a new method for semi-supervised learning on high dimensional nonlinear manifolds, which includes a phase of unsupervised basis learning and a phase of supervised function learning. The learned bases provide a set of anchor points to form a local coordinate system, such that each data point xx on…

2009-06-29abs ↗pdf ↗

Improved bounds for function approximation in nonlinear sets.

problem Achieving high probability error with limited samples in nonlinear function approximation.
method Restricting model class to a neighbourhood of the best approximation and estimating sample complexity using tangent and normal spaces' complexities and curvature.
result Improved worst-case bounds for sample complexity in more general sets like tensor networks and neural networks.

In much of the literature on function approximation by deep networks, the function is assumed to be defined on some known domain, such as a cube or a sphere. In practice, the data might not be dense on these domains, and therefore, the approximation theory results are observed to be too conservative. In manifold learni…

2019-08-01abs ↗pdf ↗

Paper studies Transformer learning theory for Euclidean and Riemannian domains.

problem Understanding and optimizing Transformer networks for regression tasks.
method Constructive approximation framework using softmax partition of unity and attention mechanism.
result Transformer can achieve uniform ε-approximation error with minimal parameters.

Paper optimizes multi-fidelity function with fast learning rates.

problem Optimizing a locally smooth function with limited budget and varying fidelity approximations.
method Kometo algorithm that achieves simple regret rates without knowing function smoothness or fidelity assumptions.
result Kometo algorithm outperforms previous methods empirically.

Improved API to achieve optimal error bound and query complexity in local planning.

problem Efficient local planning in discounted MDPs with linear approximation.
method Confident Approximate Policy Iteration (CAPI) for stationary policies, applying to local access simulators.
result Achieves optimal accuracy and query complexity bounds, improving over API.

We design a stochastic algorithm to train any smooth neural network to ε\varepsilon-approximate local minima, using O(ε3.25)O(\varepsilon^{-3.25}) backpropagations. The best result was essentially O(ε4)O(\varepsilon^{-4}) by SGD. More broadly, it finds ε\varepsilon-approximate local minima of any smooth nonconvex function in …

2017-08-29abs ↗pdf ↗

The paper explores transferring functions from one data space to another.

problem Approximating a function on a new data set using a learned function from an old data set.
method Transfer learning from one data space to another, focusing on subsets of the target data space.
result Local smoothness of the function and its lifting are related.

A new TwinGP framework for efficient large-scale GP modeling.

problem Efficiently modeling large-scale Gaussian processes with computational constraints.
method Combines global and local approximations using a subset-of-data approach.
result TwinGP framework performs on par or better than state-of-the-art methods at a fraction of the computational cost.

Paper addresses ERM in LDP, reducing sample complexity for smooth and convex losses.

problem Achieving error α in ERM with non-interactive LDP, especially for high-dimensional data.
method Developed algorithms using Bernstein polynomial and polynomial approximation techniques.
result For smooth and convex losses, sample complexity is linear in dimensionality.

We propose algorithms for approximate filtering and smoothing in high-dimensional Factorial hidden Markov models. The approximation involves discarding, in a principled way, likelihood factors according to a notion of locality in a factor graph associated with the emission distribution. This allows the exponential-in-d…

2019-02-05abs ↗pdf ↗

Sparse optimization refers to an optimization problem involving the zero-norm in objective or constraints. In this paper, nonconvex approximation approaches for sparse optimization have been studied with a unifying point of view in DC (Difference of Convex functions) programming framework. Considering a common DC appro…

2014-07-01abs ↗pdf ↗

In this paper we aim for a generalisation of the Steenrod Approximation Theorem from, concerning a smoothing procedure for sections in smooth locally trivial bundles. The generalisation is that we consider locally trivial smooth bundles with a possibly infinite-dimensional typical fibre. The main result states that a c…

2006-10-07abs ↗pdf ↗

This paper improves the approximation of machine learning models by transforming them to better fit locally pp-integrable functions.

problem The approximation quality of machine learning models can degrade outside compact subsets of the domain.
method Introduces a canonical transformation to enhance the local LpL^p-type universal approximation property.
result The transformed model class, Fexttope\mathscr{F} ext{-tope}, is dense in a finer topology Lμ,extstrictp(Rd,RD)L^p_{μ, ext{strict}}(\mathbb{R}^d,\mathbb{R}^D), improving expressibility.

Deep neural networks perform well on local tasks but struggle with global tasks.

problem Understanding the limitations of overparameterized deep neural networks in learning global functions.
method Introduced kk-local and kk-global functions to study the interplay between depth and function locality.
result Depth is beneficial for learning local functions but detrimental to learning global functions.

Study proposes a nonlocal approximation of the Willmore functional using fractional Allen-Cahn energies.

problem Approximating the Willmore functional using nonlocal methods.
method Gamma-convergence and fractional Laplacian analysis in Fermi coordinates.
result Proves ΓΓ-limsup estimate for the proposed nonlocal approximation.

Let URnU\subseteq\mathbb{R}^{n} be open and convex. We show that every (not necessarily Lipschitz or strongly) convex function f:URf:U\to\mathbb{R} can be approximated by real analytic convex functions, uniformly on all of UU. In doing so we provide a technique which transfers results on uniform approximation on bounded …

2011-12-05abs ↗pdf ↗

This work improves polynomial approximations for functions with asymmetric behavior.

problem Efficiently approximating functions with asymmetric behavior, especially those growing unbounded on one side.
method Introduces weighted deep polynomial approximants that combine learnable deep polynomials with one-sided weights.
result Weighted deep polynomial approximants outperform existing methods in approximating functions with asymmetric behavior.

The paper projects unknown manifolds onto hyperspheres for efficient function approximation.

problem Function approximation from data on unknown manifolds with added errors.
method Projects unknown manifold onto hypersphere and uses localized spherical polynomial kernels.
result Optimal rates of approximation for rough functions are given.

Study agnostic RL in large state spaces with weak function approximation.

problem Statistical intractability of agnostic policy learning in various environments.
method Investigates agnostic policy learning with different forms of environment access.
result Agnostic policy learning remains statistically intractable with certain forms of environment access.

The ropelength of a knot is the quotient of its length by its thickness. We consider a family of energy functions for knots, depending on a power p, which approach ropelength as p increases. We describe a numerically computed trefoil knot which seems to be a local minimum for ropelength; there are nearby critical point…

2002-03-20abs ↗pdf ↗