Accelerates ERM problems with LPI-GD and improved oracle complexity.
problem Empirical Risk Minimization (ERM) problems with strong convexity and smoothness.
method Local Polynomial Interpolation-based Gradient Descent (LPI-GD) and accelerated methods.
result Oracle complexity improved to $ ilde{O}\left(\sqrtσ m^d \log(1/\varepsilon)
ight)$.
Piecewise polynomial interpolation-based gradient descent reduces oracle complexity for smooth loss functions.
problem Optimizing empirical risk minimization loss functions
method Piecewise polynomial interpolation-based gradient descent
result Oracle complexity is reduced for smooth loss functions
Deep networks can interpolate noisy data without losing generalization.
problem Characterizing the relationship between interpolation and generalization in overparameterized deep networks.
method Analyzing the loss landscape of neural network functions over volumes around training data points, varying model parameters and training epochs.
result Loss sharpness in the input space follows a double descent, with large models predicting noisy targets over larger volumes around training data points.
A new tradeoff between regularization and sharpness improves model performance in overparameterized settings.
problem Improving model performance in overparameterized settings with minimum-norm interpolators.
method Proposes a regularization-sharpness tradeoff for overparameterized linear regression with an ℓ^p penalty.
result Empirical validation shows the tradeoff terms can distinguish performant linear interpolators.
New method efficiently interpolates nonparametric density estimators.
problem Efficient evaluation of nonparametric density estimators.
method Piecewise multivariate polynomial interpolation scheme.
result New estimator with low space requirements and efficient querying.
This paper develops a new method for constructing splines on Lie groups using Poisson equation solutions.
problem Existing methods for constructing splines on Lie groups have limitations and assumptions that may not reflect actual curves.
method The paper introduces a new approach using solutions of the Poisson equation on Lie groups to construct splines.
result The new method allows for global splines with arbitrary initial conditions, improving curve reconstruction.
Paper shows faster convergence to local-minimizers in over-parametrized models under interpolation-like conditions.
problem Escaping saddle-points in over-parametrized models.
method Stochastic and deterministic optimization algorithms under interpolation-like conditions.
result Oracle complexity of PSGD and SCRN algorithms to reach ε-local-minimizer matches or improves upon deterministic rates. Unified framework explains why overfitting is benign in interpolating learning.
problem Understanding why overfitting is benign in highly overparameterized models.
method Spectral-transport stability framework.
result Sharp benign-overfitting criterion and explicit phase-transition rates.
The paper extends a variance gamma model to quadratic functions, reducing arbitrage and computational costs.
problem Creating an arbitrage-free interpolation for option pricing models.
method Generalizing the local variance gamma model to a piecewise quadratic local variance function.
result The quadratic model results in an arbitrage-free interpolation of class C3, reducing knots and computational cost.
The study finds flaws in methods used to estimate foreign exchange option prices.
problem Flaws in estimating foreign exchange option prices.
method Provided counterexamples of popular FX option interpolation methods.
result Popular FX option interpolation methods fail in certain scenarios.
Neural networks can interpolate random data but still generalize well, studied in the NT regime.
problem Understanding how neural networks interpolate random labels and generalize well in the overparametrized regime.
method Characterization of the eigenstructure of the empirical NT kernel and generalization error of NT ridge regression.
result The generalization error is well approximated by polynomial ridge regression with an increased regularization parameter.
This is mainly a survey, explaining how the probabilistic (statistical mechanical) construction of Kahler-Einstein metrics on compact complex manifolds, introduced in a series of works by the author, naturally arises from classical approximation and interpolation problems in complex n-space. A fair amount of background…
We conjecture a closed-form expression of HOMFLY-PT invariants of double twist knots colored by rectangular Young diagrams where the twist is encoded in interpolation Macdonald polynomials. We also put forth a conjecture of cyclotomic expansions of HOMFLY-PT polynomials colored by rectangular Young diagrams for any kno…
Proves a new law of robustness for interpolating arbitrary data distributions.
problem Understanding robust interpolation for arbitrary data distributions.
method Proves a Lipschitzness lower bound for robust interpolation.
result Demonstrates a two-fold law of robustness for interpolating functions.
Exact universal interpolation property for landmark configurations in Euclidean space.
problem Representing and deforming landmark configurations through flows of vector fields.
method Explicitly describe vector fields for exact universal interpolation property in all dimensions.
result Achieve controllability by combining constant and polynomial vector fields.
Private optimization faster on interpolation problems with quadratic growth.
problem Private optimization in interpolation problems.
method Adaptive algorithm with improved sample complexity.
result Exponential improvement in private sample complexity for quadratic growth.
Local Gradient Descent with local steps converges to the centralized model in the interpolation regime.
problem Understanding the implicit bias of Local Gradient Descent in the interpolation regime.
method Analyzing the implicit bias of Local Gradient Descent for classification tasks with linearly separable data.
result The aggregated global model from Local-GD converges exactly to the centralized model in the interpolation regime.
New basis for quantum gl_N invariants derived from Macdonald polynomials.
problem Constructing new bases for quantum gl_N invariants.
method Using interpolation Macdonald polynomials and Okounkov's results.
result Cyclotomic expansions for gl_N invariants and knot invariants.
We seek to improve the data efficiency of neural networks and present novel implementations of parameterized piece-wise polynomial activation functions. The parameters are the y-coordinates of n+1 Chebyshev nodes per hidden unit and Lagrangian interpolation between the nodes produces the polynomial on [-1, 1]. We show …
Noise affects the effectiveness of interpolating models, especially those with strong inductive biases.
problem The impact of noise on interpolating models with strong inductive biases.
method Analyzing linear and classification models with sparse ground truths, proving fast rates for interpolators.
result Strong inductive biases can lead to faster but noisier interpolators, contrary to intuition.
DSoftKI scales GP regression with full derivative observations.
problem Efficiently fitting and predicting full derivative observations in Gaussian Processes.
method Extends SoftKI by using local temperature vectors for interpolation, enabling encoding of local directional sensitivity.
result DSoftKI achieves accurate predictions and scales to larger datasets with full derivative observations.
In this paper we present an algorithm to reduce the area of a surface spanned by a finite number of boundary curves by initiating a variational improvement in the surface. The ansatz we suggest consists of original surface plus a variational parameter t multiplying the numerator H0 of mean curvature function def…
Continuous-time interpolation of volatility surfaces preserving mixtures and arbitrage-free.
problem Interpolation of volatility surfaces
method Constructing a mixture-preserving, arbitrage-free interpolation
result Lifts Brigo-Mercurio to time-varying weights with additive cost
Deep neural networks can interpolate any dataset in the overparametrized regime.
problem Interpolating any dataset with deep neural networks in the overparametrized regime.
method Proving universal approximations and interpolating any dataset with deep neural networks, considering specific conditions on activation functions.
result Interpolation of any dataset is possible in the overparametrized regime with deep neural networks.
Study large deviation in stationarized fully lifted blirp interpolation.
problem Understanding atypical solutions in random optimization problems.
method Large deviation theory applied to fully lifted blirp interpolation.
result Elegant relations uncovered for fundamental interpolating parameters.
New algorithm interpolates data with neural nets, independent of sample size.
problem Understanding neural networks' ability to memorize training data.
method Randomized algorithm for constructing interpolating neural networks.
result Guarantees that are independent of the number of samples, moving beyond worst-case memorization capacity bounds.
Finite element method approximates scalar curvature in arbitrary dimensions.
problem Approximating scalar curvature using finite elements in arbitrary dimensions.
method Piecewise polynomial interpolants of a smooth Riemannian metric on a triangulated polyhedral domain.
result Finite element interpolants converge to scalar curvature with rate O(hr+1) in H−2(Ω) norm. Paper tackles blind polynomial regression for unknown inputs.
problem Fitting a polynomial to unknown or partially known input data.
method Formally defines the problem, proposes algorithmic approaches, and applies to jitter-correction.
result Proposes effective methods for blind polynomial regression.
Typically flat filling, linear or polynomial interpolation methods to generate missing historical data. We introduce a novel optimal method for recreating data generated by a diffusion process. The results are then applied to recreate historical data for stocks.
The paper calibrates a model to market quotes efficiently and arbitrage-free.
problem Calibrating a model to market option quotes efficiently and without arbitrage.
method Piecewise-linear local variance function for efficient calibration.
result Arbitrage-free interpolation of class C2 achieved under one millisecond. New algorithm improves gradient-based ERM for smooth convex losses.
problem Empirical risk minimization of smooth, strongly convex loss functions.
method Iterative gradient-based method with local polynomial regression.
result Oracle complexity of O((pε−1)d/(2η)) for our algorithm. We introduce a new structured kernel interpolation (SKI) framework, which generalises and unifies inducing point methods for scalable Gaussian processes (GPs). SKI methods produce kernel approximations for fast computations through kernel interpolation. The SKI framework clarifies how the quality of an inducing point a…
New law explains why deep learning models often have more parameters than needed.
problem Why deep learning models often have more parameters than classical theory suggests.
method Proved a universal law of robustness for smooth interpolation.
result Smooth interpolation requires d times more parameters than mere interpolation.
Globalizes Jones and Alexander polynomials using topological intersections.
problem Link invariants from graded intersections of Lagrangians.
method Topological model proving the Jones polynomial's well-definedness and constructing globalizations.
result Proves the Jones polynomial and constructs globalizations of Jones and Alexander polynomials.
We improve autoencoder image interpolation by shaping latent space.
problem Incongruities in autoencoder interpolation leading to artifacts or unrealistic results.
method Propose a regularization technique to shape latent space to follow a smooth, locally convex manifold consistent with training images.
result Faithful interpolation between data points achieved.
The implied volatility is a crucial element of any financial toolbox, since it is used for quoting and the hedging of options as well as for model calibration. In contrast to the Black-Scholes formula its inverse, the implied volatility, is not explicitly available and numerical approximation is required. We propose a …
New method improves statistical interpolation for analyzing complex random structures.
problem Analyzing atypical random structures in statistical models.
method Introduces a large deviation upgrade to fully lifted interpolation.
result Allows for easier analysis of atypical random structures.
FFRK automatically extracts features for spatial interpolation without external variables.
problem Spatial interpolation challenges, especially nonstationarity and lack of explanatory variables.
method Feature-Free Regression Kriging (FFRK) method that extracts geospatial features.
result FFRK outperforms classical methods in predicting heavy metal concentrations.
A physics-based method improves data interpolators and regression tasks.
problem Improving accuracy and efficiency in function learning.
method Inspired by statistical mechanics, introduces corrections to minimize energy.
result Improves performance in interpolation and regression tasks, especially in high-dimensional spaces.
Gradient descent on shallow neural networks achieves near-optimal generalization error.
problem Optimizing shallow neural networks with minimal width for generalization and stability.
method Gradient descent in the interpolating regime with minimal width.
result Gradient descent achieves near-optimal generalization error with minimal width.
New 1-cocycles for knots identified via moduli spaces.
problem Identifying knots using topological moduli spaces and 1-cocycles.
method Upgrading Vassiliev invariant to combinatorial 1-cocycles and using Lagrange interpolation.
result Induces non-trivial pairing on knot homology groups.
Recurrent tasks such as pricing, calibration and risk assessment need to be executed accurately and in real-time. Simultaneously we observe an increase in model sophistication on the one hand and growing demands on the quality of risk management on the other. To address the resulting computational challenges, it is nat…
New optimization method helps models generalize better after achieving near-perfect training performance.
problem Models can achieve near-perfect training performance but fail to generalize well to unseen examples.
method GROKtimizer combines rapid convergence to interpolation with post-interpolation norm minimization using Critically Damped Momentum.
result GROKtimizer provides a quadratic speedup over classical gradient descent, offering a natural solution for selecting low-norm interpolating solutions.
We show that two smooth nearby Riemannian metrics can be glued interpolating their scalar curvature. The resulting smooth metric is the same as the starting ones outside the gluing region and has scalar curvature interpolating between the original ones. One can then glue metrics while maintaining inequalities satisfied…
A new method evolves point clouds using B-splines for smooth surfaces.
problem Evolution of smooth surfaces from discrete point clouds.
method Adaptive Lagrangian B-spline framework for geometric evolution.
result Efficient and accurate reproduction of surface evolution phenomena.
This paper constructs PH spline curves with prescribed arc lengths.
problem Interpolating points, tangent directions, and curvatures with prescribed arc-length.
method Local construction of G2 planar PH biarc curves of degree 7. result Prescribed arc-length can be satisfied for any data and any chosen ratio between boundary tangents.
New method interpolates high-dimensional scattered data using kernel theory.
problem Scattered data in high-dimensional spaces defy traditional distributional assumptions.
method Kernel interpolation framework based on integral operator theory.
result Spectra of kernel matrices predict performance of interpolation methods.
Sample- and computationally-efficient distribution estimation is a fundamental tenet in statistics and machine learning. We present SURF, an algorithm for approximating distributions by piecewise polynomials. SURF is: simple, replacing prior complex optimization techniques by straight-forward {empirical probability} ap…