New method uses saturating splines for feature selection and nonlinear fitting.
problem Nonlinear function fitting and feature selection in data.
method Convex optimization over a space of measures, solved with conditional gradient method.
result Saturation requirement allows simultaneous feature selection and nonlinear fitting.
HAR regression improves performance on small datasets.
problem Small datasets with complex functions.
method Data-adaptive kernel ridge regression using tensor-product spline basis.
result Achieves n−1/3 convergence rate for right-continuous functions. Develops a hierarchical model for analyzing longitudinal data on manifolds.
problem Correlation between intra-subject measurements in nonlinear manifolds.
method Geodesic hierarchical models extended to Bézier spline trends.
result Validated on osteoarthritis data, improving disease progression classification.
Paper finds maximum curvature of Bézier-spline curves.
problem Finding maximum curvature of Bézier-spline curves.
method Modified B-spline solutions for inverse interpolation problem.
result Determined maximum curvature of Bézier-spline curves.
Revisits stochastic collocation with exponential splines for option pricing.
problem Improving the accuracy of option price interpolation using stochastic collocation.
method Uses exponential quadratic splines and optimizes abscissae or parameters of B-splines.
result Shows that fixing abscissae and optimizing parameters leads to better interpolation accuracy.
Paper proves KRR saturation effect for smooth functions.
problem Kernel ridge regression fails to reach theoretical limits for smooth functions.
method Proof of conjectured saturation lower bound for KRR.
result Proved the conjectured saturation lower bound for KRR.
Paper proves regularity and existence of Riemannian splines.
problem Regularity and existence of Riemannian splines on manifolds.
method Generalization of DuBois-Reymond Lemma for higher-order splines.
result Established existence of minimizers for spline energy.
Improves spline quality and accuracy in computational microscopy.
problem Detecting slender, overlapping structures in microscopy images.
method Differentiable rendering approach for spline refinement.
result Achieves high reliability and sub-pixel accuracy.
A new metric measures saturation of neural network layers.
problem Analyzing the quality of latent representations in neural networks.
method Layer Saturation metric based on spectral analysis.
result Saturation is related to generalization and predictive performance.
A method to analyze neural network performance by measuring layer saturation.
problem Understanding which layers contribute to network performance.
method Layer saturation method: restricts layer output to eigenspace of variance matrix.
result Layer saturation indicates which layers contribute to network performance.
Paper develops fast low-rank approximation for smoothing splines.
problem Computational infeasibility of fitting cubic smoothing splines to large datasets.
method Low-rank approximation using eigensystem truncation.
result The method provides accurate, fast estimates with error bounds.
Neural spline flows enhance flow models with rational-quadratic splines.
problem Improving flexibility and density estimation in flow models.
method Proposes a new differentiable module based on monotonic rational-quadratic splines.
result Demonstrates improved performance in density estimation, variational inference, and generative modeling of images.
This paper develops a new method for constructing splines on Lie groups using Poisson equation solutions.
problem Existing methods for constructing splines on Lie groups have limitations and assumptions that may not reflect actual curves.
method The paper introduces a new approach using solutions of the Poisson equation on Lie groups to construct splines.
result The new method allows for global splines with arbitrary initial conditions, improving curve reconstruction.
Sig-Splines model uses signatures and splines for time series data, achieving universality and convexity.
problem Creating a generative model for multivariate time series data.
method Combines linear transformations and signature transforms into a neural spline flow.
result Achieves universality and introduces convexity in model parameters.
Smooths GPS data with splines for noisy, irregularly sampled data.
problem Noisy, irregularly sampled GPS data with non-Gaussian noise.
method Smoothing splines with chosen spline order and tension parameter, allowing for non-Gaussian noise and outliers.
result Effective smoothing and interpolation of GPS data.
With the renewed and growing interest in geometric continuity in mind, this article gives a general definition of geometrically continuous polygonal surfaces and geometrically continuous spline functions on them. Polynomial splines defined by G1 gluing data in terms of rational functions are analyzed further. A general…
Sinh-acceleration speeds up B-spline option pricing.
problem Improving efficiency in option pricing calculations.
method Using sinh-acceleration on B-spline probability density projection.
result SINH acceleration technique improves error control and reduces CPU time.
Combines spline interpolation and ARIMA for stock market forecasting.
problem Limited predictive performance of ARIMA in noisy data.
method Integrates cubic spline interpolation and ARIMA for time series forecasting.
result Demonstrates guidance for short-term stock market forecasting.
A new method evolves point clouds using B-splines for smooth surfaces.
problem Evolution of smooth surfaces from discrete point clouds.
method Adaptive Lagrangian B-spline framework for geometric evolution.
result Efficient and accurate reproduction of surface evolution phenomena.
Novel SVDD framework classifies water saturation from seismic attributes.
problem Difficult classification of water saturation from diverse and non-linear seismic attributes.
method Support Vector Data Description (SVDD) framework with G-metric performance quantification.
result Proposed framework outperforms existing classifiers.
New algorithm for C2-splines on curved spaces.
problem Need for spline interpolation on curved, non-Euclidean space.
method Iterative algorithm for C2-splines on Riemannian symmetric spaces.
result New method surpasses Riemannian cubics in numerical tractability and computational efficiency.
A new nonparametric approach for system identification has been recently proposed where the impulse response is seen as the realization of a zero--mean Gaussian process whose covariance, the so--called stable spline kernel, guarantees that the impulse response is almost surely stable. Maximum entropy properties of the …
New method resolves density ratio estimation saturation issues.
problem Error saturation in density ratio estimation methods.
method Iterated regularization to improve kernel methods.
result Achieves fast error rates on regular learning problems.
A new spline method for manifold learning using Hessian-based curvature penalties.
problem Learning manifolds with curvature penalties in high dimensions.
method Generalizes thin-plate splines to flat manifolds using Hessian matrices, minimizing square error with curvature constraints.
result Existence and uniqueness of the spline solution, expressed as Green's functions and Hessian approximations.
Locally-verifiable conditions ensure exactness of spline discrete de Rham complex.
problem Ensuring cohomological equivalence of spline discrete complex to continuous de Rham complex.
method Theoretical analysis and locally-verifiable sufficient conditions for exactness.
result Locally-verifiable conditions guarantee exactness of hierarchical B-spline discrete de Rham complex.
Deep Random Splines model neural activity data with better dimensionality.
problem Modeling neural population data with shape constraints.
method Deep neural network transforming Gaussian noise into spline parameters.
result Better dimensionality reduction of neural spiking activity.
A new knot selection method for GAMs reduces model complexity.
problem Choosing optimal knots for B-spline regression in GAMs.
method Adaptive splines combined with Fellner-Schall tuning for automatic knot selection.
result Comparable performance with P-splines but using fewer knots.
We use splines and the Sasaki metric to analyze and compare manifold-valued trajectories.
problem Analyzing and comparing trajectories on Riemannian manifolds.
method Riemannian hierarchical model, Bézier splines, Sasaki metric.
result Spline-based approaches outperform state-of-the-art methods in intensity classification of trajectories.
Cubic spline smoothing improves interpolation between irregularly sampled data.
problem Interpolation discontinuity in recurrent neural networks for irregularly sampled sequences.
method Cubic spline smoothing compensation module trained end-to-end with ODE-RNN.
result Improves interpolation between irregularly sampled data points.
We reparametrize ReLU NNs as splines to understand their learning dynamics.
problem Understanding the learning dynamics and inductive bias of neural networks.
method Reparametrize ReLU NNs as continuous piecewise linear splines to study learning dynamics.
result Standard weight initializations yield very flat functions, leading to strength and type of implicit regularization.
Deep networks with ReLU outperform piecewise linear spline methods in function approximation.
problem Comparing expressive power of deep neural networks with ReLU activation to piecewise linear spline methods.
method Comparison of function approximation capabilities between deep neural networks with ReLU activation and piecewise linear spline methods.
result Deep neural networks with ReLU activation can approximate functions better or only slightly worse than piecewise linear spline methods.
Cubic-Spline Flows improve autoregressive flow performance in density estimation.
problem Improving the performance of flow-based models in density estimation.
method Stacking a new coupling transform based on monotonic cubic splines with LU-decomposed linear layers.
result Cubic-Spline Flows close the gap with autoregressive flows on density-estimation tasks.
This paper is devoted to the application of B-splines to volatility modeling, specifically the calibration of the leverage function in stochastic local volatility models and the parameterization of an arbitrage-free implied volatility surface calibrated to sparse option data. We use an extension of classical B-splines …
This paper introduces a spline-based method for nonparametric ADVI that handles complex posterior distributions.
problem Learning complex posterior distributions with skewness, multimodality, and bounded support.
method Develops a spline-based nonparametric approximation approach for ADVI.
result Establishes the asymptotic consistency of the derived lower bound for importance weighted autoencoder.
The paper introduces a spline-based method for calibrating neural networks.
problem Ensuring neural network outputs are reliable for safety-critical applications.
method Approximating the empirical cumulative distribution function using splines to map network outputs to calibrated probabilities.
result The spline-based recalibration consistently outperforms existing methods on calibration measures.
Multivariate splines linked to infinitely-wide neural networks with improved numerical performance.
problem Understanding the relationship between multivariate splines and neural networks.
method Showed multivariate splines can be represented as random features in infinitely-wide neural networks with a homogeneous activation function.
result The function space of multivariate splines is a Sobolev space on a Euclidean ball with explicit norm bounds on derivatives.
The paper normalizes Poisson saturation of coregular submanifolds.
problem Normalizing the Poisson saturation of coregular submanifolds.
method Normal form construction and Poisson geometry analysis.
result Local Poisson saturation of coregular submanifolds is an embedded Poisson submanifold with a normal form.
New method recovers signals from saturated data using linear loss and nonconvex penalties.
problem Signal recovery from saturated measurements with sign information loss.
method Linear loss and nonconvex penalties (e.g., minimax concave penalty, sorted ℓ1 norm).
result Estimation error is bounded and recovery performance improved.
Quantum walks blend patterns into splines when averaged.
problem Understanding the asymptotic patterns of quantum random walks.
method Averaging over quantum coins using the Haar measure.
result Patterns blend into splines, showing a unified behavior.
A new recurrent unit alleviates vanishing gradients for long-term dependencies.
problem Vanishing gradients in recurrent neural networks make long-term dependencies hard to model.
method Proposes a new NRU architecture that avoids saturating activation functions and gates.
result Demonstrates superior performance across various tasks with and without long-term dependencies.
A new modeling framework CSN simplifies and interprets machine learning models.
problem Complexity and interpretability issues in machine learning models.
method Combines spline transformation and cross-network to create CSN.
result CSN is as performant and interpretable as XGBoost and FCNN.
The paper accelerates regression algorithms by identifying saturated coordinates.
problem Non-negative and bounded-variable linear regression problems.
method Safe screening technique to identify saturated coordinates.
result The approach provides theoretical guarantees for identifying saturated coordinates.
A homogeneously saturated equation for the time development of the price of a financial asset is presented and investigated for the pricing of European call options using noise that is distributed as a Student's t-distribution. In the limit that the saturation parameter of the equation equals zero, the standard model o…
Contextual PDA improves explanation of image classifications for saturated models.
problem Difficulty in explaining decisions of saturated classifiers.
method Proposes Contextual PDA, a faster method for explaining image classifications.
result Contextual PDA outperforms PDA in explaining image classifications of state-of-the-art deep networks.
This paper presents an efficient algorithm for evolving point cloud data on smooth manifolds using B-Splines.
problem Evolution of point cloud data on smooth manifolds in higher dimensions.
method Lagrangian approach using adaptive B-Spline interpolation.
result Demonstrates the convergence of geometric quantities and the effectiveness of the approach.
33 curves on a 3-genus surface, all intersecting at most once.
problem Finding a saturated system of curves on a surface of genus 3.
method Constructing 33 essential curves pairwise non-homotopic and intersecting at most once.
result The constructed system is saturated, not properly contained in any other system.
Optimizes deep neural networks using splines and adaptive knots.
problem Improving the optimization of deep neural networks.
method Integrates a second-order total-variation criterion to optimize activation functions, deriving a representer theorem.
result Optimal network configurations can be achieved with nonuniform linear splines with adaptive knots.
This paper explores saturation effects in spectral algorithms over large dimensions.
problem Saturation effects in spectral algorithms over large dimensions.
method Improved minimax lower bound and gradient flow with early stopping strategy.
result Exact convergence rates of spectral algorithms in large dimensional settings.