Prediction of dynamical time series with additive noise using support vector machines or kernel based regression has been proved to be consistent for certain classes of discrete dynamical systems. Consistency implies that these methods are effective at computing the expected value of a point at a future time given the …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,181 papers · 148 categories
Trend · papers per month
48 results for “smoothing spline regression”
The paper shows how random ReLU networks converge to smooth splines.
problem Understanding the behavior of shallow ReLU neural networks with random weights.
method Mathematical analysis of L2-regularized regression and gradient descent.
result Random ReLU networks converge to smooth splines as the number of hidden nodes increases.
Bayesian nonparametric LABS model adapts to function smoothness in Besov spaces.
problem Estimating functions with unknown smoothness in Besov spaces.
method Lévy Adaptive B-spline (LABS) regression model with automatic smoothness adaptation.
result LABS posterior contracts around true function in Besov classes at nearly minimax-optimal rates.
The paper determines the optimal number of machines for parallel computing in kernel ridge regression.
problem How many machines can be used in parallel computing for kernel ridge regression?
method Empirical processes method
result Upper bounds on the number of machines are proven to be un-improvable in two important cases.
We study trend filtering, a recently proposed tool of Kim et al. [SIAM Rev. 51 (2009) 339-360] for nonparametric regression. The trend filtering estimate is defined as the minimizer of a penalized least squares criterion, in which the penalty term sums the absolute th order discrete derivatives over the input points…
A new knot selection method for GAMs reduces model complexity.
problem Choosing optimal knots for B-spline regression in GAMs.
method Adaptive splines combined with Fellner-Schall tuning for automatic knot selection.
result Comparable performance with P-splines but using fewer knots.
Kolmogorov-Arnold Networks achieve optimal convergence rates in nonparametric regression.
problem Nonparametric function approximation in multivariate settings.
method Structured additive and multiplicative KANs using B-splines.
result Achieve minimax-optimal convergence rate for Sobolev space functions.
The paper develops a new method for estimating non-parametric regression functions with spatio-temporal dependencies.
problem Estimating non-parametric regression functions with spatio-temporal dependencies.
method Locally Adaptive Regression Splines (LARS) with ADMM algorithm.
result The method shows superior performance compared to existing techniques.
Paper develops fast low-rank approximation for smoothing splines.
problem Computational infeasibility of fitting cubic smoothing splines to large datasets.
method Low-rank approximation using eigensystem truncation.
result The method provides accurate, fast estimates with error bounds.
Smooths GPS data with splines for noisy, irregularly sampled data.
problem Noisy, irregularly sampled GPS data with non-Gaussian noise.
method Smoothing splines with chosen spline order and tension parameter, allowing for non-Gaussian noise and outliers.
result Effective smoothing and interpolation of GPS data.
Gradient descent training of neural networks leads to solutions close to natural cubic splines.
problem Understanding the implicit bias of gradient descent in neural networks.
method Analysis of gradient descent training for wide neural networks, focusing on the curvature penalty and initialization schemes.
result The solutions of gradient descent training are polyharmonic splines for certain initialization schemes.
Graph poly-Laplacian method improves regression accuracy.
problem Regression with noisy labels on graphs.
method Graph poly-Laplacian regularization for non-parametric regression.
result Rate of convergence matches known results for smoothing splines.
A new spline method for manifold learning using Hessian-based curvature penalties.
problem Learning manifolds with curvature penalties in high dimensions.
method Generalizes thin-plate splines to flat manifolds using Hessian matrices, minimizing square error with curvature constraints.
result Existence and uniqueness of the spline solution, expressed as Green's functions and Hessian approximations.
Cubic spline smoothing improves interpolation between irregularly sampled data.
problem Interpolation discontinuity in recurrent neural networks for irregularly sampled sequences.
method Cubic spline smoothing compensation module trained end-to-end with ODE-RNN.
result Improves interpolation between irregularly sampled data points.
New approach detects small defects on car surfaces with high accuracy.
problem Automated detection of small defects on specular car surfaces.
method Spline smoothing for feature extraction and k-nearest neighbour classifier.
result Near zero misclassification error rate achieved with standard learning classifiers.
SMART: A Flexible Approach to Regression using Spline-Based Multivariate Adaptive Regression Treesstat.ML
SMART combines decision trees and MARS for better regression modeling.
problem High variance in decision trees for continuous relationships, poor performance in MARS for discontinuities.
method SMART uses a decision tree to identify subsets with distinct continuous relationships, then applies MARS to fit these relationships independently.
result SMART improves regression performance over state-of-the-art methods in capturing discontinuities and continuous relationships.
We propose a novel method to determine the dissimilarity between subjects for functional data clustering. Spline smoothing or interpolation is common to deal with data of such type. Instead of estimating the best-representing curve for each subject as fixed during clustering, we measure the dissimilarity between subjec…
Deep P-Spline automates DNN structure selection for complex regression problems.
problem Challenges in selecting optimal network structures for DNNs.
method Linking neuron selection to knot placement in basis expansion techniques, introducing a difference penalty for automated knot selection.
result Deep P-Spline extends model class and forms a latent variable modeling framework with theoretical guarantees.
Efficient variance estimation for kernel ridge regression.
problem Estimating variance in kernel ridge regression efficiently.
method Random projection approach to estimate variance.
result Optimal variance estimator for various kernels.
Optimally adaptive Bayesian spectral density estimation for stationary and nonstationary processesstat.ME
Optimizes spectral density estimation for stationary and nonstationary processes.
problem Estimating spectral density of time series with complex structure.
method Optimally adaptive Bayesian spectral density estimation using smoothing spline covariance structure.
result Optimal eigendecomposition provides superior performance compared to alternative covariance functions.
Adaptive Bayesian Multivariate Spline Knot Inference with Prior Specifications on Model Complexitystat.ME
Bayesian method for knot inference in multivariate spline regression.
problem Inference on knot locations in multivariate spline regression due to non-differentiability and varying dimensions.
method Fully Bayesian approach with a new prior on knot number and analytic formula for normal model, extended Bayesian information criterion for non-normal cases, reversible jump Markov chain Monte Carlo.
result Demonstrated superior performance in function fitting with jumping discontinuity.
A new method evolves point clouds using B-splines for smooth surfaces.
problem Evolution of smooth surfaces from discrete point clouds.
method Adaptive Lagrangian B-spline framework for geometric evolution.
result Efficient and accurate reproduction of surface evolution phenomena.
In this paper we combine two important extensions of ordinary least squares regression: regularization and optimal scaling. Optimal scaling (sometimes also called optimal scoring) has originally been developed for categorical data, and the process finds quantifications for the categories that are optimal for the regres…
Dimension Reduction and MARSstat.ME
Improves MARS for nonparametric multivariate regression with dimension reduction.
problem High number of basis functions in MARS for high-order interactions.
method Linear combinations of covariates for dimension reduction, facilitating gradient calculation and eigen-analysis for estimation.
result Asymptotic theory and numerical studies show improved performance over MARS.
Kronecker trend filtering improves lattice data smoothing.
problem Estimating smooth functions on lattice data.
method Penalized least squares with Kronecker products of univariate trend filtering penalties.
result Kronecker trend filtering outperforms linear smoothers in high dimensions.
Solve for the Hyperparameter, Skip the Search: Kolmogorov-Optimal Scaling Laws for Spline Regressioncs.LG
KOLMOGOROV-OPTIMAL RESOLUTION ESTIMATION (KORE) solves spline regression without exhaustive search
problem Hyperparameter tuning in spline regression
method Solving for optimal resolution analytically
result KORE matches exhaustive cross-validation and outperforms tuned models
This paper presents an efficient algorithm for evolving point cloud data on smooth manifolds using B-Splines.
problem Evolution of point cloud data on smooth manifolds in higher dimensions.
method Lagrangian approach using adaptive B-Spline interpolation.
result Demonstrates the convergence of geometric quantities and the effectiveness of the approach.
This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline smoothing or locally weighted regression, and the choice of a kernel in multiple kern…
We extend the adaptive regression spline model by incorporating saturation, the natural requirement that a function extend as a constant outside a certain range. We fit saturating splines to data using a convex optimization problem over a space of measures, which we solve using an efficient algorithm based on the condi…
Improves BN graph learning with splines for scalability.
problem Learning accurate BN graph structures from data.
method Score-and-search approach with MARS for CPD modeling.
result Improves BN graph accuracy and scalability.
This work relates the framework of model-based clustering for spatial functional data where the data are surfaces. We first introduce a Bayesian spatial spline regression model with mixed-effects (BSSR) for modeling spatial function data. The BSSR model is based on Nodal basis functions for spatial regression and accom…
We use splines and the Sasaki metric to analyze and compare manifold-valued trajectories.
problem Analyzing and comparing trajectories on Riemannian manifolds.
method Riemannian hierarchical model, Bézier splines, Sasaki metric.
result Spline-based approaches outperform state-of-the-art methods in intensity classification of trajectories.
NQE uses quantile regression for fast SBI with cubic Hermite splines.
problem Efficient Bayesian inference for complex models with limited data.
method Neural Quantile Estimation (NQE) learns quantiles autoregressively and interpolates them using cubic Hermite splines.
result NQE achieves state-of-the-art performance on various benchmark problems.
Highly Adaptive Ridgestat.ML
HAR regression improves performance on small datasets.
problem Small datasets with complex functions.
method Data-adaptive kernel ridge regression using tensor-product spline basis.
result Achieves convergence rate for right-continuous functions.
Develops a new method to model overlapping asymmetric datasets effectively.
problem Handling overlapping asymmetric datasets in data science.
method Twice penalized P-Spline approximation method.
result Improves model fit by over 65% in a real-life dataset.
Application Research of Spline Interpolation and ARIMA in the Field of Stock Market Forecastingq-fin.ST
Combines spline interpolation and ARIMA for stock market forecasting.
problem Limited predictive performance of ARIMA in noisy data.
method Integrates cubic spline interpolation and ARIMA for time series forecasting.
result Demonstrates guidance for short-term stock market forecasting.
SplineCalib calibrates probabilities using splines for better performance.
problem Calibrating probabilities for better accuracy and log-loss.
method Uses smoothing splines to determine a calibration function.
result Significant improvements to log-loss and accuracy on various problems.
Deep model predicts shapes of curves with multiple covariates.
problem Predicting shapes of planar curves with various covariates.
method Deep learning model using complex-valued functions, conditional covariance smoother with modality-specific encoders.
result Model accurately predicts shapes of curves with multimodal covariates.
A new model approximates complex functions in parameter space.
problem Complex and nonlinear functional regression problems.
method Mapping-to-Parameter function model with B-spline free knot placement.
result Robust knot placement algorithms improve model performance.
Bayesian framework for sphere regression using Gaussian fields.
problem Nonparametric regression on the sphere with Gaussian priors.
method Isotropic Gaussian field priors, harmonic structure, exact posterior distributions, optimal spectral truncation, posterior contraction rates.
result Sharp posterior contraction rates for Gaussian priors with polynomially decaying angular power spectra.
Deep networks with ReLU outperform piecewise linear spline methods in function approximation.
problem Comparing expressive power of deep neural networks with ReLU activation to piecewise linear spline methods.
method Comparison of function approximation capabilities between deep neural networks with ReLU activation and piecewise linear spline methods.
result Deep neural networks with ReLU activation can approximate functions better or only slightly worse than piecewise linear spline methods.
Smooth neural TPPs using B-splines for better efficiency and accuracy.
problem Efficiently modeling sequences of events in continuous time with neural networks.
method Directly parametrize the CIF as a non-negative combination of B-spline basis functions, predicting coefficients with a neural network.
result Improved computational efficiency and predictive accuracy compared to existing methods.
Locally-verifiable conditions ensure exactness of spline discrete de Rham complex.
problem Ensuring cohomological equivalence of spline discrete complex to continuous de Rham complex.
method Theoretical analysis and locally-verifiable sufficient conditions for exactness.
result Locally-verifiable conditions guarantee exactness of hierarchical B-spline discrete de Rham complex.
This paper is devoted to the application of B-splines to volatility modeling, specifically the calibration of the leverage function in stochastic local volatility models and the parameterization of an arbitrage-free implied volatility surface calibrated to sparse option data. We use an extension of classical B-splines …
TensorSketch solves Kronecker product regression and non-negative regression.
problem Solving regression problems with Kronecker product matrices.
method Extending TensorSketch to other norms for Kronecker product regression.
result Solving Kronecker product regression and non-negative regression in sublinear time.
New method shows supervised learning can mimic unsupervised learning effectively.
problem The fundamental difference between supervised and unsupervised learning.
method A two-stage procedure where unsupervised model selection is followed by adding outputs without changing parameters.
result Asymptotic out-of-sample risk bounds for various models trained without access to labels.
Dropout Regularization in Extended Generalized Linear Models based on Double Exponential Familiesstat.ML
Dropout improves regularization in flexible models for rare features.
problem Understanding theoretical properties of dropout in generalized linear models.
method Theoretical analysis and application to adaptive smoothing with B-splines.
result Dropout prefers rare features in mean and dispersion parameters.
Unified analysis of multi-task functional linear regression with manifold and composite penalties.
problem Estimating slope functions from functional data with multi-task learning.
method Penalized splines with manifold constraint and composite quadratic penalty.
result Unified convergence upper bound and phase transition behaviors for estimators.