A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Reduced-rank method improves least-squares regression under output regularity.
We study randomized sketching methods for approximately solving least-squares problem with a general convex constraint. The quality of a least-squares approximation can be assessed in different ways: either in terms of the value of the quadratic objective function (cost approximation), or in terms of some distance meas…
Illustrates interleaved learning with Kalman Filter for linear least squares.
Proposes a partitioned least squares model for feature grouping.
We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then performs an ordinary (un-regularized) least squares regression in this subspace. This note shows that …
The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm is closely related to the Kalman filtering, and thus, the KLMS can be interpreted…
The least-squares support vector machine is a frequently used kernel method for non-linear regression and classification tasks. Here we discuss several approximation algorithms for the least-squares support vector machine classifier. The proposed methods are based on randomized block kernel matrices, and we show that t…
This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional construction and employs least-squares functionals as loss functions to determine para…
CD converges linearly for MCP/SCAD penalized least squares.
We propose a new forward-backward stochastic differential equation solver for high-dimensional derivatives pricing problems by combining deep learning solver with least square regression technique widely used in the least square Monte Carlo method for the valuation of American options. Our numerical experiments demonst…
The ratio of two probability densities can be used for solving various machine learning tasks such as covariate shift adaptation (importance sampling), outlier detection (likelihood-ratio test), and feature selection (mutual information). Recently, several methods of directly estimating the density ratio have been deve…
We introduce a novel semi-supervised version of the least squares classifier. This implicitly constrained least squares (ICLS) classifier minimizes the squared loss on the labeled data among the set of parameters implied by all possible labelings of the unlabeled data. Unlike other discriminative semi-supervised method…
A new method for estimating large-scale linear models with improved precision.
Speeds up complex portfolio exposure calculations.
The paper proposes a least squares method for binary compressive sampling with low intrinsic dimension signals.
The family of temporal difference (TD) methods span a spectrum from computationally frugal linear methods like TD(λ) to data efficient least squares methods. Least square methods make the best use of available data directly computing the TD solution and thus do not require tuning a typically highly sensitive learning r…
Study identifies and validates a method for system identification of Markov jump linear systems.
We introduce the implicitly constrained least squares (ICLS) classifier, a novel semi-supervised version of the least squares classifier. This classifier minimizes the squared loss on the labeled data among the set of parameters implied by all possible labelings of the unlabeled data. Unlike other discriminative semi-s…
New method speeds up solving L0-regularized least-squares problems.
A new algorithm solves nonnegative least squares faster with nonnegative data.
Efficient method for high-dimensional American option pricing and hedging.
Paper proposes a pre-conditioning technique to speed up gradient-descent convergence in distributed linear least-squares problems.
Ordinary least squares (OLS) is the default method for fitting linear models, but is not applicable for problems with dimensionality larger than the sample size. For these problems, we advocate the use of a generalized version of OLS motivated by ridge regression, and propose two novel three-step algorithms involving l…
New algorithm reduces sketching dimension to effective problem size.
Unified multi-view learning framework using OPLS with regularization and deep extensions.
Least squares kernel based methods have been widely used in regression problems due to the simple implementation and good generalization performance. Among them, least squares support vector regression (LS-SVR) and extreme learning machine (ELM) are popular techniques. However, the noise sensitivity is a major bottlene…
Cross validation residuals are well known for the ordinary least squares model. Here leave-M-out cross validation is extended to generalised least squares. The relationship between cross validation residuals and Cook's distance is demonstrated, in terms of an approximation to the difference in the generalised residual …
New algorithm reduces bias and variance in weighted least-squares solutions.
Efficiently estimates rotations with corrupted data.
Algorithm solves robust linear regression with block Lewis weights.
We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related to Kernel Partial Least Squares, a regression method that combines supervised dim…
New algorithms estimate Jacobian matrices for large-scale machine learning.
Bayesian system ID improves robustness to sparse, noisy data.
Proposes a method for coarse graph alignment using sparse partial least squares.
It is shown that the the popular least squares method of option pricing converges even under very general assumptions. This substantially increases the freedom of creating different implementations of the method, with varying levels of computational complexity and flexible approach to regression. It is also argued that…
Derivatives on the Chicago Board Options Exchange volatility index (VIX) have gained significant popularity over the last decade. The pricing of VIX derivatives involves evaluating the square root of the expected realised variance which cannot be computed by direct Monte Carlo methods. Least squares Monte Carlo methods…
Extends phase retrieval methods to handle sensing vector errors.
Paper presents novel online MTL methods using WRLS and OSLSSVR.
Paper presents a novel approach to predict volatility using robust least squares method.
The paper uses LSMC to price capped American options with time-dependent caps.
The paper improves Kaczmarz algorithm with momentum for linear least squares.
New algorithm improves online binary classification with constant time complexity.
This paper reviews and compares supervised linear dimension-reduction techniques.
This paper explores alternative regression techniques in pricing American put options and compares to the least-squares method (LSM) in Monte Carlo implemented by Longstaff-Schwartz, 2001 which uses least squares to estimate the conditional expected payoff to the option holder from continuation. The pricing is done und…
We describe a simple Importance Sampling strategy for Monte Carlo simulations based on a least squares optimization procedure. With several numerical examples, we show that such Least Squares Importance Sampling (LSIS) provides efficiency gains comparable to the state of the art techniques, when the latter are known to…
Study on consistency of ML methods for moving objects in non-stationary environments.
Least-squares models such as linear regression and Linear Discriminant Analysis (LDA) are amongst the most popular statistical learning techniques. However, since their computation time increases cubically with the number of features, they are inefficient in high-dimensional neuroimaging datasets. Fortunately, for k-fo…
This work proves convergence of adaptive resampling for random Fourier features.