Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

67134201268 · Jun 202019922001200920172026
48 results for weighted least-squares

New algorithm reduces bias and variance in weighted least-squares solutions.

problem Inconsistent linear least-squares problems with rapidly decaying singular values.
method Regularized block Kaczmarz (ReBlocK) algorithm.
result ReBlocK outperforms RBK and minibatch SGD for inconsistent problems.

Algorithm solves robust linear regression with block Lewis weights.

problem Group distributionally robust least squares problem.
method Algorithm based on geometric construction and block Lewis weights, using accelerated proximal methods.
result Improves over known methods for moderate accuracy regimes and matches state-of-the-art guarantees.

Optimal weight windows are symmetric rectangles centered at peak.

problem Finding the best weight windows for weighted least squares.
method Investigated symmetric and tapered rectangle window weights, showing the best rectangle window is optimal.
result The best rectangle window is optimal for all tapered rectangle window definitions.

New algorithm improves online binary classification with constant time complexity.

problem Online binary classification with rebalancing.
method Non-iteratively reweighted recursive least-squares.
result Exacts converges to batch formulation and outperforms existing algorithms.

Optimal weight windows are found by projecting the origin onto a convex polytope.

problem Finding the best weight windows for a weighted moving average smoother.
method Formulated as a quadratic program and projection onto a convex polytope.
result Optimal weight windows are symmetrical and decrease in weight away from the center.

ESNs trained with Tikhonov least squares approximate ergodic dynamical systems in L2(μ) norm.

problem Approximating ergodic dynamical systems using ESNs.
method Tikhonov least squares regression on ESNs trained on observations from an ergodic dynamical system.
result ESNs trained with Tikhonov least squares approximate the target function in the L2(μ) norm.

Efficient RL for linear MDPs with unknown transitions.

problem Long planning horizons and unknown state transitions in linear mixture MDPs.
method Horizon-free algorithm using weighted least squares with variance and uncertainty awareness.
result Achieves optimal regret up to logarithmic factors.

Study shows overparameterization helps in generalizing from smooth interpolants.

problem Understanding generalization in overparameterized linear models.
method Analysis of random Fourier series model with weighted trigonometric interpolation.
result Weighted trigonometric interpolation leads to lower generalization error in overparameterized scenarios.

This paper optimizes sampling for least-squares approximation.

problem Optimizing sampling for least-squares approximation in arbitrary linear spaces.
method Introducing the Christoffel function to construct near-optimal random sampling strategies.
result The number of samples scales log-linearly in the dimension of the approximation space.

Unified analysis of reweighted least-squares algorithms for linear models.

problem Recovering unknown signals from linear measurements using reweighted least squares.
method Unified asymptotic analysis of IRLS, lin-RFM, and alternating minimization algorithms.
result The algorithms can achieve favorable performance in a few iterations with appropriate reweighting.

We provide a pointwise confidence bound for non-linear least-squares with fixed design.

problem Confidence estimation in non-linear 2\ell^2-regularized least squares.
method Pointwise confidence bound for local minimizers, using weighted norm involving inverse-Hessian.
result The proposed confidence bound scales with the test input's similarity to the training data.

Proposes a new regression method using LpL_p-norms for non-Gaussian noise.

problem Non-Gaussian noise in residuals affects the performance of local least squares regression.
method Introduces local polynomial LpL_p-norm regression, replacing weighted least squares with weighted LpL_p-norm estimation.
result Demonstrates superior performance over local least squares in one-dimensional data and higher dimensions.

The paper tackles robust reinforcement learning with performance guarantees.

problem Finding a robust policy for RMDP with state space uncertainties.
method Proposes RLSPI algorithm for learning optimal robust policy with performance bounds.
result Demonstrates the performance of RLSPI on standard benchmark problems.

Global convergence for robust regression problems via IRLS with enhancements.

problem Global convergence for robust regression problems.
method Augmentations to IRLS to ensure global recovery and improved robustness.
result Global recovery guarantees for robust regression problems, outperforming state-of-the-art algorithms.

Optimistic algorithm reduces regret in non-stationary linear MDPs.

problem Efficient learning in non-stationary linear MDPs with evolving reward and transition.
method OPT-WLSVI, an optimistic model-free algorithm using exponential weights.
result Achieves a regret bound of O~(d5/4H2Δ1/4K3/4)\widetilde{\mathcal{O}}(d^{5/4}H^2 Δ^{1/4} K^{3/4}).

The accuracy of least squares calibration using option premiums and particle filtering of price data to find model parameters is determined. Derivative models using exponential Lévy processes are calibrated using regularized weighted least squares with respect to the minimal entropy martingale measure. Sequential impor…

2017-05-13abs ↗pdf ↗

Efficient method for high-dimensional American option pricing and hedging.

problem High-dimensional American option pricing and hedging.
method Gradient-enhanced sparse Hermite polynomial expansions combined with least squares Monte Carlo.
result Outperforms state-of-the-art methods in high dimensions with comparable computational cost.

The paper addresses statistical inference for online decision-making in a contextual bandit setting.

problem Understanding the performance of reward models in online decision-making with contextual information.
method The paper uses the contextual bandit framework with a linear reward model and the ε\varepsilon-greedy policy to address the exploration-exploitation dilemma. It employs the martingale central limit theorem and inverse propensity score weighting to establish asymptotic normality of parameter estimators.
result The online ordinary least squares estimator and the online weighted least squares estimator are asymptotically normal, providing insights into the performance of the reward model.

Study on consistency of ML methods for moving objects in non-stationary environments.

problem Consistency of machine learning methods for moving objects in non-stationary environments.
method Least squares, ridge regression, and s\ell_s-penalized least squares methods under non-stationary spatial-temporal sampling.
result Consistency and asymptotic normality of the estimates under weak conditions.

Develops a new random forest method for clustered data with improved prediction and inference.

problem Improving prediction and inference accuracy for clustered data with within-cluster dependence.
method Clustered Random Forests, using weighted least squares estimators for leaf predictions.
result Optimal prediction and inference weights vary under covariate shift, necessitating user-chosen weights.

Develops a diagnostic framework for interest rate model calibration, showing equivalence to Weighted Least Squares and revealing boundary-dominated leverage and local parameter instability.

problem Calibration of stochastic interest rate models
method Diagnostic framework using non-linear regression and analytical tractability of At-The-Money caps
result Reveals boundary-dominated leverage and local parameter instability

Dynamic trading strategies, in the spirit of trend-following or mean-reversion, represent an only partly understood but lucrative and pervasive area of modern finance. Assuming Gaussian returns and Gaussian dynamic weights or signals, (e.g., linear filters of past returns, such as simple moving averages, exponential we…

2019-05-31abs ↗pdf ↗

We propose and analyze a variant of the classic Polyak-Ruppert averaging scheme, broadly used in stochastic gradient methods. Rather than a uniform average of the iterates, we consider a weighted average, with weights decaying in a geometric fashion. In the context of linear least squares regression, we show that this …

2018-02-22abs ↗pdf ↗

Proposes a new method for joint sample and feature selection in multi-view data.

problem Cannot detect latent subsets of samples and remove outliers.
method Weighted Sparse Partial Least Squares (/0\ell_\infty/\ell_0-wsPLS) method for joint sample and feature selection.
result Developed globally convergent algorithm and iterative algorithms for multi-view data fusion.

Based on the property that solving the system of linear matrix equations via the column space and the row space projections boils down to an approximation in the least squares error sense, a formulation for learning the weight matrices of the multilayer network can be derived. By exploiting into the vast number of feas…

2018-11-20abs ↗pdf ↗

Estimates network structure and interaction rules from multiple agent trajectories.

problem Modeling multi-agent systems on networks from data.
method Jointly infers network topology and interaction kernels using non-convex optimization.
result ORALS estimator is consistent and asymptotically normal under coercivity conditions.

We study the total least squares (TLS) problem that generalizes least squares regression by allowing measurement errors in both dependent and independent variables. TLS is widely used in applied fields including computer vision, system identification and econometrics. The special case when all dependent and independent…

2014-06-01abs ↗pdf ↗

Presents SPEED, an algorithm for optimal policy evaluation in linear bandits with heteroscedastic noise.

problem Optimal data collection for policy evaluation in linear bandits with heteroscedastic reward noise.
method Formulated an optimal design for weighted least squares estimates, derived the optimal sample allocation, introduced SPEED algorithm, and derived regret bounds.
result SPEED leads to policy evaluation with MSE comparable to oracle strategy and significantly lower than random policy execution.

The paper addresses model averaging and ensembling, providing theoretical and practical insights.

problem Combining least squares estimators from multiple candidate models for improved predictive accuracy.
method Establishes oracle inequalities for Mallows' CpC_p criterion, proposes a novel Mallows-type MA procedure.
result Demonstrates the effectiveness of the proposed Mallows-type MA estimator through numerical experiments.

Proposes a bond portfolio solution for managing interest rate risk.

problem Managing long-term assets and liabilities under interest rate risk.
method Proposes a bond portfolio solution based on ambiguity-averse preferences, accommodating various constraints and interest rate perturbations.
result Optimal portfolio can be computed as a simple generalized least squares problem, enhancing out-of-sample performance.

Generative approach speeds hyperparameter tuning for machine learning models.

problem Computational infeasibility of cross-validation and difficulty of fully Bayesian hyper-parameter learning.
method Combines optimization-based approximations and amortization techniques.
result Rapid evaluation of hyper-parameters over grids or ranges, supporting predictive tuning and uncertainty quantification.

Method aggregates models with different hyper-parameters to adapt to target domain.

problem Choosing hyper-parameters for unsupervised domain adaptation.
method Linear aggregation of models with different hyper-parameters using weighted least squares for vector-valued functions.
result The target error is asymptotically not worse than twice the error of the optimal aggregation.

Stacked regressions improve predictive accuracy by combining estimators.

problem Improve predictive accuracy in regression models.
method Analogous to least-squares, learn combination weights by minimizing regularized empirical risk with nonnegativity constraint.
result The stacked estimator has strictly smaller population risk than the best single estimator, especially when signal-to-noise ratio is small.

This paper is concerned with the sparsification of the input-hidden weights of ELM (Extreme Learning Machine). For ordinary feedforward neural networks, the sparsification is usually done by introducing certain regularization technique into the learning process of the network. But this strategy can not be applied for E…

2018-01-22abs ↗pdf ↗

Corrects distribution shift in target shift scenarios using importance weighting.

problem Analyzes importance weighting for correcting distribution shift under target shift.
method Analyzed importance-weighted kernel ridge regression under target shift.
result Shows that importance weighting corrects the train-test mismatch without altering input-space complexity.

Optimizes mixture models without parametrizing distributions using tensor decomposition.

problem Estimating conditionally-independent mixture models in high dimensions.
method Alternating least squares optimization scheme for tensor decomposition.
result Competitive performance and applicability to various models and applications.

Normalization methods such as batch [Ioffe and Szegedy, 2015], weight [Salimansand Kingma, 2016], instance [Ulyanov et al., 2016], and layer normalization [Baet al., 2016] have been widely used in modern machine learning. Here, we study the weight normalization (WN) method [Salimans and Kingma, 2016] and a variant call…

2019-11-18abs ↗pdf ↗