Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

59118177236 · Jun 202019922001200920172026
48 results for Backward Regression

Proposes a new algorithm for Sparse Bayesian Learning connected to Stepwise Regression.

problem Sparse Bayesian Learning for probabilistic models.
method Coordinate ascent algorithm (RMP) for SBL, showing connection to Stepwise Regression.
result RMP's noise variance parameter limit connects to Stepwise Regression, with derived guarantees.

In this note we propose a new approach towards solving numerically optimal stopping problems via reinforced regression based Monte Carlo algorithms. The main idea of the method is to reinforce standard linear regression algorithms in each backward induction step by adding new basis functions based on previously estimat…

2018-08-07abs ↗pdf ↗

SGD converges with perturbed forward-backward passes, explained by geometric amplification.

problem Analyzing convergence of SGD with perturbed forward-backward passes in composite optimization.
method Characterized propagation and amplification of perturbations, derived convergence guarantees for non-convex and PL objectives.
result Perturbations cascade through the computational graph, affecting convergence order under specific conditions.

New method uses tensor trains for efficient PDE approximation.

problem High-dimensional PDEs and the curse of dimensionality.
method Tensor trains and backward stochastic differential equations for parabolic PDEs.
result Achieves a favorable trade-off between accuracy and computational efficiency.

In this era of big data, feature selection techniques, which have long been proven to simplify the model, makes the model more comprehensible, speed up the process of learning, have become more and more important. Among many developed methods, forward and stepwise feature selection regression remained widely used due t…

2019-10-17abs ↗pdf ↗

Tensor trains simplify solving complex PDEs efficiently.

problem Solving high-dimensional parabolic PDEs using traditional methods is computationally infeasible.
method Reformulate PDEs as backward stochastic differential equations and use tensor train format for compression and efficient computation.
result Tensor train methods achieve a good balance between accuracy and computational efficiency.

Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.

problem Nonlinear Forward Backward Stochastic Differential Equations (FBSDE) with terminal conditions.
method Backward deep BSDE method applied to FBSDE with nonlinear generators and random initial conditions.
result Derives exact and Taylor-based approximations for time-stepping nonlinear BSDEs.

This paper compares linear regression and neural networks for pricing swing options.

problem Pricing swing options using approximation methods.
method Linear regression and neural networks for approximating the continuation value and swing price.
result The approximation methods converge to the actual swing price as the number of functions or Monte Carlo samples increases.

Study numerical methods for singular FBSDEs with degenerate forward component.

problem Numerical approximation of singular fully coupled FBSDEs with degenerate forward component and non-smooth terminal condition.
method Splitting approach to treat diffusion and transport parts separately.
result The splitting method converges with rate 1/2 under structural condition.

The study introduces backward baselines to distinguish past prediction from future prediction in machine learning models.

problem Differentiating between past and future prediction in machine learning models.
method Theoretical, empirical, and normative arguments support a family of simple and efficient statistical tests called backward baselines.
result The study provides a meaningful backward baseline for auditing black-box prediction systems.

Study proves existence of equilibrium in incomplete economies with discontinuous volatility.

problem Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
method Established existence of solution for Markovian quadratic BSDEs with discontinuous generators using unique continuation and backward uniqueness.
result Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.

This study improves stock price prediction for Apple Inc. using feature selection and regression models with technical indicators.

problem Improving stock price prediction accuracy for Apple Inc. using technical indicators.
method Evaluation of 123 technical indicators and 10 regression models on 13 years of Apple Inc. data.
result Combining feature selection with regression models significantly improves prediction accuracy.

Paper presents IMRCs for evolving tasks with forward and backward learning.

problem Incremental learning of evolving tasks with few samples per task.
method Incremental minimax risk classifiers (IMRCs) that exploit forward and backward learning.
result IMRCs provide significant performance improvement, especially with reduced sample sizes.

Backwards uniqueness proved for flows with asymptotically conical singularities.

problem Proving uniqueness of mean curvature flows with specific singularities.
method Developed new global tools to handle singularities, asymptotic structure, and smooth parts of flows.
result Backwards uniqueness for mean curvature flows with asymptotically conical singularities proved.

We propose a simple technique for encouraging generative RNNs to plan ahead. We train a "backward" recurrent network to generate a given sequence in reverse order, and we encourage states of the forward model to predict cotemporal states of the backward model. The backward network is used only during training, and play…

2017-08-22abs ↗pdf ↗

The study examines backward compatibility issues in ML systems, especially with noisy data.

problem Backward compatibility challenges in ML systems, especially with noisy data.
method Empirical analysis of ML systems across different architectures and datasets, focusing on data shifts and noise.
result Backward compatibility issues arise even without data shift due to optimization stochasticity and training on large-scale noisy datasets can significantly decrease compatibility.

Recurrent neural networks' hidden state can be reconstructed from its past, providing a theoretical framework for stability and tracking.

problem Hidden-state stability in RNNs
method Backward coherence analysis
result Almost-sure convergence, rates under mixing, interpretable limiting representation, finite pathwise stopping times, and theoretical framework for time-uniform confidence sequences.

Generative models speed up complex system simulations.

problem Accurately forecasting the dynamics of complex systems at reduced cost.
method Generative Learning of Effective Dynamics (G-LED) using auto-regressive attention and Bayesian diffusion models.
result Generative models can accurately forecast complex system dynamics at lower computational cost.

Backward propagation rules for warped products under Ricci flow.

problem Understanding how warped product structures behave under Ricci flow.
method Establishing sufficient conditions for backward propagation of warped product structures.
result Asymptotically conical shrinkers are multiply-warped products over Einstein manifolds.

In this paper, we prove a unique continuation or ``backwards-uniqueness'' theorem for solutions to the Ricci flow. A particular consequence is that the isometry group of a solution cannot expand within the lifetime of the solution.

2009-06-26abs ↗pdf ↗

DG improves policy gradient efficiency by selectively backpropagating only valuable samples.

problem Expensive backward passes in policy gradient methods reduce efficiency.
method Introduces 'delight' as a forward-pass signal of learning value and a Kondo gate to selectively backpropagate.
result Selective backpropagation reduces backward pass costs without sacrificing learning quality.

Paper proposes efficient training for normalizing flows in Boltzmann generators.

problem Training normalizing flows for Boltzmann generators is computationally challenging and unstable.
method Regression Training of Normalizing Flows (RegFlow) using 2\ell_2-regression.
result RegFlow enables efficient and stable training of normalizing flows for Boltzmann generators.

Unified approach combining BSDEs and PINNs for solving PDEs.

problem Solving high-dimensional partial differential equations.
method Interpolating between BSDEs and PINNs using diffusion loss.
result Unified understanding of numerical approaches for high-dimensional PDEs.

Naive Bayes can be used as a discriminative classifier, matching the definition of logistic regression.

problem The definition of generative and discriminative classifiers.
method Comparing Naive Bayes and logistic regression, showing they can be used in either generative or discriminative ways.
result Naive Bayes can be used as a discriminative classifier.