Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

120239359478 · Jun 202019922001200920172026
48 results for backward feature correction

Study on feature learning dynamics in infinite-depth neural networks, focusing on ResNets.

problem Understanding how features evolve during training in deep neural networks, especially in the large-depth limit.
method Conditional Gaussian representations and SDE system with decoupled backward weights.
result Depth-induced suppression of forward-backward coupling in infinite-depth networks, leading to a decoupled forward-backward SDE system.

In this era of big data, feature selection techniques, which have long been proven to simplify the model, makes the model more comprehensible, speed up the process of learning, have become more and more important. Among many developed methods, forward and stepwise feature selection regression remained widely used due t…

2019-10-17abs ↗pdf ↗

The aim of this short note is to fill in a gap in our earlier paper [16] on 2BSDEs with reflections, and to explain how to correct the subsequent results in the second paper [15]. We also provide more insight on the properties of 2RBSDEs, in the light of the recent contributions [13, 23] in the so--called GG-framework…

2017-06-26abs ↗pdf ↗

Study loop corrections in random feature models affecting training and test errors.

problem Analyzing loop corrections in random feature models to understand training and test errors.
method Statistical physics and effective field theory approach to study loop corrections.
result Derived loop corrections to training error, test error, and generalization gap.

New Hessian estimates for heat equations on manifolds.

problem Estimating Hessian matrices for heat-type equations on Riemannian manifolds.
method Using Bismut-Stroock Hessian formula, with explicit coefficients and delay/growth rate functions.
result Novel backward weak Harnack inequality and precise pointwise Hessian estimates for eigenfunctions.

This paper proposes a new evaluation metric and boosting method for weight separability in neural network design. In contrast to general visual recognition methods designed to encourage both intra-class compactness and inter-class separability of latent features, we focus on estimating linear independence of column vec…

2019-10-20abs ↗pdf ↗

This work uses adversarial learning to detect and correct feature shifts in various datasets.

problem Detecting and correcting feature shifts in real-world datasets.
method Adversarial learning applied to multiple discriminators to detect and correct feature shifts.
result Mainstream classifiers can effectively localize and correct feature shifts, outperforming existing techniques.

Proposes a progressive label correction method for feature-dependent label noise.

problem Real-world large-scale datasets often suffer from heterogeneous, feature-dependent label noise.
method A progressive label correction algorithm that iteratively refines the model.
result A classifier trained with this strategy converges to be consistent with the Bayes classifier for various noise patterns.

STAS selects optimal spatio-temporal scales for bias correction in precipitation forecasts.

problem Limited prior data and fixed ST scale in existing BCoPs lead to biases in numerical weather predictions.
method End-to-end deep-learning BCoP model STAS with SFM/TFM to automatically adjust spatial and temporal scales.
result STAS outperforms 8 published BCoP methods on threat scores (TS).

Paper proves estimates for heat and conjugate heat equations under Ricci flow, leading to monotonicity of parabolic frequencies.

problem Establishing estimates for heat and conjugate heat equations under Ricci flow.
method Proving matrix Li-Yau-Hamilton estimates for positive solutions to the heat and conjugate heat equations coupled with Ricci flow.
result Monotonicity of parabolic frequencies established up to correction factors.

Study numerical methods for singular FBSDEs with degenerate forward component.

problem Numerical approximation of singular fully coupled FBSDEs with degenerate forward component and non-smooth terminal condition.
method Splitting approach to treat diffusion and transport parts separately.
result The splitting method converges with rate 1/2 under structural condition.

New framework selects key features for better query performance prediction.

problem Predict query performance without relevance judgments.
method Step-wise forward and backward feature selection approach.
result Model with selected features performs as well as complex models and better than non-selective models.

Random feature model shows slow self-correction of generalization gap.

problem Slow deterioration of generalization error in random feature model.
method Examined the dynamic behavior of gradient descent in the model's resonance regime.
result Gradient descent exhibits a self-correction mechanism, reducing generalization gap over time.

Paper finds a new principle for optimizing consumption and wealth using Tsallis entropy.

problem Optimal consumption-investment problem with recursive utility.
method Established connection to quadratic BSDE, derived stochastic maximum principle.
result Proved existence of optimal strategy and analyzed coupled system.

Proposes log density gradient to improve reinforcement learning sample complexity.

problem Residual error in gradient estimation in policy gradient methods.
method Log density gradient method to correct residual error, using state-action discounted distributional formulation.
result Min-max optimization method to approximate log density gradient with on-policy samples, achieving sample complexity of m1/2m^{-1/2}.

How can neural networks such as ResNet efficiently learn CIFAR-10 with test accuracy more than 96%, while other methods, especially kernel methods, fall relatively behind? Can we more provide theoretical justifications for this gap? Recently, there is an influential line of work relating neural networks to kernels in t…

2019-05-24abs ↗pdf ↗

Proposes a model combining difference-attention and error-correction LSTMs for improved time series prediction.

problem Improving accuracy in time series prediction.
method Combines difference-attention LSTM and error-correction LSTM in a cascade approach.
result Improves prediction accuracy in time series.

We propose a modification that corrects for split-improvement variable importance measures in Random Forests and other tree-based methods. These methods have been shown to be biased towards increasing the importance of features with more potential splits. We show that by appropriately incorporating split-improvement as…

2019-03-12abs ↗pdf ↗

We consider the mean-variance hedging problem under partial Information. The underlying asset price process follows a continuous semimartingale and strategies have to be constructed when only part of the information in the market is available. We show that the initial mean variance hedging problem is equivalent to a ne…

2007-03-14abs ↗pdf ↗

New methods ensure feature importance rankings are correct with high probability.

problem Stability issues in feature importance scores due to random sampling.
method Hypothesis testing-based techniques to assess and verify the stability of top-ranked features.
result Ensures the most important features are correct with high-probability guarantees.

Mutual information has been successfully adopted in filter feature-selection methods to assess both the relevancy of a subset of features in predicting the target variable and the redundancy with respect to other variables. However, existing algorithms are mostly heuristic and do not offer any guarantee on the proposed…

2019-07-17abs ↗pdf ↗

We propose a novel algorithm which allows to sample paths from an underlying price process in a local volatility model and to achieve a substantial variance reduction when pricing exotic options. The new algorithm relies on the construction of a discrete multinomial tree. The crucial feature of our approach is that -- …

2015-11-03abs ↗pdf ↗

Forward-backward selection is one of the most basic and commonly-used feature selection algorithms available. It is also general and conceptually applicable to many different types of data. In this paper, we propose a heuristic that significantly improves its running time, while preserving predictive accuracy. The idea…

2017-05-30abs ↗pdf ↗

Deep model improves option pricing for CSI 300 index with sentiment and volatility features.

problem Challenges in real market option pricing, especially with constant volatility assumption.
method Deep Forward-Backward Stochastic Differential Equation (FBSDE) framework with dual-network architecture.
result Significant reduction in MAE and MAPE compared to BSM model.

Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.

problem Nonlinear Forward Backward Stochastic Differential Equations (FBSDE) with terminal conditions.
method Backward deep BSDE method applied to FBSDE with nonlinear generators and random initial conditions.
result Derives exact and Taylor-based approximations for time-stepping nonlinear BSDEs.

Proposes a new algorithm for Sparse Bayesian Learning connected to Stepwise Regression.

problem Sparse Bayesian Learning for probabilistic models.
method Coordinate ascent algorithm (RMP) for SBL, showing connection to Stepwise Regression.
result RMP's noise variance parameter limit connects to Stepwise Regression, with derived guarantees.

Unified view of improving tree model interpretability and debiasing feature importance.

problem Improving interpretability and debiasing feature importance in tree-based models.
method Demonstrates a common thread among bias correction methods and local explanations for trees.
result Points out a bias in explainable AI for trees algorithms due to inbag data inclusion.

We adress the maximization problem of expected utility from terminal wealth. The special feature of this paper is that we consider a financial market where the price process of risky assets can have a default time. Using dynamic programming, we characterize the value function with a backward stochastic differential equ…

2008-11-28abs ↗pdf ↗

The paper relaxes constraints on predictive coding models, making them more biologically plausible.

problem Neurophysiological models of predictive coding are not fully biologically plausible.
method The paper relaxes constraints on standard predictive coding algorithms by removing neurally implausible features.
result The removal of neurally implausible features does not significantly affect learning performance.

We study how finite Bayesian neural networks adapt their hidden representations.

problem Understanding how finite Bayesian neural networks differ from infinite ones.
method We analyze the asymptotics of learned feature kernels for various network architectures.
result The leading finite-width corrections to feature kernels have a universal form.