A new method ranks and selects features without model fitting.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We propose a computationally efficient wrapper feature selection method - called Autoencoder and Model Based Elimination of features using Relevance and Redundancy scores (AMBER) - that uses a single ranker model along with autoencoders to perform greedy backward elimination of features. The ranker model is used to pri…
Deep neural networks (DNNs) are famous for their high prediction accuracy, but they are also known for their black-box nature and poor interpretability. We consider the problem of variable selection, that is, selecting the input variables that have significant predictive power on the output, in DNNs. We propose a backw…
We study a notion of good-deal hedging, that corresponds to good-deal valuation for generalized good-deal constraints. Under model uncertainty about the market prices of risk of hedging assets, a robust approach leads to a reduction or even elimination of a speculative component in good-deal hedging, which is shown to …
Exploiting sparsity enables hardware systems to run neural networks faster and more energy-efficiently. However, most prior sparsity-centric optimization techniques only accelerate the forward pass of neural networks and usually require an even longer training process with iterative pruning and retraining. We observe t…
ACI identifies cause-effect relationships and causal influence ranges in dynamical systems.
Neural network training is computationally and memory intensive. Sparse training can reduce the burden on emerging hardware platforms designed to accelerate sparse computations, but it can affect network convergence. In this work, we propose a novel CNN training algorithm Sparse Weight Activation Training (SWAT). SWAT …
New integration method improves BSDE-based PDE solvers.
Backpropagation-free RL method trains layers using local signals.
Developing feature selection algorithms that move beyond a pure correlational to a more causal analysis of observational data is an important problem in the sciences. Several algorithms attempt to do so by discovering the Markov blanket of a target, but they all contain a forward selection step which variables must pas…
New method recovers BSDE from financial data without ergodicity.
A new family of momentum coefficients improves the convergence rate of accelerated algorithms.
When the design matrix has orthonormal columns, "soft thresholding" the ordinary least squares (OLS) solution produces the Lasso solution [Tibshirani, 1996]. If one uses the Puffer preconditioned Lasso [Jia and Rohe, 2012], then this result generalizes from orthonormal designs to full rank designs (Theorem 1). Theorem …
Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.
Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "neighbor explosion" problem during minibatch training. We propose GraphSAINT, a graph sampling based …
Proposes a flexible tournament design combining knockout and round-robin.
Study predicts P2P lending platform failures using machine learning.
In this paper, we study the evolving behaviors of the first eigenvalue of Laplace-Beltrami operator under the normalized backward Ricci flow, construct various quantities which are monotonic under the backward Ricci flow and get upper and lower bounds. We prove that in cases where the backward Ricci flow converges to a…
Deep neural networks have achieved state-of-art performance in many domains including computer vision, natural language processing and self-driving cars. However, they are very computationally expensive and memory intensive which raises significant challenges when it comes to deploy or train them on strict latency appl…
Improved elimination strategies for adaptive bandit identification reduce sample complexity and computational burden.
Classification may not be reliable for several reasons: noise in the data, insufficient input information, overlapping distributions and sharp definition of classes. Faced with several possibilities neural network may in such cases still be useful if instead of a classification elimination of improbable classes is done…
Backward exploration reduces sample complexity in policy evaluation.
The study introduces backward baselines to distinguish past prediction from future prediction in machine learning models.
Training recurrent neural networks (RNNs) on long sequence tasks is plagued with difficulties arising from the exponential explosion or vanishing of signals as they propagate forward or backward through the network. Many techniques have been proposed to ameliorate these issues, including various algorithmic and archite…
The paper extends NUP representations to factor graphs for better estimation.
Study proves existence of equilibrium in incomplete economies with discontinuous volatility.
Scalar dynamic risk measures for univariate positions in continuous time are commonly represented as backward stochastic differential equations. In the multivariate setting, dynamic risk measures have been defined and studied as families of set-valued functionals in the recent literature. There are two possible extensi…
A novel stepwise VI method using vine copulas for complex latent dependence.
New algorithm eliminates arms to minimize regret in complex bandit problems.
Paper presents IMRCs for evolving tasks with forward and backward learning.
Backwards uniqueness proved for flows with asymptotically conical singularities.
SGD converges with perturbed forward-backward passes, explained by geometric amplification.
In this note, we will show a backwards uniqueness theorem of the mean curvature flow with bounded second fundamental form in arbitrary codimension.
Learning how to act when there are many available actions in each state is a challenging task for Reinforcement Learning (RL) agents, especially when many of the actions are redundant or irrelevant. In such cases, it is sometimes easier to learn which actions not to take. In this work, we propose the Action-Elimination…
Scalable feature selection improves GBDT model training speed.
We propose a simple technique for encouraging generative RNNs to plan ahead. We train a "backward" recurrent network to generate a given sequence in reverse order, and we encourage states of the forward model to predict cotemporal states of the backward model. The backward network is used only during training, and play…
In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time-continuous or time-discrete forward-backward stochastic differential equations (FBSDE) final-value or control problems, how these final val…
We introduce Neural Choice by Elimination, a new framework that integrates deep neural networks into probabilistic sequential choice models for learning to rank. Given a set of items to chose from, the elimination strategy starts with the whole item set and iteratively eliminates the least worthy item in the remaining …
In this paper, we further study the forward-backward envelope first introduced in [28] and [30] for problems whose objective is the sum of a proper closed convex function and a twice continuously differentiable possibly nonconvex function with Lipschitz continuous gradient. We derive sufficient conditions on the origin…
Backward SDEs help price XVA for OTC derivatives.
Aims to eliminate domain bias in authentication without domain labels.
The study examines backward compatibility issues in ML systems, especially with noisy data.
Recurrent neural networks' hidden state can be reconstructed from its past, providing a theoretical framework for stability and tracking.
New method uses backward SDEs for deep learning uncertainty.
A new unsupervised learning method calibrates rough volatility models efficiently.
Backward propagation rules for warped products under Ricci flow.
Paper approximates backward heat equation using wave equations and Ricci flow.
In this paper, we prove a unique continuation or ``backwards-uniqueness'' theorem for solutions to the Ricci flow. A particular consequence is that the isometry group of a solution cannot expand within the lifetime of the solution.