The study introduces backward baselines to distinguish past prediction from future prediction in machine learning models.
problem Differentiating between past and future prediction in machine learning models.
method Theoretical, empirical, and normative arguments support a family of simple and efficient statistical tests called backward baselines.
result The study provides a meaningful backward baseline for auditing black-box prediction systems.
Unified framework for inference in complex nonlinear processes.
problem Challenges in inferring nonlinear continuous stochastic processes with sparse observations and complex topologies.
method Neural Backward Filtering Forward Guiding (NBFFG) framework that constructs a variational posterior using a proxy linear-Gaussian process.
result Empirical results show NBFFG outperforms baselines on synthetic benchmarks and high-dimensional phylogenetic analysis tasks.
ST-BCP narrows the coverage gap in BCP by transforming nonconformity scores.
problem The looseness in BCP's coverage guarantee due to Markov's inequality.
method Introduces a data-dependent transformation of nonconformity scores.
result Reduces the average coverage gap from 4.20% to 1.12% on benchmarks.
Second-order estimator improves continuous-time policy evaluation.
problem Estimating value surfaces from discrete data with time-inhomogeneous dynamics.
method Moment-matching coefficients for high-order generator regression.
result Second-order estimator consistently outperforms Bellman baseline.
In this paper, we present a technique that improves the process of training an agent (using RL) for instruction following. We develop a training curriculum that uses a nominal number of expert demonstrations and trains the agent in a manner that draws parallels from one of the ways in which humans learn to perform comp…
Accelerates Birkhoff projection for manifold-constrained hyper-connections with high accuracy and speed.
problem Inaccurate and slow Birkhoff projection in mHC implementations.
method Dual formulation, Newton's method, implicit differentiation, warp-level CUDA kernel.
result Substantial speedups and accuracy improvements in doubly stochastic projections.
Unified discrete diffusion for categorical data simplifies training and sampling.
problem Training and sampling in discrete diffusion models for categorical data.
method Mathematical simplifications and elegant unification of discrete-time and continuous-time discrete diffusion.
result Unified Simplified Discrete Denoising Diffusion (USD3) outperforms SOTA baselines.
Paper presents a new backward deep BSDE method for solving nonlinear FBSDE problems.
problem Nonlinear Forward Backward Stochastic Differential Equations (FBSDE) with terminal conditions.
method Backward deep BSDE method applied to FBSDE with nonlinear generators and random initial conditions.
result Derives exact and Taylor-based approximations for time-stepping nonlinear BSDEs.
In this paper, we study the evolving behaviors of the first eigenvalue of Laplace-Beltrami operator under the normalized backward Ricci flow, construct various quantities which are monotonic under the backward Ricci flow and get upper and lower bounds. We prove that in cases where the backward Ricci flow converges to a…
Deep neural networks have achieved state-of-art performance in many domains including computer vision, natural language processing and self-driving cars. However, they are very computationally expensive and memory intensive which raises significant challenges when it comes to deploy or train them on strict latency appl…
AMI framework improves text generation by optimizing mutual information between source and target.
problem Previous MI approaches ignored the backward network, leading to loose variational bounds.
method AMI is a saddle point optimization framework that iteratively promotes and demotes generated instances.
result AMI significantly outperforms baselines on various text generation tasks.
We propose the Limited Multi-Label (LML) projection layer as a new primitive operation for end-to-end learning systems. The LML layer provides a probabilistic way of modeling multi-label predictions limited to having exactly k labels. We derive efficient forward and backward passes for this layer and show how the layer…
The paper extends NUP representations to factor graphs for better estimation.
problem Nontrivial model-based estimation problems.
method Augmenting factor graphs with convex-dual variables and NUP representations; proposing a new iterative algorithm.
result A new dual algorithm for state space problems.
Study proves existence of equilibrium in incomplete economies with discontinuous volatility.
problem Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
method Established existence of solution for Markovian quadratic BSDEs with discontinuous generators using unique continuation and backward uniqueness.
result Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
Scalar dynamic risk measures for univariate positions in continuous time are commonly represented as backward stochastic differential equations. In the multivariate setting, dynamic risk measures have been defined and studied as families of set-valued functionals in the recent literature. There are two possible extensi…
Paper presents IMRCs for evolving tasks with forward and backward learning.
problem Incremental learning of evolving tasks with few samples per task.
method Incremental minimax risk classifiers (IMRCs) that exploit forward and backward learning.
result IMRCs provide significant performance improvement, especially with reduced sample sizes.
Backwards uniqueness proved for flows with asymptotically conical singularities.
problem Proving uniqueness of mean curvature flows with specific singularities.
method Developed new global tools to handle singularities, asymptotic structure, and smooth parts of flows.
result Backwards uniqueness for mean curvature flows with asymptotically conical singularities proved.
SGD converges with perturbed forward-backward passes, explained by geometric amplification.
problem Analyzing convergence of SGD with perturbed forward-backward passes in composite optimization.
method Characterized propagation and amplification of perturbations, derived convergence guarantees for non-convex and PL objectives.
result Perturbations cascade through the computational graph, affecting convergence order under specific conditions.
In this note, we will show a backwards uniqueness theorem of the mean curvature flow with bounded second fundamental form in arbitrary codimension.
We propose a simple technique for encouraging generative RNNs to plan ahead. We train a "backward" recurrent network to generate a given sequence in reverse order, and we encourage states of the forward model to predict cotemporal states of the backward model. The backward network is used only during training, and play…
In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time-continuous or time-discrete forward-backward stochastic differential equations (FBSDE) final-value or control problems, how these final val…
In this paper, we further study the forward-backward envelope first introduced in [28] and [30] for problems whose objective is the sum of a proper closed convex function and a twice continuously differentiable possibly nonconvex function with Lipschitz continuous gradient. We derive sufficient conditions on the origin…
Backward SDEs help price XVA for OTC derivatives.
problem XVA valuation for OTC derivatives with default risk.
method Review and apply BSDEs with random horizon.
result Explicit formula for XVA correction terms.
The study examines backward compatibility issues in ML systems, especially with noisy data.
problem Backward compatibility challenges in ML systems, especially with noisy data.
method Empirical analysis of ML systems across different architectures and datasets, focusing on data shifts and noise.
result Backward compatibility issues arise even without data shift due to optimization stochasticity and training on large-scale noisy datasets can significantly decrease compatibility.
Recurrent neural networks' hidden state can be reconstructed from its past, providing a theoretical framework for stability and tracking.
problem Hidden-state stability in RNNs
method Backward coherence analysis
result Almost-sure convergence, rates under mixing, interpretable limiting representation, finite pathwise stopping times, and theoretical framework for time-uniform confidence sequences.
New method uses backward SDEs for deep learning uncertainty.
problem Uncertainty quantification in deep learning models.
method Probabilistic machine learning with stochastic neural networks and stochastic optimal control.
result Effectiveness validated through numerical experiments.
Backward propagation rules for warped products under Ricci flow.
problem Understanding how warped product structures behave under Ricci flow.
method Establishing sufficient conditions for backward propagation of warped product structures.
result Asymptotically conical shrinkers are multiply-warped products over Einstein manifolds.
In this paper, we prove a unique continuation or ``backwards-uniqueness'' theorem for solutions to the Ricci flow. A particular consequence is that the isometry group of a solution cannot expand within the lifetime of the solution.
Study BSΔE on lattices for asset price analysis.
problem Optimal investment and market equilibrium analysis in asset price models.
method Backward stochastic difference equations on lattices.
result Applications to optimal investment and market equilibrium analysis.
The paper defines a frequency for mean curvature flow and proves its monotonicity.
problem Backwards uniqueness for solutions of mean curvature flow.
method Defining and proving monotonicity of a parabolic frequency for mean curvature flows.
result Frequency monotonicity implies backwards uniqueness for mean curvature flow solutions.
Extends SABR model for pricing RFR caplets.
problem Pricing backward RFR caplets in a post-Libor market.
method Closed-form effective SABR parameters for backward RFR caplets.
result Closed-form solution for backward RFR caplets.
DG improves policy gradient efficiency by selectively backpropagating only valuable samples.
problem Expensive backward passes in policy gradient methods reduce efficiency.
method Introduces 'delight' as a forward-pass signal of learning value and a Kondo gate to selectively backpropagate.
result Selective backpropagation reduces backward pass costs without sacrificing learning quality.
BPQP improves efficiency of differentiable optimization layers for deep learning.
problem Efficiency in differentiating optimization problems for deep learning models.
method Reformulates optimization problems as quadratic programming, enabling efficient gradient calculation.
result Significant improvement in efficiency (order of magnitude faster) compared to other differentiable optimization layers.
Paper examines pricing and hedging for cross-currency swaps referencing backward-looking rates.
problem Pricing and hedging cross-currency swaps with backward-looking rates.
method Uses interest rate and currency futures for hedging, analyzes arbitrage-free multi-curve setting.
result Explicit pricing and hedging results for CCBS with backward-looking rates.
Paper proves stability of complex equations under various conditions.
problem Stability of backward stochastic differential equations with jumps.
method General framework for convergent sequences of data and solutions.
result Convergent sequence of solutions for associated data.
The paper develops methods to price options under rough volatility models using BSPDEs.
problem Pricing options in models with non-Markovian dynamics.
method Backward stochastic partial differential equations (BSPDEs) and deep learning for numerical approximations.
result Existence and uniqueness of weak solutions for general nonlinear BSPDEs.
Optimal wealth strategy derived for jump-diffusion models with liabilities.
problem Maximizing utility in jump-diffusion models with random liabilities.
method Forward Backward SDEs system for optimal strategy.
result Explicit results for pure jump model and exponential utilities.
We propose a new method for the numerical solution of backward stochastic differential equations (BSDEs) which finds its roots in Fourier analysis. The method consists of an Euler time discretization of the BSDE with certain conditional expectations expressed in terms of Fourier transforms and computed using the fast F…
The study analyzes implicit biases in neural networks using backward error analysis.
problem Analyzing implicit biases in multitask and continual learning settings.
method Backward error analysis to compute implicit training biases, deriving modified losses with three terms.
result The conflict term, measuring gradient alignment, is a new quantity in continual learning.
New Harnack inequality for heat equation on compact manifolds.
problem Developing a new Harnack inequality for heat equations.
method Gradient estimates by Hamilton combined with backward time comparison.
result Discovered a backward in time Harnack inequality for positive solutions.
FLUID uses flows to unify filtering and smoothing for complex systems.
problem Bayesian filtering and smoothing for high-dimensional nonlinear systems.
method FLUID encodes observation histories into a fixed summary statistic, using flows for filtering and smoothing.
result FLUID provides accurate approximations of filtering and smoothing distributions.
We generalize the primal-dual methodology, which is popular in the pricing of early-exercise options, to a backward dynamic programming equation associated with time discretization schemes of (reflected) backward stochastic differential equations (BSDEs). Taking as an input some approximate solution of the backward dyn…
Method solves optimisation problems on non-Riemannian surfaces with bilateral curvature bounds.
problem Optimisation problems on non-Riemannian surfaces with sharp edges.
method Forward-backward splitting in Alexandrov spaces with bilateral curvature bounds.
result Convergence of the forward-backward method in Alexandrov spaces with bilateral curvature bounds.
This paper develops a new methodology for studying continuous-time Nash equilibrium in a financial market with asymmetrically informed agents. This approach allows us to lift the restriction of risk neutrality imposed on market makers by the current literature. It turns out that, when the market makers are risk averse,…
A new method detects changes in data sequences by comparing backward and forward confidence sequences.
problem Detecting changes in data sequences over time.
method Constructing and comparing backward and forward confidence sequences.
result The method successfully detects changes with strong nonasymptotic guarantees.
In this paper, we introduce a large class of convergent numerical methods, based on (linear) basis function regression technique, to approximate the solution to a forward-backward stochastic differential equation with jumps (FBSDEJ hereafter). Numerical experiment shows good applicability of the proposed method.
We present a novel method in the family of particle MCMC methods that we refer to as particle Gibbs with ancestor sampling (PG-AS). Similarly to the existing PG with backward simulation (PG-BS) procedure, we use backward sampling to (considerably) improve the mixing of the PG kernel. Instead of using separate forward a…
Bayesian units improve speech recognition with minimal parameters.
problem Improving speech recognition models with fewer parameters.
method Derived Bayesian recurrent units integrated into deep learning frameworks.
result Adding Bayesian units improves speech recognition performance.