Extends tracking guarantees for time-varying variational inequalities.
problem Tracking solutions of time-varying variational inequalities.
method Extends existing results to sublinear solution paths and periodic problems.
result Discrete dynamical systems of periodic time-varying VI can exhibit chaotic behavior or converge to the solution.
We give a proof of the sublinear tracking property for sample paths of random walks on various groups acting on spaces with hyperbolic-like properties. As an application, we prove sublinear tracking in Teichmueller distance for random walks on mapping class groups, and on Cayley graphs of a large class of finitely gene…
We provide a general construction of time-consistent sublinear expectations on the space of continuous paths. It yields the existence of the conditional G-expectation of a Borel-measurable (rather than quasi-continuous) random variable, a generalization of the random G-expectation, and an optional sampling theorem that…
Inexact acquisition solutions in BO lead to sublinear cumulative regret.
problem Inexact maximization of acquisition functions in Bayesian optimization.
method Define inaccuracy measure, establish cumulative regret bounds for GP-UCB and GP-TS.
result Inexact BO algorithms can achieve sublinear cumulative regret under appropriate inaccuracy conditions.
Algorithm minimizes regret and converges to equilibria in Markov games.
problem Regret minimization and convergence to equilibria in general-sum Markov games under adversarial opponents.
method Decentralized algorithm that uses policy optimization and controls path length to achieve sublinear regret.
result Sublinear regret guarantees for convergence to correlated equilibrium in Markov games.
We construct a time-consistent sublinear expectation in the setting of volatility uncertainty. This mapping extends Peng's G-expectation by allowing the range of the volatility uncertainty to be stochastic. Our construction is purely probabilistic and based on an optimal control formulation with path-dependent control …
Algorithm reduces regret in SSP problems with LFA.
problem Finding shortest paths in stochastic environments with linear approximations.
method Uses linear function approximation and stationary policies to minimize regret.
result Achieves sublinear regret under minimal assumptions.
Sharp Liouville theorem for minimal graphs on manifolds with nonnegative Ricci curvature.
problem Characterizing smooth solutions to minimal hypersurface equations on manifolds with nonnegative Ricci curvature.
method Gradient estimate for minimal graphs over Σ with small linear growth of the negative parts of graphic functions via iteration. result Every smooth solution u to minimal hypersurface equation on Σ is a constant provided u has sublinear growth for its negative part. New approach for distributed online optimization of non-convex losses with sublinear regret.
problem Regret evaluation and consensus in distributed, multi-agent systems with non-convex losses.
method Composite regret metric and consensus-based online normalized gradient (CONGD) approach for pseudo-convex losses; offline optimization oracle for general non-convex losses.
result First sublinear regret bound for general distributed online non-convex learning.
Posterior sampling-based EI achieves sublinear regret bounds for expensive function optimization.
problem Theoretical analysis of expected improvement (EI) in Bayesian optimization.
method Randomized posterior sampling of EI.
result Achieves sublinear Bayesian cumulative regret bounds.
The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an alternating manner, in which a gradient step is taken on one block, while keeping the …
A well-known problem in data science and machine learning is {\em linear regression}, which is recently extended to dynamic graphs. Existing exact algorithms for updating the solution of dynamic graph regression require at least a linear time (in terms of n: the size of the graph). However, this time complexity might…
Minimal graphs grow slowly on curved spaces, proving constant solutions.
problem Characterizing minimal graphs with sublinear growth on manifolds.
method New technique to get gradient bounds by integral estimates, no further geometric assumptions.
result Entire solutions are constant when negative part grows like r/logr. Proposes a new method to learn entire solution paths without discretization.
problem Optimizing a family of problems indexed by hyperparameters.
method Parameterizes the solution path with basis functions and solves a single stochastic optimization problem.
result Uniform error of learned path converges linearly to a constant related to basis expressiveness.
New algorithmic view of ℓ2 regularization using ODEs and path-following methods.
problem Optimizing convex loss functions with ℓ2 regularization.
method Established an equivalence between ℓ2-regularized solution paths and ODEs, proposing path-following algorithms based on homotopy methods and numerical ODE solvers.
result The solution path can be viewed as a hybrid of gradient descent and Newton method, providing novel schemes to choose grid points and reducing computational cost.
We relate ergodic-theoretic properties of a very small tree or lamination to the behavior of folding and unfolding paths in Outer space that approximate it, and we obtain a criterion for unique ergodicity in both cases. Our main result is that non-unique ergodicity gives rise to a transverse decomposition of the foldin…
We consider dynamic sublinear expectations (i.e., time-consistent coherent risk measures) whose scenario sets consist of singular measures corresponding to a general form of volatility uncertainty. We derive a càdlàg nonlinear martingale which is also the value process of a superhedging problem. The superhedging strate…
We consider cocycles of isometries on spaces of nonpositive curvature H. We show that the supremum of the drift over all invariant ergodic probability measures equals the infimum of the displacements of continuous sections under the cocycle dynamics. In particular, if a cocycle has uniform sublinear drift, then there…
The paper develops methods to price and hedge options in path-dependent stock models.
problem Pricing and hedging options under complex stock models.
method Develops a path-dependent PDE for option pricing and differentiability of path-dependent SDE solutions.
result Provides formulas for option Greeks and differentiability of path-dependent SDE solutions.
We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization problems are equivalent, in the following sense. Given any instance of an $\ell…
The paper shows how sublinear biLipschitz equivalences affect Morse boundaries of metric spaces.
problem Understanding how sublinear biLipschitz equivalences affect Morse boundaries of metric spaces.
method Defining sublinear biLipschitz equivalence and Morse boundaries, proving invariance under SBEs, using sublinear rays.
result κ-Morse boundaries of proper geodesic metric spaces are invariant under suitable sublinear biLipschitz equivalences.
Study geodesics on graphs with random lengths, proving bi-infinite paths exist.
problem Existence of bi-infinite geodesic paths on graphs with random edge lengths.
method Sublinear Morse geodesics and first passage percolation analysis.
result Proves the existence of bi-infinite geodesic paths in graphs with specific properties.
The paper generalizes Feynman-Kac formula for volatility uncertainty.
problem Calculating sublinear expectation under volatility uncertainty.
method Generalization of Feynman-Kac formula under different hypotheses.
result G-conditional expectation is a viscosity solution of a nonlinear PDE.
Signature tensors uniquely identify ODE solutions.
problem Identifying ODE solutions from signature tensors.
method Geometric theory of nonlinear systems of ODEs.
result Necessary and sufficient algebraic conditions for signature tensors to represent ODE solutions.
BILBO optimizes bilevel problems without repeated lower-level optimizations.
problem Challenges in bilevel optimization, especially in noisy, constrained, and derivative-free settings.
method BILevel Bayesian Optimization (BILBO) that optimizes both levels simultaneously, using confidence-bounds and function query selection.
result Theoretical and empirical evidence of BILBO's effectiveness on various problems.
For a variety of regularized optimization problems in machine learning, algorithms computing the entire solution path have been developed recently. Most of these methods are quadratic programs that are parameterized by a single parameter, as for example the Support Vector Machine (SVM). Solution path algorithms do not …
The paper explores moduli space of heterotic system using two deformation paths.
problem Exploring the moduli space of the heterotic system.
method Considering two dual deformation paths starting from a Kähler solution, one along Bott-Chern cohomology class and the other along Aeppli cohomology class. Using the implicit function theorem to prove local existence of heterotic solutions.
result Established an initial step to construct local moduli coordinates around a Kähler solution.
Sublinear LSVI via LSH reduces runtime to sublinear in actions.
problem Efficiently estimating value functions in reinforcement learning with sublinear runtime.
method Formulated as approximate maximum inner product search, used LSH to solve with sublinear time complexity.
result Sublinear runtime while maintaining LSVI's regret.
Develops a new solver for path-dependent PDEs using signature kernels.
problem Solving path-dependent PDEs (PPDEs) efficiently and accurately.
method Uses signature kernels to solve PPDEs by approximating the solution with minimal norm in a reproducing kernel Hilbert space.
result Proves the consistency of the numerical scheme, ensuring convergence to PPDE solutions as the number of collocation points increases.
The aim of this paper is to introduce the sublinear Higson corona and show that the sublinear Higson corona of Euclidean cone of P and X is decomposed into the product of P and that of X. Here P is a compact metric space and X is unbounded proper metric space. For example, the sublinear Higson corona of n-dimensional E…
We investigate the difficulties of training sparse neural networks and make new observations about optimization dynamics and the energy landscape within the sparse regime. Recent work of \citep{Gale2019, Liu2018} has shown that sparse ResNet-50 architectures trained on ImageNet-2012 dataset converge to solutions that a…
Let Ł be the Laplace operator on Rd, d≥3 or the Laplace Beltrami operator on the harmonic NA group (in particular on a rank one noncompact symmetric space). For the equation Łu−φ(⋅,u)=0 we give necessary and sufficient conditions for the existence of entire bounded or large solutions under…
New algorithm learns optimal path in reinforcement learning with linear approximations.
problem Optimal path learning in reinforcement learning with linear approximations.
method Proposes novel algorithm with Hoeffding-type and Bernstein-type confidence sets.
result Achieves near-optimal regret guarantee for linear mixture SSP.
New model for Knightian uncertainty with jumps.
problem Knightian uncertainty and non-linear jumps.
method Probabilistic construction of non-linear affine processes with jumps.
result Tractable model for Knightian uncertainty with sublinear expectations.
New control theory for self-path-dependent problems solves unique constraints.
problem Optimal control with self-path-dependent constraints in stochastic systems.
method Introduces new HJB equations for variational inequalities with historical maximum controls.
result Value functions are viscosity solutions to HJB equations under Lipschitz conditions.
We give time-slicing path integral formulas for solutions to the heat equation corresponding to a self-adjoint Laplace type operator acting on sections of a vector bundle over a compact Riemannian manifold with boundary. More specifically, we show that such a solution can be approximated by integrals over finite-dimens…
New simulation approaches to evaluating path-dependent options without matrix inversion issues nor Euler bias are evaluated. They employ three main contributions: Stochastic approximation replaces regression in the LSM algorithm; Explicit weak solutions to stochastic differential equations are developed and applied to …
NanoFlow reduces parameter complexity in normalizing flows.
problem Efficient parameter complexity in flow-based models.
method Single neural density estimator with flow indication embedding.
result Sublinear parameter complexity achieved.
This study proposes an approach based on a perturbation technique to construct global solutions to dynamic stochastic general equilibrium models (DSGE). The main idea is to expand a solution in a series of powers of a small parameter scaling the uncertainty in the economy around a solution to the deterministic model, i…
Paper studies portfolio investment under volatility uncertainty and short-sale constraints, improving risk-adjusted returns.
problem Investment portfolio optimization under volatility uncertainty and short-sale constraints.
method Sublinear expectation model to handle volatility uncertainty, constructing SLE-MUV model.
result Pareto frontier of SLE-MUV model is a continuous convex curve with polynomial analytical expression.
Survey on extragradient methods for solving nonlinear equations and inclusions.
problem Approximating solutions of nonlinear equations and inclusions.
method Unified convergence analysis of extragradient and its variants.
result Sublinear convergence rates for different classes of algorithms.
New method uses LSTM and signature theory to solve complex financial PDEs.
problem Solving path-dependent PDEs for financial derivatives pricing.
method Combining LSTM networks and rough paths theory.
result Efficient algorithms for pricing and hedging path-dependent derivatives.
The study examines insurance demand under rough volatility and path-dependent shocks.
problem Optimal insurance and investment strategies under rough volatility and path-dependent shocks.
method Rough volatility model and Hawkes process with power kernel, Functional Ito formula extension.
result Individuals demand more catastrophe insurance when path-dependent effects are considered.
Study the averaging principle for non-autonomous slow-fast systems and apply it to financial local stochastic volatility models.
problem Understanding the behavior of non-autonomous slow-fast systems of stochastic differential equations.
method Prove the averaging principle under specific conditions and apply it to a financial model.
result Prices of derivatives converge to those calculated using the limit model under a risk-neutral measure.
In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to bring this idea to address a challenging problem in statistics, \emph{i.e.} finding …
Improved convergence analysis for decentralized non-convex optimization.
problem Minimizing a sum of smooth non-convex functions over a network.
method Gradient tracking in decentralized stochastic gradient descent (GT-DSGD).
result GT-DSGD achieves network-independent performances matching centralized SGD under certain conditions.
Paper generalizes extragradient methods for solving equations and inclusions with improved convergence rates.
problem Solving equations and inclusions using extragradient methods.
method Unified and generalized extragradient methods for a broader class of algorithms, analyzing sublinear convergence rates.
result Unified and improved convergence results for various extragradient variants.
Solves complex equation for specific geometric solitons.
problem Solving complex Monge-Ampère equation for specific geometric solitons.
method Aubin continuity path and continuity method.
result Initial value of the path parameter has a solution and is open to all.