Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

93186278371 · Jun 202019922001200920172026
48 results for discontinuous gradients

Paper analyzes SGHMC for non-convex optimization with discontinuous gradients.

problem Training neural networks with ReLU activation.
method Non-asymptotic convergence analysis of SGHMC with discontinuous gradients.
result Explicit upper bounds for expected excess risk in non-convex optimization.

This paper tackles discontinuous neural networks for better approximation of piecewise continuous functions.

problem Limitation of neural networks in approximating piecewise continuous functions due to discontinuities.
method Proposes a decoupled two-step procedure to train a discontinuous deep neural network model.
result Provides approximation guarantees for the proposed model in piecewise continuous function spaces.

New algorithm tackles optimization problems with discontinuous gradients in finance and insurance.

problem Optimization problems with discontinuous stochastic gradients in finance and insurance.
method Langevin dynamics based algorithm e-THε\varepsilonO POULA.
result Non-asymptotic error bounds and expected excess risk estimates for e-THε\varepsilonO POULA.

This work improves SGMs' convergence guarantees for semiconvex distributions with discontinuous gradients.

problem Establishing convergence guarantees for SGMs under weak regularity conditions.
method Developed non-asymptotic Wasserstein-2 convergence analysis for SGMs targeting semiconvex distributions with discontinuous gradients.
result Achieved optimal dependence of O(d)O(\sqrt{d}) on data dimension dd and convergence rate of order one.

Framework uses deep learning and statistical models to solve PDEs with discontinuous coefficients.

problem Solving PDEs with discontinuous coefficients.
method Two-stage physics-informed deep learning and statistical mixture models.
result Framework achieves adaptability and accurate parameter identification.

In this paper, we present a novel and principled approach to learn the optimal transport between two distributions, from samples. Guided by the optimal transport theory, we learn the optimal Kantorovich potential which induces the optimal transport map. This involves learning two convex functions, by solving a novel mi…

2019-08-28abs ↗pdf ↗

Low-variance gradient estimation is crucial for learning directed graphical models parameterized by neural networks, where the reparameterization trick is widely used for those with continuous variables. While this technique gives low-variance gradient estimates, it has not been directly applicable to discrete variable…

2016-11-04abs ↗pdf ↗

We propose a simple change to existing neural network structures for better defending against gradient-based adversarial attacks. Instead of using popular activation functions (such as ReLU), we advocate the use of k-Winners-Take-All (k-WTA) activation, a C0 discontinuous function that purposely invalidates the neural …

2019-05-25abs ↗pdf ↗

Proposes a method for inference in high-dimensional classification with non-differentiable surrogate losses.

problem Lack of inference procedures for identifying driving factors in high-dimensional classification with non-differentiable surrogate losses.
method Kernel-smoothed decorrelated score and cross-fitted version for hypothesis tests and interval estimators.
result Valid and superior inference methods for high-dimensional classification with non-differentiable surrogate losses.

New approach uses SGLD to minimize CVaR for portfolio weights.

problem Minimizing CVaR for portfolio weights with complete theoretical guarantees.
method Stochastic Gradient Langevin Dynamics (SGLD) with discontinuous updating.
result Theoretical guarantees for convergence in Wasserstein distances for convex and non-convex functions.

New method samples from piecewise smooth distributions using Hamiltonian Monte Carlo.

problem Sampling from distributions with discontinuous gradients.
method Generalized Randomized Hamiltonian Monte Carlo (GRHMC) for piecewise smooth targets.
result GRHMC processes sample from piecewise smooth target distributions with the desired distribution as the invariant distribution.

Proves nonemptyness of domains for specific group actions.

problem Nonemptyness of domains of proper discontinuity for Anosov groups of affine Lorentzian transformations.
method Proof of nonemptyness of domains of proper discontinuity.
result Proves nonemptyness of domains for Anosov groups of affine Lorentzian transformations.

We consider the deformation of a discontinuous group acting on the Euclidean space by affine transformations. A distinguished feature here is that even a `small' deformation of a discrete subgroup may destroy proper discontinuity of its action. In order to understand the local structure of the deformation space of disc…

2006-03-14abs ↗pdf ↗

Cut-DeepONet handles discontinuities and sharp transitions in neural operators.

problem Neural operators struggle with discontinuities and sharp transitions in PDEs.
method Two-stage training framework that explicitly models discontinuities via a lifting strategy and input-dependent discontinuity prediction.
result Cut-DeepONet outperforms state-of-the-art methods on benchmark PDEs with low-resolution datasets.

Study proves existence of equilibrium in incomplete economies with discontinuous volatility.

problem Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
method Established existence of solution for Markovian quadratic BSDEs with discontinuous generators using unique continuation and backward uniqueness.
result Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.

New domains of discontinuity found for Anosov representations.

problem Understanding Anosov representations acting on homogeneous spaces.
method Constructing open domains of discontinuity for Anosov representations acting on specific homogeneous spaces.
result Describes the largest possible open domains of discontinuity for Zariski dense Anosov representations.

New framework to understand and exploit curvature in deep learning loss landscapes.

problem Understanding and optimizing the loss landscape in deep learning models.
method New conceptual framework and techniques to estimate and exploit curvature of expected loss changes.
result Alice algorithm optimizes training by incorporating curvature terms and step bounds.

Study new symmetries in non-symmetric spaces and discontinuous groups.

problem Analyze symmetries in non-symmetric homogeneous spaces and discontinuous groups.
method Investigate discrete series, discontinuous groups, and analysis on pseudo-Riemannian spaces.
result New insights into symmetries of non-symmetric homogeneous spaces and discontinuous groups.

TUSLA algorithm solves non-convex optimization problems with ReLU activations.

problem Non-convex stochastic optimization with super-linearly growing and discontinuous gradients.
method Non-asymptotic analysis of TUSLA algorithm for non-convex learning.
result TUSLA provides non-asymptotic error bounds in Wasserstein distances for non-convex learning.

This article gives an up-to-date account of the theory of discrete group actions on non-Riemannian homogeneous spaces. As an introduction of the motifs of this article, we begin by reviewing the current knowledge of possible global forms of pseudo-Riemannian manifolds with constant curvatures, and discuss what kind of …

2006-03-14abs ↗pdf ↗

Regression trees learn gradients of differentiable functions.

problem Understanding gradients of differentiable functions using regression trees.
method Developed a method to estimate gradients of differentiable functions using regression trees and exposed quantities from tree learning libraries.
result Gradient estimates from regression trees can be used to improve predictive analysis and solve tasks in uncertainty quantification.

Paper analyzes error in stochastic approximation for discontinuous functions.

problem Estimating expected error in discontinuous stochastic approximation.
method Uses finite differences and O(n1/5)O(n^{-1/5}) error estimate for discontinuous functions.
result Achieves error estimate of O(n1/5)O(n^{-1/5}) for discontinuous stochastic representation.

Study proves rigid spectral properties of planets with metric discontinuities.

problem Establishing spectral rigidity for spherically symmetric planets with discontinuities.
method Novel trace formula applied to two wave types in spherically symmetric manifolds with boundary and interior interfaces.
result Spectral rigidity of spherically symmetric planets with discontinuities is proven.

This work models overnight rates with jumps and discontinuities, extending classical short-rate models.

problem Capturing the jump behavior and discontinuities in overnight rates for accurate modeling.
method Developed a term structure modeling framework based on overnight rates, accommodating stochastic discontinuities.
result Simple specifications can capture the jump behavior of overnight rates, and explicit valuation formulas are provided.

Quasi-experimental research designs, such as regression discontinuity and interrupted time series, allow for causal inference in the absence of a randomized controlled trial, at the cost of additional assumptions. In this paper, we provide a framework for discontinuity-based designs using Bayesian model comparison and …

2019-11-15abs ↗pdf ↗

The study explores deformations of discrete subgroups in non-compact homogeneous spaces.

problem Addressing the proper discontinuity of discrete subgroups in non-compact homogeneous spaces.
method Classification results for deformations of standard discontinuous groups in pseudo-Riemannian homogeneous spaces.
result Conditions for local rigidity and Zariski-dense deformations in standard quotients.