We generalize stochastic smoothing for gradient estimation of non-differentiable functions.
problem Gradient estimation for non-differentiable functions.
method Developed a general framework for relaxation and gradient estimation of non-differentiable black-box functions using stochastic smoothing with reduced assumptions.
result Empirically validated the effectiveness of variance reduction strategies for various non-differentiable tasks.
Paper proves autodiff systems are correct for non-differentiable functions.
problem Correctness of autodiff systems for non-differentiable functions in deep learning.
method Investigation of PAP functions and introduction of intensional derivatives.
result Intensional derivatives always exist and coincide with standard derivatives for almost all inputs.
New geometric proof of convex function differentiability and approximation.
problem Second-order differentiability of convex functions and their approximations.
method Elementary geometric approach to prove classical and recent results.
result New proofs of Lusin approximation of convex functions and bodies by C1,1 functions. Paper discusses directional differentiability of interval-valued functions on Riemannian manifolds.
problem Equivalence of directional differentiability of interval-valued functions and their components.
method Analyzes directional differentiability of interval-valued functions on Riemannian manifolds.
result Directional differentiability of interval-valued functions is not equivalent to the directional differentiability of their components.
Differentially private algorithms for submodular maximization under various constraints.
problem Maximizing decomposable submodular functions under constraints while preserving privacy.
method Designing differentially private algorithms for both monotone and non-monotone decomposable submodular maximization under general matroid constraints.
result Improved utility guarantees and competitive performance compared to non-private algorithms.
New variational principle found for non-variational differential equations.
problem Non-variational differential equations without variational multipliers.
method Connecting functional forms with antiexact differential forms to identify obstructions.
result Formulation of variational problem for non-variational equations.
We show that any multiplicative bijection between the algebras of differentiable functions, defined on differentiable manifolds of positive dimension, is an algebra isomorphism, given by composition with a unique diffeomorphism.
The paper uses complex-valued functions to simplify plane differential geometry and kinematics.
problem Simplifying complex problems in plane differential geometry and kinematics.
method Consistent use of complex-valued functions of a real variable.
result Derives results in a particularly simple, uniform, and transparent way.
We present a system for the automatic differentiation of a higher-order functional array-processing language. The core functional language underlying this system simultaneously supports both source-to-source automatic differentiation and global optimizations such as loop transformations. Thanks to this feature, we demo…
This work integrates differentiation and integration in Physics-Informed Neural Networks.
problem Solving integro-differential equations and computing integral transforms.
method Augmenting Physics-Informed Neural Networks with automatic integration.
result Solving complex integral transforms and integro-differential equations.
Differential privacy is a framework for privately releasing summaries of a database. Previous work has focused mainly on methods for which the output is a finite dimensional vector, or an element of some discrete set. We develop methods for releasing functions while preserving differential privacy. Specifically, we sho…
Constructs a function to prove meromorphic differential strata don't have complete subvarieties.
problem Proving meromorphic differential strata don't contain complete subvarieties.
method Explicit construction of a strictly plurisubharmonic function.
result Proves meromorphic differential strata do not contain positive-dimensional complete subvarieties.
PINNs solve differential geometry problems in complex shapes.
problem Solving differential geometry problems in complex shapes.
method Training neural networks with loss functions inspired by differential conditions.
result PINNs are effective for differential geometry problems.
FuDGE estimates differences between functional graphs in high-dimensional settings.
problem Estimating differences between two undirected functional graphical models with shared structures.
method FuDGE: A method that directly estimates the functional differential graph without first estimating individual graphs.
result FuDGE consistently estimates the functional differential graph in high-dimensional settings.
In this paper, we present a method for the accurate estimation of the derivative (aka.~sensitivity) of expectations of functions involving an indicator function by combining a stochastic algorithmic differentiation and a regression. The method is an improvement of the approach presented in [Risk Magazine April 2018]. T…
We develop differential algebraic K-theory for rings of integers in number fields and we construct a cycle map from geometrized bundles of modules over such a ring to the differential algebraic K-theory. We also treat some of the foundational aspects of differential cohomology, including differential function spectra a…
Efficient offline reinforcement learning with neural networks using differentiable function approximation.
problem Statistical efficiency of offline reinforcement learning with function approximators.
method Pessimistic fitted Q-learning (PFQL) and differentiable function approximation.
result Provably efficient offline reinforcement learning with differentiable function approximation.
Elvet solves differential equations and variational problems with neural networks.
problem Solving complex differential and variational equations with arbitrary conditions.
method Machine learning, specifically neural networks, to represent and solve equations.
result Elvet can solve a wide range of differential and variational problems.
Develops a new method for statistical optimal allocation problems.
problem Statistical optimal allocation problems with constraints.
method Functional differentiability approach and Hadamard differentiability of value functions.
result Validates margin assumption for fast convergence rate of plug-in methods.
Paper introduces magnetic Hodge Laplacian for differential forms.
problem No specific problem stated; general spectral analysis of differential forms.
method Introduced magnetic Hodge Laplacian, discussed spectral results.
result Similarities and differences with magnetic Laplacian on functions.
Developed a theory of ultradifferentiable sheafs with applications.
problem Ultradifferentiable functions and their sheafs.
method Abstract theory development for ultradifferentiable sheafs.
result Applications to linear PDEs, differential geometry, and CR geometry.
Volume of unit balls defined by quadratic differentials is not proper and has integrable volume.
problem Characterizing the behavior of volume functions associated with quadratic differentials.
method Analyzing the Thurston volume of unit balls in measured lamination spaces.
result The volume function is not proper and is p-integrable for any 0<p<1. Monotonic differentiable sorting networks improve upon previous methods.
problem Non-monotonicity in differentiable sorting networks.
method Relaxation of conditional swap operations using sigmoid functions to ensure monotonicity.
result Monotonic differentiable sorting networks improve upon previous methods.
New method uses PINNs to efficiently compute Gerber-Shiu functions.
problem Calculating the Gerber-Shiu function efficiently.
method Physics-informed neural networks (PINNs) embedded with differential equations.
result Demonstrates good performance in approximating Gerber-Shiu functions.
The Closest Point Method for solving partial differential equations (PDEs) posed on surfaces was recently introduced by Ruuth and Merriman [J. Comput. Phys. 2008] and successfully applied to a variety of surface PDEs. In this paper we study the theoretical foundations of this method. The main idea is that surface diffe…
In a natural way, the local diffeomorphisms of a manifold onto itself act on the reference frame bundles of any order and on the bundles associated with them. Due to the transitivity, the invariants by diffeomorphisms of an associated bundle correspond to the real functions on the orbit space of the action of the jet g…
We apply a suitable modification of the functional delta method to statistical functionals that arise from law-invariant coherent risk measures. To this end we establish differentiability of the statistical functional in a relaxed Hadamard sense, namely with respect to a suitably chosen norm and in the directions of a …
Extends gradient-based optimization to spline functions.
problem Limitations of standard differentiable programming methods.
method Derives Jacobian of spline functions and uses it in predictive models.
result Improved performance in various applications.
Develops a mathematical model for automatic differentiation in machine learning.
problem Current automatic differentiation lacks a simple mathematical model for machine learning.
method Articulates relationships between program differentiation and nonsmooth functions, provides a class of functions and nonsmooth calculus.
result Shows how nonsmooth calculus applies to stochastic approximation methods and evidence of artificial critical points.
The paper quantizes Kähler manifolds using differential operators.
problem Quantizing classical observables on Kähler manifolds as differential operators.
method Constructing higher-order differential operators using Fedosov-type constructions and proving asymptotic equivalence to Berezin-Toeplitz operators.
result Holomorphic differential operators are precisely those that arise as Berezin-Toeplitz operators for quantizable functions.
Transport functions for principal bundles and Morse homology with differential graded coefficients
problem Transport functions for principal bundles
method Constructing transport functions as maps from broken gradient flow lines to a topological group
result Recovering the principal bundle from the transport function
Preserving differential privacy has been well studied under centralized setting. However, it's very challenging to preserve differential privacy under multiparty setting, especially for the vertically partitioned case. In this work, we propose a new framework for differential privacy preserving multiparty learning in t…
Universal approximation theorem for differentiable maps on infinite-dimensional manifolds
problem Approximation of differentiable maps on infinite-dimensional manifolds
method Weighted universal approximation theorem
result Universal approximation theorem for differentiable maps
Survival function estimation is used in many disciplines, but it is most common in medical analytics in the form of the Kaplan-Meier estimator. Sensitive data (patient records) is used in the estimation without any explicit control on the information leakage, which is a significant privacy concern. We propose a first d…
Differentially private log-location-scale regression models improve privacy in statistical analysis.
problem Ensuring privacy in statistical regression models while maintaining accuracy.
method Integrates differential privacy into LLS regression using the functional mechanism.
result Proposed DP-LLS models satisfy ε-differential privacy and perform well under various conditions.
A distance-squared function is one of the most significant functions in the application of singularity theory to differential geometry. In this paper, we define naturally extended mappings of distance-squared functions, wherein each component is a distance-squared function. We investigate the properties of these mappin…
Simplifies efficient estimation via automatic differentiation and probabilistic programming.
problem Constructing efficient estimators for complex statistical models.
method Automatic differentiation applied to statistical functionals, avoiding the need to derive efficient influence functions.
result Users can generate efficient estimators with minimal code, simplifying the process for non-experts.
ξ-torch simplifies physics-informed learning by providing differentiable functionals.
problem Training physics-informed deep neural networks requires differentiable physical simulations.
method ξ-torch offers a library of differentiable functionals for scientific simulations.
result Improves numerical stability and reduces memory requirements for higher order derivatives.
This paper provides an explicit form for symmetric differentials and their corresponding holomorphic functions.
problem Understanding the correspondence between symmetric differentials and L2 holomorphic functions on quotient spaces. method Explicit description of the correspondence between symmetric differentials and weighted L2-holomorphic functions. result Derivation of several applications based on the explicit form of the correspondence.
New mechanism for pure differential privacy on functional summaries using Laplace-like process.
problem Challenges in achieving differential privacy for complex, structured functional summaries.
method Independent Component Laplace Process (ICLP) mechanism for infinite-dimensional Hilbert space.
result Effective enhancement of utility of private summaries through oversmoothing.
Algebraic geometry replaces manifolds in differential geometry.
problem Eliminate the need for manifolds in differential geometry.
method Introduce algebraifolds and use commutative algebras with finitely generated projective module of derivations.
result General relativity can be formulated using algebraifolds.
Efficient estimators for smooth Hilbert-valued parameters with theoretical guarantees.
problem Estimating smooth Hilbert-valued parameters with theoretical guarantees.
method Pathwise differentiable Hilbert-valued parameters, efficient influence functions, regularized one-step estimators.
result Theoretical guarantees for efficient estimators even when nuisance functions are arbitrary.
Proposes efficient, modular method for implicit differentiation.
problem Implicit differentiation of optimization problems.
method Automatic implicit differentiation using autodiff and implicit function theorem.
result Automatic differentiation of optimization problems is made easier and more modular.
Most deep neural networks use simple, fixed activation functions, such as sigmoids or rectified linear units, regardless of domain or network structure. We introduce differential equation units (DEUs), an improvement to modern neural networks, which enables each neuron to learn a particular nonlinear activation functio…
We provide a draft of a theory of geometric integration of rough differential forms which are generalizations of classical (smooth) differential forms to similar objects with very low regularity, for instance, involving Hölder continuous functions that may be nowhere differentiable. Borrowing ideas from the theory of r…
Study Z2 harmonic functions with singularities on flat space.
problem Understanding Z2 harmonic functions with point singularities.
method Analyzes Z2 harmonic functions on R2 with point singularities. result Characterizes Z2 harmonic functions on R2 with point singularities. Paper classifies minimal graph transformations into new families of surfaces.
problem Classifying minimal graph transformations into new families of surfaces.
method Formulated and solved a coupled system of partial differential equations, reduced to solving an ordinary differential equation.
result Established rigorous equivalence to a modified problem for a harmonic function, yielding new families of minimal surfaces.
This paper is concerned with the following Markovian stochastic differential equation of mean-reversion type \[ dR_t= (θ+σα(R_t, t))R_t dt +σR_t dB_t \] with an initial value R0=r0∈R, where θ∈R and σ>0 are constants, and the mean correction function $α:\mathbb{R}\times[0,\infty)\to α(x,t)\…