Novel mean estimation method under user-level differential privacy reduces noise in continual mean estimates.
problem Maintaining accurate running mean estimates under user-level differential privacy.
method Developed a novel mean estimation specific factorization under approximate differential privacy.
result Achieved asymptotically lower mean-squared error bounds in continual mean estimation.
Proposes a continuous, differentiable model from local adaptive models.
problem Inadequate continuity and differentiability in over-parameterized models.
method A global continuous and differentiable model constructed from weighted averages of locally learned models.
result Achieves faster statistical convergence and improved performance in various settings.
Paper proves equivalence of derivatives for maps between Carnot groups.
problem Maps between Carnot groups and their derivatives.
method Elementary proof using Euclidean arguments and mean value estimates.
result Maps preserving horizontal curves are continuously Pansu differentiable.
VSDN models sporadic time series with neural SDEs.
problem Modeling irregular and sparse time series data.
method Variational Bayesian method and neural SDEs.
result VSDNs outperform state-of-the-art models in prediction and interpolation.
Develops analysis of Hölder continuous mappings on Heisenberg groups.
problem Analyzing Hölder continuous mappings on Heisenberg groups.
method Theory of distributional Jacobians and pullbacks of differential forms.
result Simple proof of a generalization of the Gromov non-embedding theorem and new results about Hölder homotopy groups.
New continuous-time optimization algorithms converge in finite time to local minima.
problem Finding local minima in optimization problems.
method Discontinuous dynamical systems with finite-time convergence via Lyapunov-based differential inequality.
result Finite-time convergence to strict local minima with provable settling time.
We study continuous maps between differential manifolds from a microlocal point of view. In particular, we characterize the Lipschitz continuity of these maps in terms of the microsupport of the constant sheaf on their graph. Furthermore, we give lower and upper bounds on the microsupport of the graph of a continuous m…
We solve the differentiability problem for the evolution map in Milnor's infinite dimensional setting. We first show that the evolution map of each Ck-semiregular Lie group G (for k∈N⊔{lip,∞}) admits a particular kind of sequentially continuity − called Mackey k-continuity. We …
The notion of pseudo-differential operators with coefficients in a continuous trace algebra over a manifold are introduced and their index theory is studied. The algebra of principal symbols in this calculus provides an abstract Poincaré dual to the continuous trace algebra. Index formulas for pseudo-differential opera…
Develops a mathematical framework for causal fermion systems in infinite dimensions.
problem Analysis of causal fermion systems in infinite-dimensional settings.
method Introduces Banach manifold structure and expedient differential calculus.
result Establishes Hölder continuity of causal Lagrangian and integrated causal Lagrangian.
Over a closed manifold, we consider the sectorial projection of an elliptic pseudo-differential operator A of positive order with two rays of minimal growth. We show that it depends continuously on A when the space of pseudo-differential operators is equipped with a certain topology which we explicitly describe. Our ma…
Extends unique continuation theorem to manifolds with boundary, proving zero set codimension.
problem Proving unique continuation for exterior differential forms on manifolds with boundary.
method Extends Aronszajn-Krzywicki-Szarski theorem to manifolds with boundary, assuming suitable boundary conditions.
result Hausdorff dimension of zero sets of harmonic forms and eigenfields has codimension at least 2.
Discrete Gaussian noise preserves privacy and accuracy in differential privacy.
problem Finite computers cannot represent continuous Gaussian noise, leading to privacy breaches and loss of interpretability.
method Introduced and analyzed discrete Gaussian noise, providing privacy and accuracy guarantees similar to continuous Gaussian noise.
result Discrete Gaussian noise offers the same privacy and accuracy as continuous Gaussian noise, with efficient sampling algorithms.
Paper studies continuous prediction with experts' advice using differential equations.
problem Continuous prediction with experts' advice in online learning.
method Continuous-time stochastic calculus and differential equations.
result Improved guarantees for quantile regret with continuous-time algorithm.
Neural SDEs model continuous sequences using neural networks.
problem Modeling continuous-time dynamics in sequence data.
method Interprets time-series as samples from a continuous dynamical system, parameterized by Neural SDE.
result Demonstrates superior performance in diverse sequence modeling tasks.
Catastrophic forgetting can be a significant problem for institutions that must delete historic data for privacy reasons. For example, hospitals might not be able to retain patient data permanently. But neural networks trained on recent data alone will tend to forget lessons learned on old data. We present a differenti…
Study robust utility maximization with uncertain continuous semimartingales.
problem Maximizing utility in continuous time under model uncertainty.
method Duality and conjugate problems for logarithmic, exponential, and power utilities.
result Existence of optimal portfolios for various utilities.
Study Galois groupoids of discret Painlevé equations.
problem Computing Galois groupoids for discret Painlevé equations.
method Using semi-continuity theorem for Galois groupoid in confluence of difference to differential equations.
result Computed Galois groupoids for discret Painlevé equations.
JME continually estimates data moments privately and accurately.
problem Private and accurate continual estimation of data moments.
method Uses matrix mechanism and joint sensitivity analysis.
result Improves accuracy in estimating mean and covariance with reduced noise.
Topological degrees of continuous mappings between manifolds of even dimension are studied in terms of index theory of pseudo-differential operators. The index formalism of non-commutative geometry is used to derive analytic integral formulas for the index of a 0:th order pseudo-differential operator twisted by a Hölde…
Derives EoM for DNNs to describe GD dynamics precisely.
problem Gaps between differential equations and actual DNN learning dynamics due to discretization error.
method Starts from GF, derives counter term to cancel discretization error, obtains EoM.
result EoM precisely describes GD dynamics of DNNs, highlights differences between continuous and discrete GD.
These course note first provide an introduction to secondary characteristic classes and differential cohomology. They continue with a presentation of a stable homotopy theoretic approach to the theory of differential extensions of generalized cohomology theories including products and Umkehr maps.
In this paper we establish the basic tools to develop the "Calculus" associated with group-valued continuously Pansu differentiable mappings. We develop the technical machinery on which all of our results rely. In particular, the linearization of addends appearing in the Baker-Campbell-Hausdorff formula is one of the m…
Continuized Nesterov acceleration accelerates stochastic gradient descent and gossip algorithms.
problem Improving the convergence rate of stochastic gradient descent and gossip algorithms.
method Introducing a continuized variant of Nesterov acceleration, which mixes variables continuously and takes gradient steps at random times.
result The continuized Nesterov acceleration achieves convergence rates similar to Nesterov's original acceleration but with random parameters.
CRUs model irregular time series with continuous hidden states.
problem Handling irregular time intervals in sequential data.
method Continuous Recurrent Units (CRUs) that integrate hidden states via a linear stochastic differential equation.
result CRUs outperform methods based on neural ordinary differential equations in irregular time series interpolation.
Continuous-time MBRL framework tackles control systems with Bayesian ODEs.
problem Discretization of continuous-time systems in MBRL.
method Novel actor-critic method with Bayesian ODEs for state inference.
result Model robust against irregular and noisy data, sample-efficient, solves challenging control problems.
Continuous family of elliptic operators' projections maintain Cauchy data spaces.
problem Maintaining Cauchy data spaces for a continuous family of elliptic operators.
method Elementary tools and classical results applied to operator graphs, Sobolev spaces, and Green's formula.
result Orthogonalized Calderón projections form a continuous family of projections.
Any discrete differential manifold M (finite set endowed with an algebraic differential calculus) can be represented by appropriate polyhedron P(M). This representation demonstrates the adequacy of the calculus of discrete differential manifolds and links this approach with that based on finitary substitutes…
Study proves existence of equilibrium in incomplete economies with discontinuous volatility.
problem Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
method Established existence of solution for Markovian quadratic BSDEs with discontinuous generators using unique continuation and backward uniqueness.
result Existence of incomplete Radner equilibrium with nondegenerate endogenous volatility.
Extends Seeley's theorem for Bastiani's differential calculus in infinite dimensions.
problem Extending differential calculus results to infinite-dimensional spaces.
method Follows Seeley's approach but extends to continuous differentials and families of operators.
result Constructs families of extension operators for continuous differentials.
The systems of complex analytic second order ordinary differential equations whose solutions close up to become rational curves (after analytic continuation) are characterized by the vanishing of an explicit differential invariant, and turn out to provide an infinite dimensional family of integrable systems.
Differential equations are derived for a continuous limit of iterated Schwarzian reflection of analytic curves, and solutions are interpreted as geodesics in an infinite-dimensional symmetric space geometry.
Develops geometric integration for rough differential forms.
problem Integrating rough differential forms with low regularity.
method Uses rough path theory to construct geometric integration.
result Constructs geometric integration for rough differential forms.
Following the work of Cano and Diaz, we consider a continuous analog of lattice path enumeration. This allows us to define a continuous version of any discrete object that counts certain types of lattice paths. We define continuous versions of binomials and multinomials, and describe some identities and partial differe…
Study shows certainty equivalent policy minimizes regret in continuous-time systems.
problem Minimizing regret in continuous-time stochastic linear-quadratic systems.
method Theoretical analysis of randomized certainty equivalent policy.
result Establishes square-root of time regret bounds and linear scaling with parameters.
Extends Neural ODEs to model discrete changes in continuous systems.
problem Lack of explicit termination time in existing Neural ODE formulations.
method Introduces neural event functions to implicitly define termination criteria.
result Models discrete changes in continuous systems without prior knowledge.
Paper develops a consistent algorithm for learning graph structure from continuous-time stochastic differential equations.
problem Learning structure from continuous-time stochastic differential equations.
method Score-based structure learning using Neural Ordinary Differential Equations with adaptive regularization.
result The method consistently recovers directed graphs of local independencies in systems of stochastic differential equations.
New method optimizes SDE models using continuous-time gradient descent.
problem Optimizing over the stationary distribution of SDE models.
method Continuous-time stochastic gradient descent for SDE models.
result Asymptotic convergence to the direction of steepest descent.
Continuous reinforcement learning such as DDPG and A3C are widely used in robot control and autonomous driving. However, both methods have theoretical weaknesses. While DDPG cannot control noises in the control process, A3C does not satisfy the continuity conditions under the Gaussian policy. To address these concerns,…
This paper is concerned with the following Markovian stochastic differential equation of mean-reversion type \[ dR_t= (θ+σα(R_t, t))R_t dt +σR_t dB_t \] with an initial value R0=r0∈R, where θ∈R and σ>0 are constants, and the mean correction function $α:\mathbb{R}\times[0,\infty)\to α(x,t)\…
Constructs finite element spaces for (p,q)-forms, excluding one subspace.
problem Constructing finite element spaces for (p,q)-forms. method Piecewise polynomial finite element spaces for all natural subspaces of (p,q)-forms, excluding one subspace. result Recovers known finite element spaces and introduces new ones.
We develop a scalable method for Bayesian neural networks with stochastic differential equations.
problem Uncertainty quantification in deep neural networks.
method Gradient-based stochastic variational inference in continuous-depth Bayesian neural networks.
result Gradient estimator with zero variance as the approximation improves.
Neural system optimizes glucose levels in diabetics.
problem Limited research on continuous glucose maintenance devices.
method Differential predictive control with neural policy and differentiable modeling.
result Improves glucose level optimization in real-time.
Researchers compute Wodzicki residue for pseudo-differential operators on compact Lie groups.
problem Computing the Wodzicki residue for pseudo-differential operators on compact Lie groups.
method Analytic continuation of traces and matrix-valued symbols.
result Main theorem complementary to [2], removing ellipticity hypothesis.
We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a black-box differential equation solver. These continuous-depth models have constan…
In this paper we study a special case of the completion of cusp Kähler-Einstein metric on the regular part of varieties by taking the continuity method proposed by La Nave and Tian. The differential geometric and algebro-geometric properties of the noncollapsing limit in the continuity method with cusp singularities wi…
We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us to differentiate the output of CEM with respect to the objective function's parameters. In the machine learning setting this brings CEM insi…
Graph neural networks learn PDEs from sparse, irregular data.
problem Learning PDEs from irregularly spaced data.
method Continuous-time differential model with graph neural networks for arbitrary discretizations.
result Efficient inference with continuous-time adjoint method.