Proposes a conservative exploration method for RL agents.
problem Guaranteeing performance of exploratory policies in RL.
method Importance sampling for off-policy policy evaluation.
result Derives a regret bound ensuring no conservative constraint violation.
This work connects symmetries and conserved quantities in machine learning.
problem Improving machine learning models by learning conserved quantities.
method Using Noether's theorem, learn symmetries and conserved quantities directly from data.
result Correctly identifies conserved quantities and improves model performance.
We obtain necessary and sufficient conditions for the existence of "conservation laws" on null hypersurfaces for the wave equation on general four-dimensional Lorentzian manifolds. Examples of null hypersurfaces exhibiting such conservation laws include the standard null cones of Minkowski spacetime and the degenerate …
A new method, based on the original theory of conservation of sum of kinetic and potential energy defined for prices is proposed and applied on Dow Jones Industrials Average (DJIA). The general trends averaged over months or years gave a roughly conserved total energy, with three different potential energies, i.e. posi…
Theoretical analysis confirms non-conservative algorithms can converge to optimal policies.
problem Theoretical guarantees for non-conservative reinforcement learning algorithms.
method Theoretical analysis of Peng's Q(λ) algorithm. result Peng's Q(λ) converges to an optimal policy under certain conditions. A new AI optimization method uses energy-conserving dynamics inspired by Born-Infeld theory.
problem Optimization challenges in non-convex loss functions and machine learning tasks.
method Discretization of Born-Infeld dynamics for energy-conserving Hamiltonian optimization.
result The method avoids high local minima and outperforms traditional methods in shallow valleys.
Study finds conserved quantities for two types of curves on conformal sphere.
problem Identifying conserved quantities for specific types of curves on a conformal sphere.
method Used parallel tractor and Lagrangian formalism to compute conserved quantities.
result Found relation between conserved quantities of two curve types.
New framework models non-conservative stochastic processes without energy conservation constraints.
problem Existing Schrödinger Bridge methods are limited by energy-conservation assumptions.
method Introduces non-conservative generalized Schrödinger bridge (NCGSB) based on contact Hamiltonian mechanics.
result Contact Wasserstein geodesic (CWG) provides a broader class of real-world stochastic processes.
Survey on conservation laws for geometric PDEs.
problem Modeling polyharmonic maps.
method Conservation law approach.
result Overview of conservation laws in geometric PDEs.
A conservative drifting method improves generative modeling by using KDE gradients, proving convergence rates.
problem Improving generative modeling by addressing non-conservatism issues.
method Proposes a conservative drifting method using kernel density estimator gradients to address non-conservatism.
result Proves finite-particle convergence rates for the conservative method, providing explicit quadrature constants.
The article discusses conservation laws for polyharmonic maps and their applications.
problem Understanding conservation laws for polyharmonic maps.
method Recalling the stress-energy tensor and showing conservation laws with Killing vector fields.
result Conservation laws for polyharmonic maps and their applications.
Paper presents a reduction-based framework for conservative bandits and RL with improved lower and upper bounds.
problem Conservative bandits and reinforcement learning problems.
method Reduction technique to calculate necessary and sufficient budget from baseline policy.
result Improved lower and upper bounds for various conservative settings.
Framework infers conservation laws from trained neural networks.
problem Building reduced models of complex systems from physical data.
method Derives conservation laws from symmetries of dynamics in trained DNNs using Noether's theorem.
result Consistent results with previous studies for metastable collective motion systems.
I consider the existence and structure of conservation laws for the general class of evolutionary scalar second-order differential equations with parabolic symbol. First I calculate the linearized characteristic cohomology for such equations. This provides an auxiliary differential equation satisfied by the conservatio…
This paper extends, to a class of systems of semi-linear hyperbolic second order PDEs in three variables, the geometric study of a single nonlinear hyperbolic PDE in the plane as presented in [Anderson I.M., Kamran N., Duke Math. J. 87 (1997), 265-319]. The constrained variational bi-complex is introduced and used to d…
Non-trivial conservation law found for a specific system.
problem Conservation law for a specific system with a vanishing characteristic.
method Analyzing overdetermined system with given characteristics.
result Non-trivial conservation law despite vanishing characteristic.
Symmetry-regularized Neural ODEs improve model stability and interpretability.
problem Improving the stability and physical interpretability of Neural ODEs.
method Integrating Lie symmetries and conservation laws into the loss function.
result Symmetry-regularized Neural ODEs enhance model stability and interpretability.
Gaussian process model learns Hamiltonian systems from noisy data.
problem Learning Hamiltonian systems from long, noisy trajectories.
method Efficient decoupled parameterisation, energy-conserving shooting method.
result Robust inference from short and long trajectories.
Conservation law for weakly harmonic mappings in high dimensions.
problem Conservation law for harmonic mappings in supercritical dimensions.
method Partial extension of Rivière's conservation law with Lorentz integrability condition.
result Conservation law for weakly harmonic mappings in supercritical dimensions.
The conservation laws of the third order quasilinear scalar evolution equations are considered via differential system and characteristic cohomology. We find a subspace of 2 forms in the infinite prolonged space in which every conservation law has a unique representative. The structure of this subspace naturally gives …
Given a vector field on a manifold M, we define a globally conserved quantity to be a differential form whose Lie derivative is exact. Integrals of conserved quantities over suitable submanifolds are constant under time evolution, the Kelvin circulation theorem being a well-known special case. More generally, conserved…
BCPO optimizes offline RL policies by converting uncertainty into conservative bounds.
problem Offline RL's fragility under distribution shifts and model errors.
method Bayesian approach with credible lower bounds and KL regularization.
result BCPO yields an uncertainty-calibrated policy that avoids exploiting model errors.
We study higher-order conservation laws of the non-linearizable elliptic Poisson equation ∂z∂zˉ∂2u=−f(u) as elements of the characteristic cohomology of the associated exterior differential system. The theory of characteristic cohomology determines a normal form for diffe…
VaR-CPO optimizes VaR-constrained RL problems with conservative policy updates.
problem Optimizing VaR-constrained reinforcement learning problems.
method Combines Cantelli's inequality and trust-region framework for efficient and conservative optimization.
result Achieves zero constraint violations during training in feasible environments.
Based on Lie group method, potential symmetry and invariant solutions for generalized quasilinear hyperbolic equations are studied. To obtain the invariant solutions in explicit form, we focus on the physically interesting situations which admit potential symmetries. Then by using the partial Lagrangian approach, we fi…
New conservation laws found for polyharmonic maps in critical dimension.
problem Existence of conservation laws for polyharmonic maps in critical dimension.
method Small perturbation of Uhlenbeck's gauge fixing matrix.
result Existence of conservation laws for elliptic systems of even order in critical dimension.
The paper tackles safe exploration in RL by a conservative safety critic.
problem Safe exploration in reinforcement learning (RL) when partially trained policies are deployed.
method Learning a conservative safety estimate through a critic, provably bounding catastrophic failures.
result The approach provably converges to competitive task performance with significantly lower catastrophic failure rates.
LNNs learn Lagrangians without canonical coordinates, conserving energy and relativity.
problem Neural networks struggle to learn physical symmetries like conservation laws.
method Lagrangian Neural Networks (LNNs) parameterize arbitrary Lagrangians using neural networks.
result LNNs conserve energy and relativity in complex systems.
Develops ECD framework for optimizing machine learning problems.
problem Optimizing machine learning models, especially non-convex ones.
method Energy Conserving Descent (ECD) framework, chaotic dynamical systems.
result ECDSep outperforms existing methods on various machine learning tasks.
A challenging problem in complex networks is the network reconstruction problem from data. This work deals with a class of networks denoted as conserved networks, in which a flow associated with every edge and the flows are conserved at all non-source and non-sink nodes. We propose a novel polynomial time algorithm to …
MC-LSTM extends LSTM to conserve mass in neural networks.
problem Conservation laws in real-world systems.
method Extending LSTM's inductive bias to conserve mass.
result MC-LSTM sets new state-of-the-art for predicting peak flows.
Unified neural network framework for context-aware Gaussian overbounds in uncertainty propagation.
problem Uncertainty quantification in safety-critical settings requires conservative bounds, but existing methods often fail to compose and are overly conservative.
method Proposes a learning framework that trains neural networks to produce context-aware Gaussian overbounds with provable conservatism.
result The method yields tighter bounds while maintaining conservatism on the enforced grid and in experiments.
The paper studies symmetries and conservation laws of non-diagonalisable hydrodynamic systems.
problem Integrating non-diagonalisable hydrodynamic systems of partial differential equations.
method Analysis of gl-regular Nijenhuis operators, splitting Theorem for symmetries and conservation laws, relationship between symmetries and conservation laws.
result The system of partial differential equations is integrable in quadratures.
We present a connection between the Killing fields that arise in the loop-group approach to integrable systems and conservation laws viewed as elements of the characteristic cohomology. We use the connection to generate the complete set of conservation laws (as elements of the characteristic cohomology) for the Tzitzei…
Noether's Theorem yields conservation laws for a Lagrangian with a variational symmetry group. The explicit formulae for the laws are well known and the symmetry group is known to act on the linear space generated by the conservation laws. The aim of this paper is to explain the mathematical structure of both the Euler…
CQL learns conservative Q-functions to improve offline RL performance.
problem Leveraging large, static datasets in reinforcement learning without further interaction.
method Conservative Q-learning (CQL) which learns a conservative Q-function to lower-bound policy values.
result CQL substantially outperforms existing offline RL methods, often achieving 2-5 times higher final returns.
A new algorithm balances exploration and exploitation in online decision-making.
problem Balancing exploration and exploitation in online decision-making.
method Proposed C4-UCB algorithm incorporating conservative mechanism. result Proved n-step upper regret bound for two situations.
We consider the problem of estimating the set of all inputs that leads a system to some particular behavior. The system is modeled by an expensive-to-evaluate function, such as a computer experiment, and we are interested in its excursion set, i.e. the set of points where the function takes values above or below some p…
New neural network enforces mass conservation for better ice flow predictions.
problem Reliably project future sea level rise by improving ice sheet model inputs.
method Proposes divergence-free neural networks (dfNNs) enforcing local mass conservation.
result dfNNs yield more reliable ice flux estimates compared to other models.
The study finds resonance points in polarised curves with polynomial conserved quantities.
problem Finding resonance points in polarised curves with polynomial conserved quantities.
method Using the non-orthogonality assumption on the conserved quantity, the study deduces the existence of resonance points.
result Every finite type polarised curve in the conformal 2-sphere with a polynomial conserved quantity admits a resonance point.
Following an approach of the second author for conformally invariant variational problems in two dimensions, we show in four dimensions the existence of a conservation law for fourth order systems, which includes both intrinsic and extrinsic biharmonic maps. With the help of this conservation law we prove the continuit…
The network jackknife provides conservative variance estimates for network statistics.
problem Estimating the variance of network statistics.
method Leave-node-out jackknife procedure for network data under the sparse graphon model.
result The network jackknife leads to conservative estimates of the variance for network functionals invariant to node permutation.
There is a well-known example of integrable conservative system on S2, the case of Kovalevskaya in the dynamics of a rigid body, possessing an integral of fourth degree in momenta. Goryachev proposed a one-parameter family of examples of conservative systems on S2 possessing an integral of fourth degree in moment…
In this paper we study the relation between conserved quantities of nonholonomic systems and the hamiltonization problem employing the geometric methods of [1,3]. We illustrate the theory with classical examples describing the dynamics of solids of revolution rolling without sliding on a plane. In these cases, using th…
Data symmetries in neural networks can generate conserved quantities.
problem Conservation laws in neural networks
method Using tensorizable networks
result Data augmentation can induce conserved quantities
RORL improves offline RL robustness with conservative smoothing.
problem Distribution shift and robustness issues in offline RL.
method RORL introduces regularization and conservative smoothing for robustness.
result RORL achieves state-of-the-art performance and robustness to adversarial perturbations.
Canary optimizes VaR-constrained RL problems with a conservative bound using Cantelli's inequality.
problem Optimizing reinforcement learning policies under VaR constraints in dense cost regimes.
method Employing Cantelli's inequality to create a conservative and smooth bound on VaR constraints based on moments of cost returns. Extending trust-region framework for worst-case bounds on policy improvement and constraint violation.
result Canary reliably satisfies VaR constraints with fewest violations and earliest permanent satisfaction, while maintaining reward competitiveness.
We propose a dynamical model for business cycle based on an optimal DI model. In the model there exists a conserved quantity, which corresponds to the total energy in a dynamical system. We found that the business cycle with the period 6 or 7 years is nicely reproduced, since the model predicts a periodic motion in the…