The abstract explores a new wave equation linking quantum mechanics and complex adaptive systems.
problem Understanding the underlying mechanism of distribution formation in complex quantum entanglement.
method Exploring the logical relationship between Schrödinger's wave equation and Shi's trading volume-price wave equation in finance.
result A non-localized wave equation in quantum mechanics reveals the invariance of interaction as a universal law.
In our simplified description `wealth' is money (m). A kinetic theory of gas like model of money is investigated where two agents interact (trade) selectively and exchange some amount of money between them so that sum of their money is unchanged and thus total money of all the agents remains conserved. The probabilit…
We propose a set of conservative models in which agents exchange wealth with a preference in the choice of interacting agents in different ways. The common feature in all the models is that the temporary values of financial status of agents is a deciding factor for interaction. Other factors which may play important ro…
Conservative SPDEs emerge from fluctuating SGD dynamics in neural networks.
problem Understanding the convergence of stochastic gradient descent to SPDEs.
method Mean-field analysis and central limit theorem for SPDEs.
result Optimal convergence rates for SPDEs derived from SGD.
BCPO optimizes offline RL policies by converting uncertainty into conservative bounds.
problem Offline RL's fragility under distribution shifts and model errors.
method Bayesian approach with credible lower bounds and KL regularization.
result BCPO yields an uncertainty-calibrated policy that avoids exploiting model errors.
In many fields such as digital marketing, healthcare, finance, and robotics, it is common to have a well-tested and reliable baseline policy running in production (e.g., a recommender system). Nonetheless, the baseline policy is often suboptimal. In this case, it is desirable to deploy online learning algorithms (e.g.,…
Learning influence pathways of a network of dynamically related processes from observations is of considerable importance in many disciplines. In this article, influence networks of agents which interact dynamically via linear dependencies are considered. An algorithm for the reconstruction of the topology of interacti…
HAMBO estimates policy performance by hallucinating worst-case trajectories, providing valid lower bounds.
problem Conservative off-policy evaluation of policies in real-world applications.
method HAMBO hallucinates worst-case trajectories based on learned model uncertainty.
result Valid lower bounds on policy performance, converging to true expected return under regular conditions.
New method learns credit prices offline without interaction.
problem Dynamic pricing of consumer credit.
method Offline deep reinforcement learning with Q-Learning.
result Effective personalized pricing policy learned without online interaction.
The statistical mechanics approach to wealth distribution is based on the conservative kinetic multi-agent model for money exchange, where the local interaction rule between the agents is analogous to the elastic particle scattering process. Here, we discuss the role of a class of conservative local operators, and we s…
CQL learns conservative Q-functions to improve offline RL performance.
problem Leveraging large, static datasets in reinforcement learning without further interaction.
method Conservative Q-learning (CQL) which learns a conservative Q-function to lower-bound policy values.
result CQL substantially outperforms existing offline RL methods, often achieving 2-5 times higher final returns.
Noether's theorem clarifies how symmetries in neural networks influence learning.
problem Understanding how symmetries in neural networks affect learning.
method Systematic study of symmetry interactions with learning algorithms using Noether's theorem.
result Symmetries impose restrictions on the optimization path, leading to conserved quantities.
We address the issue of the distribution of firm size. To this end we propose a model of firms in a closed, conserved economy populated with zero-intelligence agents who continuously move from one firm to another. We then analyze the size distribution and related statistics obtained from the model. Our ultimate goal is…
New approach reduces particle simulation complexity to linear time and space.
problem Challenges in learning dynamics from particle interactions, especially N-body problems.
method Transforms fully-connected interaction graphs into hierarchical ones, reducing complexity.
result Linear time and space complexity for large-scale simulations, retaining high accuracy.
A conservative drifting method improves generative modeling by using KDE gradients, proving convergence rates.
problem Improving generative modeling by addressing non-conservatism issues.
method Proposes a conservative drifting method using kernel density estimator gradients to address non-conservatism.
result Proves finite-particle convergence rates for the conservative method, providing explicit quadrature constants.
The reduction problem of the chiral field equation on symmetric spaces is studied. It is shown that the symmetric chiral field has infinitely many local conservation laws. A recursive formula for these conservation laws is derived and the first associated integral of motion are given explicitly. Furthermore, the Zakhar…
We develop a model for the evolution of wealth in a non-conservative economic environment, extending a theory developed earlier by the authors. The model considers a system of rational agents interacting in a game theoretical framework. This evolution drives the dynamic of the agents in both wealth and economic configu…
We review the geometric setting of the field theory with locally anisotropic interactions. The concept of locally anisotropic space is introduced as a general one for various type of extensions of Lagrange and Finsler geometry and higher dimension (Kaluza--Klein type) spaces. The problem of definition of spinors on gen…
We propose and discuss some toy models of stock markets using the same operatorial approach adopted in quantum mechanics. Our models are suggested by the discrete nature of the number of shares and of the cash which are exchanged in a real market, and by the existence of conserved quantities, like the total number of s…
MPM-ParVI uses particle sampling for variational inference.
problem Variational inference for complex probabilistic models.
method Material Point Method (MPM) for particle-based simulation.
result Deterministic sampling and inference for intractable densities.
MIDAS learns to adaptively control other cars in urban driving scenarios.
problem Autonomous vehicles need to interact with other agents on the road.
method Reinforcement learning with attention mechanism to handle multiple agents.
result MIDAS policies are adaptive and robust to external changes.
Linear stochastic models and discretized kinetic theory are two complementary analytical techniques used for the investigation of complex systems of economic interactions. The former employ Langevin equations, with an emphasis on stock trade; the latter is based on systems of ordinary differential equations and is bett…
This paper considers ideal gas-like models of trading markets, where each agent is identified as a gas molecule that interacts with others trading in elastic or money-conservative collisions. Traditionally, these models introduce different rules of random selection and exchange between pair agents. Unlike these traditi…
New geometry theory solves dark matter issues.
problem Addressing dark matter and energy in Weyl geometry.
method Developed a generalized Weyl integrable geometry (GWIG) with interactions and anisotropic dilation.
result Solved singularity issues in point charged particle models.
Theoretical analysis confirms non-conservative algorithms can converge to optimal policies.
problem Theoretical guarantees for non-conservative reinforcement learning algorithms.
method Theoretical analysis of Peng's Q(λ) algorithm. result Peng's Q(λ) converges to an optimal policy under certain conditions. Study finds conserved quantities for two types of curves on conformal sphere.
problem Identifying conserved quantities for specific types of curves on a conformal sphere.
method Used parallel tractor and Lagrangian formalism to compute conserved quantities.
result Found relation between conserved quantities of two curve types.
Deep learning is built on the foundational guarantee that gradient descent on an objective function converges to local minima. Unfortunately, this guarantee fails in settings, such as generative adversarial nets, that exhibit multiple interacting losses. The behavior of gradient-based methods in games is not well under…
Survey on conservation laws for geometric PDEs.
problem Modeling polyharmonic maps.
method Conservation law approach.
result Overview of conservation laws in geometric PDEs.
We present a geometric approach to the field theory with higher order anisotropic interactions. The concepts of higher order space, or locally anisotropic, space (in brief, h-space, or la-space) are introduced as general ones for various types of higher order extensions of Lagrange and Finsler geometry and higher dimen…
The article discusses conservation laws for polyharmonic maps and their applications.
problem Understanding conservation laws for polyharmonic maps.
method Recalling the stress-energy tensor and showing conservation laws with Killing vector fields.
result Conservation laws for polyharmonic maps and their applications.
Paper presents a reduction-based framework for conservative bandits and RL with improved lower and upper bounds.
problem Conservative bandits and reinforcement learning problems.
method Reduction technique to calculate necessary and sufficient budget from baseline policy.
result Improved lower and upper bounds for various conservative settings.
I consider the existence and structure of conservation laws for the general class of evolutionary scalar second-order differential equations with parabolic symbol. First I calculate the linearized characteristic cohomology for such equations. This provides an auxiliary differential equation satisfied by the conservatio…
Proposes a two-stage method for testing variable interactions with FDR control.
problem Testing pairwise interactions in high-dimensional data with dependence.
method Two-stage testing procedure with FDR control using Cramér type moderate deviation technique.
result The proposed method controls FDR and has comparable or improved statistical power.
Non-trivial conservation law found for a specific system.
problem Conservation law for a specific system with a vanishing characteristic.
method Analyzing overdetermined system with given characteristics.
result Non-trivial conservation law despite vanishing characteristic.
This work connects symmetries and conserved quantities in machine learning.
problem Improving machine learning models by learning conserved quantities.
method Using Noether's theorem, learn symmetries and conserved quantities directly from data.
result Correctly identifies conserved quantities and improves model performance.
Proposes a conservative exploration method for RL agents.
problem Guaranteeing performance of exploratory policies in RL.
method Importance sampling for off-policy policy evaluation.
result Derives a regret bound ensuring no conservative constraint violation.
Conservation law for weakly harmonic mappings in high dimensions.
problem Conservation law for harmonic mappings in supercritical dimensions.
method Partial extension of Rivière's conservation law with Lorentz integrability condition.
result Conservation law for weakly harmonic mappings in supercritical dimensions.
The conservation laws of the third order quasilinear scalar evolution equations are considered via differential system and characteristic cohomology. We find a subspace of 2 forms in the infinite prolonged space in which every conservation law has a unique representative. The structure of this subspace naturally gives …
Given a vector field on a manifold M, we define a globally conserved quantity to be a differential form whose Lie derivative is exact. Integrals of conserved quantities over suitable submanifolds are constant under time evolution, the Kelvin circulation theorem being a well-known special case. More generally, conserved…
New offline RL algorithms tackle partial data coverage with optimal performance and practicality.
problem Partial data coverage in offline RL datasets.
method Augmented Lagrangian method applied to MIS formulation for optimal offline RL.
result Statistically optimal offline RL with practical performance, eliminating conservatism.
We study higher-order conservation laws of the non-linearizable elliptic Poisson equation ∂z∂zˉ∂2u=−f(u) as elements of the characteristic cohomology of the associated exterior differential system. The theory of characteristic cohomology determines a normal form for diffe…
New conservation laws found for polyharmonic maps in critical dimension.
problem Existence of conservation laws for polyharmonic maps in critical dimension.
method Small perturbation of Uhlenbeck's gauge fixing matrix.
result Existence of conservation laws for elliptic systems of even order in critical dimension.
A challenging problem in complex networks is the network reconstruction problem from data. This work deals with a class of networks denoted as conserved networks, in which a flow associated with every edge and the flows are conserved at all non-source and non-sink nodes. We propose a novel polynomial time algorithm to …
MC-LSTM extends LSTM to conserve mass in neural networks.
problem Conservation laws in real-world systems.
method Extending LSTM's inductive bias to conserve mass.
result MC-LSTM sets new state-of-the-art for predicting peak flows.
Motivated by a probabilistic approach to Kahler-Einstein metrics we consider a general non-equilibrium statistical mechanics model in Euclidean space consisting of the stochastic gradient flow of a given (possibly singular) quasi-convex N-particle interaction energy. We show that a deterministic "macroscopic" evolution…
The paper studies symmetries and conservation laws of non-diagonalisable hydrodynamic systems.
problem Integrating non-diagonalisable hydrodynamic systems of partial differential equations.
method Analysis of gl-regular Nijenhuis operators, splitting Theorem for symmetries and conservation laws, relationship between symmetries and conservation laws.
result The system of partial differential equations is integrable in quadratures.
We mathematically analyze a simple market model where trading at each point in time involves only two agents with the sum of their money being conserved and with neither parties resulting with negative money after the interaction process. The exchange involves random re-distribution among the two players of a fixed fra…
We present a connection between the Killing fields that arise in the loop-group approach to integrable systems and conservation laws viewed as elements of the characteristic cohomology. We use the connection to generate the complete set of conservation laws (as elements of the characteristic cohomology) for the Tzitzei…