Weight decay stabilizes training dynamics by slowing progressive sharpening.
problem Understanding how weight decay affects training stability in deep learning models.
method Analyzing weight decay effects at the Edge of Stability, developing a mathematical framework.
result Weight decay dampens oscillations and stabilizes sharpness in CNNs, causing a phase transition in MLPs.
Global stability bounds for matrix frames in phase retrieval problems.
problem Phase retrieval for matrix frames in various applications.
method Computable global stability bounds for the quasi-linear analysis map β, using Whitney stratification of positive semidefinite matrices of low rank.
result Novel conditions for a frame to be generalized phase retrievable.
Paper uses TDA to assess cryptocurrency risk by measuring phase space instability.
problem Traditional risk measures fail to capture market dynamics' geometric structure.
method Applied Takens' Delay Embedding Theorem to generate point cloud, computed persistent homology groups, defined Topological Persistence Norm.
result Proposed leverage calibration heuristic based on persistence of 1-dimensional cycles.
In this paper we study the property of phase retrievability by redundant sysems of vectors under perturbations of the frame set. Specifically we show that if a set $\fc$ of m vectors in the complex Hilbert space of dimension n allows for vector reconstruction from magnitudes of its coefficients, then there is a pertu…
Stability inequalities for specific solutions in high dimensions.
problem Stability of solutions to the one-phase Bernoulli problem.
method Proving strict stability inequalities for cohomogeneity one solutions with bi-orthogonal symmetry.
result Strict stability for cohomogeneity one solutions in dimensions 7 and above.
The stability of money value is an important requisite for a functioning economy, yet it critically depends on the actions of participants in the market themselves. Here we model the value of money as a dynamical variable that results from trading between agents. The basic trading scenario can be recast into an Ising t…
We study the stability of partitions involving two or more phases in convex domains under the assumption of at most two-phase contact, thus excluding in particular triple junctions. We present a detailed derivation of the second variation formula with particular attention to the boundary terms, and then study the sign …
New method uses generative models to improve phase retrieval stability.
problem Improving stability of solutions in phase retrieval problems.
method Unified reconstruction approach using generative models to mitigate overfitting.
result Mitigates overfitting to generative model for varying noise levels.
The paper examines stability of shares in Proof of Stake protocol, identifying different investor behaviors and phase transitions.
problem Stability of shares in Proof of Stake protocol.
method Identification of large, medium, and small investors under various rewarding schemes; dynamical population model analysis.
result Phase transitions and thresholds for stability are characterized; chaotic centralization leads to concentration of shares.
Paper confirms conjecture for projective manifolds in supercritical phase.
problem Stability condition for deformed Hermitian-Yang-Mills equation.
method Establishes stability result not involving uniform constants.
result Confirms conjecture for projective manifolds in supercritical phase.
Gradient descent dynamics in quadratic regression models are analyzed, revealing five phases: monotonic, catapult, periodic, chaotic, and divergent.
problem Analyzing the dynamics of gradient descent in quadratic regression models.
method Fine-grained bifurcation analysis of gradient descent dynamics using a cubic map parameterized by the step-size.
result Gradient descent dynamics in quadratic regression models exhibit five distinct phases: monotonic, catapult, periodic, chaotic, and divergent.
We study the stability of partitions in convex domains involving simultaneous coexistence of three phases, viz. triple junctions. We present a careful derivation of the formula for the second variation of area, written in a suitable form with particular attention to boundary and spine terms, and prove, in contrast to t…
Enhances neural network dynamics to boost computational capacity.
problem Improving computational capacity of neural networks.
method Introducing Phase Transition Adaptation to drive system dynamics towards edge of stability.
result Consistently achieves enhancement in computational capacity over multiple datasets.
Persistent entropy detects phase transitions in complex systems.
problem Detecting phase transitions in complex systems.
method Established a general theorem for persistent entropy to reliably detect phase transitions, introduced operational framework for finite-time computations.
result Persistent entropy exhibits an asymptotically non-vanishing gap across phases, robust numerical signatures across experiments.
Study on combustion theory solutions, proving nondegeneracy and stability in limit.
problem One-phase singular perturbation problem in combustion theory.
method Introduce density condition to preserve nondegeneracy, classify stable solutions.
result Global stable solutions have flat level sets in dimensions ≤ 4.
The Hopf fibration has inspired any number of geometric structures in physical systems, in particular in chiral liquid crystalline materials. Because the Hopf fibration lives on the three sphere, S3, some method of projection or distortion must be employed to realize textures in flat space. Here, we explore…
We describe the "hyperbolic" properties of a riemann surface lamination M canonically associated to every compact three manifolds of curvature less than 1. More precisely, if the geodesic flow is the phase space attached to an ordinary differential equation, our space M is the "phase space" attached to a certain ellipt…
High-dimensional models become unstable when sample size falls below a critical level, leading to a phase transition.
problem Instability in high-dimensional learning models when sample size is insufficient.
method Proved the necessity of a Fisher eigenvalue threshold for stability, introduced Fisher floor for verification.
result A sharp phase transition between reliable concentration and inevitable failure in high-dimensional learning.
The paper examines how gradient descent stabilizes low-rank matrix factorization in noisy conditions.
problem Stability of low-rank implicit regularization in perturbed deep matrix factorization.
method Derives spectral conditions for gradient descent to exhibit a low-rank phase in noiseless settings and analyzes perturbed dynamics.
result Gradient descent converges to a low-rank solution under perturbation, with explicit dependence on perturbation size.
Noise can stabilize systemic risk models with uncertain robustness.
problem Understanding systemic risk in financial systems with uncertain parameters.
method Analyzing a mean-field model of systemic risk with uncertain coefficients and noise.
result Noise can induce stability in systemic risk models, contrary to intuition.
We present a model that investigates the spontaneous emergence of randomness in equity market microstructure. The phase space analysis of our model exposes an endogenous source of fluctuation in price and volume. We formulate a control problem for maximizing price regularity and stability while minimizing entanglement …
We study the deformed Hermitian-Yang-Mills (dHYM) equation, which is mirror to the special Lagrangian equation, from the variational point of view via an infinite dimensional GIT problem mirror to Thomas' GIT picture for special Lagrangians. This gives rise to infinite dimensional manifold H mirror to Solom…
AANets balance stability and plasticity in CIL.
problem Stability-plasticity dilemma in class-incremental learning.
method Adaptive Aggregation Networks (AANets) with stable and plastic residual blocks.
result AANets improve performance on CIL benchmarks.
Rod flow models Adam's behavior at the edge of stability.
problem Modeling adaptive gradient methods like Adam at the edge of stability.
method Extended rod flow to Adam, considering parameters, first moment, and second moment as variables.
result Rod flow accurately tracks Adam's behavior through the edge-of-stability regime.
We develop an explicit and tractable representation of a twist-grain-boundary phase of a smectic A liquid crystal. This allows us to calculate the interaction energy between grain boundaries and the relative contributions from the bending and compression deformations. We discuss the special stability of the 90 degree g…
Improved stability for matrix recovery from rank-one measurements.
problem Phase retrieval problem of recovering rank-one positive semidefinite matrices.
method Developed a smoothing Newton method based on Bures-Wasserstein gradient descent.
result Superlinear convergence with rigorous guarantees and stable implementation.
Poisson and symplectic structures discussed in lecture notes.
problem Exploring Poisson and symplectic structures in mathematics.
method Presentation of Poisson and symplectic structures, group actions, moment maps, and phase space reduction.
result Comprehensive review of Poisson and symplectic structures, group actions, and reduction.
Framework for multi-scale clustering using phase transitions.
problem Clustering datasets with multi-scale structures.
method Cascade of phase transitions in simulated annealing of Expectation-Maximisation algorithm with weighted local covariance.
result Approximation of the number and size of clusters at different scales.
Deep learning has become an area of interest in most scientific areas, including physical sciences. Modern networks apply real-valued transformations on the data. Particularly, convolutions in convolutional neural networks discard phase information entirely. Many deterministic signals, such as seismic data or electrica…
CoCos can increase financial fragility in certain network structures.
problem The effectiveness of CoCos in enhancing financial stability depends on the network structure.
method Analysis of phase transitions in a network of interconnected banks.
result CoCos can increase financial fragility under certain network structures.
Deep learning model reduces food waste by stabilizing online food delivery supply chains.
problem Wastage and bullwhip effect in online food delivery services.
method Two-phase LSTM network for demand forecasting, newsvendor model for inventory management.
result Significant reduction in bullwhip effect and food waste, improved forecasting accuracy.
We analyse a linear regression problem with nonconvex regularization called smoothly clipped absolute deviation (SCAD) under an overcomplete Gaussian basis for Gaussian random data. We propose an approximate message passing (AMP) algorithm considering nonconvex regularization, namely SCAD-AMP, and analytically show tha…
The big phase space, the geometric setting for the study of quantum cohomology with gravitational descendents, is a complex manifold and consists of an infinite number of copies of the small phase space. The aim of this paper is to define a Hermitian geometry on the big phase space. Using the approach of Dijkgraaf and …
We analyze the linear response of a market network to shocks based on the bipartite market model we introduced in an earlier paper, which we claimed to be able to identify the time-line of the 2009-2011 Eurozone crisis correctly. We show that this model has three distinct phases that can broadly be categorized as "stab…
Symplectic forms from two phase spaces are proven equivalent.
problem Equivalence of symplectic forms from different phase spaces.
method Proof of equivalence for theories over space-time with boundary.
result Symplectic forms derived from canonical and covariant phase spaces are equivalent.
Noise-robust Koopman operator framework for control with improved stability and performance.
problem Developing a stable and noise-robust Koopman operator for control tasks.
method Proposes a learning framework using Hankel matrix and neural network approximations for system dynamics, ensuring long-term stability and noise robustness.
result Demonstrates improved model performance and noise robustness in control tasks compared to existing methods.
Continuous phase transitions identified in Doi-Onsager, noisy transformer, and Hegselmann-Krause models.
problem Phase transitions in multimodal models and their properties.
method Sharp coercivity estimate and constrained Lebedev--Milin inequality.
result Continuous phase transitions at critical coupling strengths for Doi-Onsager, noisy transformer, and Hegselmann-Krause models.
The goal of this investigation was to overcome limitations of a persistency analysis, introduced by Benoit Mandelbrot for fractal Brownian processes: nondifferentiability, Brownian nature of process and a linear memory measure. We have extended a sense of a Hurst factor by consideration of a phase diffusion power law. …
SyMetric evaluates learned Hamiltonian dynamics from images, improving model stability and interpretability.
problem Lack of reliable metrics to assess learned Hamiltonian dynamics from images.
method Developed SyMetric, a binary indicator based on Hamiltonian dynamics properties.
result SyMetric identifies architectural improvements for better dynamics learning.
The phase space of relativistic particle mechanics is defined as the 1st jet space of motions regarded as timelike 1-dimensional submanifolds of spacetime. A Lorentzian metric and an electromagnetic 2-form define naturally on the odd-dimensional phase space a generalized contact structure. In the paper infinitesimal sy…
Stable long-term predictions for fluid flows using neural networks.
problem Predicting complex dynamics of fluid flows with high temporal stability.
method End-to-end trained neural network architecture combining CNN for spatial compression and LSTM for temporal prediction.
result Novel latent space subdivision (LSS) allows stable and controllable long-term predictions.
Develops a minimax optimal estimator for system stability under distribution shift.
problem Ensuring system reliability under changes in the underlying environment.
method Minimax optimal estimation of stability defined in terms of acceptable performance degradation.
result Characterizes the minimax convergence rate and demonstrates practical utility.
Theoretical study shows AI models can recover from contaminated training data.
problem Data contamination in AI training can degrade model performance.
method Theoretical analysis and experiments on various data types.
result Models converge to true distribution under mild conditions, with rate dependent on real data fraction.
GeoHNN models physics laws for stable, accurate predictions.
problem Violations of physical principles in machine learning models.
method Explicitly encodes geometric priors in inertia and phase space.
result Significantly outperforms existing models in long-term stability and accuracy.
The study finds minimal distortion embeddings of surfaces into small domains.
problem Finding the minimal distortion of embeddings between two-dimensional manifolds.
method Proving a lower bound on distortion in terms of areas' discrepancy, characterizing minimizers, and proving stability.
result Homotheties are the unique minimizers for VN/VM≥1/4, and non-homothetic minimizers exist for VN/VM≤1/4. New method for flux quantization on phase space stacks.
problem Defining and constructing flux-quantized phase space stacks.
method Observation of flux densities and characterization of Cauchy data.
result Flux-quantized phase space stacks have classifying spaces with rational Whitehead L-infinity algebra.
Introduces a new phase space for 2D supersymmetric sigma models.
problem Developing a new Hamiltonian formulation for 2D supersymmetric sigma models.
method Introduces a phase space with spinorial momenta and derives a covariant Hamiltonian formulation.
result Shows the existence of additional supersymmetries in the new formulation.
A novel framework interprets driving patterns using Action phases clustering.
problem Challenges in comprehending driving heterogeneity from underlying behavior mechanisms.
method Resampling and Downsampling Method (RDM) followed by iterative clustering calibration.
result Six driving patterns identified in real-world datasets, revealing dynamic nature of driving.