Deep learning dynamics and NTK evolution studied through diverse measures.
problem Understanding the training dynamics of deep neural networks and their loss landscapes.
method Phenomenological analysis of training dynamics in multiple architectures and datasets.
result Training dynamics exhibit a chaotic initial transient followed by a stable phase, with the NTK evolving to match full network performance.
We combine Riemannian geometry with the mean field theory of high dimensional chaos to study the nature of signal propagation in generic, deep neural networks with random weights. Our results reveal an order-to-chaos expressivity phase transition, with networks in the chaotic phase computing nonlinear functions whose g…
Predicts the age of astronomical transients from real-time data.
problem Improving understanding of transients and their progenitor systems.
method Bayesian probabilistic recurrent neural network.
result Accurately predicts the age of transients with robust uncertainties.
New Roman pipeline detects astronomical transients.
problem Automated detection of transients from Roman Space Telescope data.
method Machine learning model RuBR for distinguishing real from fake detections.
result Effective real-bogus classification in Roman era.
Study shows bifurcating price dynamics in ASME with traders.
problem Understanding price dynamics in artificial stock markets.
method Agent-based model of endogenous traders interacting through a LOB.
result Bistability in price equilibria: zero-price and persistent positive-price states.
Calculates the transient number of knots using homology groups.
problem Determining the minimal number of arcs needed to trivialize a knot.
method Uses the rank of the first homology group of the double branched cover of the knot.
result Calculates transient numbers for many knots and shows existence of knots with arbitrarily large transient numbers.
Study chaotic behavior in homeomorphism groups of countable products of spaces.
problem Investigate chaotic behavior in homeomorphism groups of countable products of various metrizable topological spaces.
method Construct numerous examples of chaotic groups of homeomorphisms of countable products of spaces.
result New chaotic groups of homeomorphisms of countable products of various metrizable topological spaces are discovered.
Detects anomalies in astronomical time series data.
problem Identifying new and interesting transients in large astronomical surveys.
method Two novel methods: a probabilistic neural network and a Bayesian parametric model.
result Neural networks are less suitable for anomaly detection in time series data compared to parametric models.
TSSC images enhance chaotic signal classification using ConvNets.
problem Classifying chaotic signals accurately and robustly.
method Triad State Space Construction (TSSC) for image encoding, Convolutional Neural Network (ConvNet) for classification.
result TSSC-ConvNet achieves high accuracy and robustness in chaotic signal classification.
Transient market impact explained via Nash equilibrium in a game.
problem Understanding the transient nature of market impact.
method Analyzing a game between a trader and an arbitrageur, deriving decay kernels.
result Implied transient impact can be derived from trader behavior at Nash equilibrium.
The use of artificial neural networks as models of chaotic dynamics has been rapidly expanding. Still, a theoretical understanding of how neural networks learn chaos is lacking. Here, we employ a geometric perspective to show that neural networks can efficiently model chaotic dynamics by becoming structurally chaotic t…
Study non-rectangular robust MDPs for average-reward, finding optimal policies and transient values.
problem Non-rectangular robust Markov decision processes under average-reward criterion.
method Proves history-dependent policies are robust-optimal, introduces transient-value framework, constructs epoch-based policy.
result Existence and properties of robust optimal policies, transient value bounds.
New method decomposes Markov chain rewards into persistent and transient components.
problem Ambiguity in classical evaluation methods for Markov chains with reducible and periodic states.
method Minimal exact quotient by the real peripheral invariant subspace, decomposing rewards into persistent and transient components.
result Exact comparison with classical methods shows that the new decomposition reallocates the same information, making persistent modes explicit.
Study examines the training process of an unsupervised learning model for detecting gravitational-wave transient noise.
problem Transient noise in gravitational-wave detector data causes instability and signal overlap.
method Unsupervised deep learning with variational autoencoder and invariant information clustering applied to the Gravity Spy dataset.
result Training process of the unsupervised learning architecture is examined and reported.
We present RAPID (Real-time Automated Photometric IDentification), a novel time-series classification tool capable of automatically identifying transients from within a day of the initial alert, to the full lifetime of a light curve. Using a deep recurrent neural network with Gated Recurrent Units (GRUs), we present th…
Study solves utility maximization in a transient price impact market.
problem Utility maximization in a market with transient price impact.
method Developed a discrete-time model and removed market depth and resilience process restrictions.
result Solved the utility maximization problem without convexity of attainable portfolio values.
Reservoir computing predicts chaotic systems for long horizons with sparse updates.
problem Predicting chaotic systems with long horizons using limited data.
method Sparse, time-dependent data inputs into reservoir computing.
result Achieves arbitrarily long prediction horizons for chaotic systems.
Novel method uses information theory to measure causal influences during transient neural events.
problem Characterizing network interactions during transient neural events.
method Structural Causal Models, Information Theory, Transfer Entropy, Dynamic Causal Strength, Relative Dynamic Causal Strength.
result Introduced a novel measure, relative Dynamic Causal Strength, with theoretical and empirical support.
Bayesian ANN method predicts chaotic systems with uncertainty.
problem Estimating chaotic dynamical systems from noisy data.
method Bayesian Artificial Neural Networks for ODE inverse problems.
result Accurate time predictions and uncertainty bounds.
Unsupervised learning classifies transient noise in gravitational wave detectors.
problem Transient noise interferes with gravitational wave signals, causing instability.
method Combines variational autoencoder and invariant information clustering.
result Consistent classification with Gravity Spy project labels.
New risk models use chaotic attractors to predict extreme events.
problem Predicting Black Swan events in financial markets.
method Combining heavy-tailed priors with chaotic dynamics (Lorenz and Rossler systems).
result Models generate volatility clustering, fat tails, and extreme events.
Panda predicts chaotic systems without retraining, showing emergent properties.
problem Predicting chaotic systems with small errors.
method Trained on a synthetic dataset of chaotic dynamical systems using evolutionary algorithms.
result Panda predicts unseen chaotic systems with zero-shot learning.
Deep learning models learn chaotic system dynamics from real and simulated data.
problem Training deep learning models for chaotic systems requires big data.
method Jointly train deep neural networks on real and simulated data, enforcing physical laws.
result Proposes knowledge-based deep learning (KDL) for accurate forecasting of chaotic systems.
We discuss an "extrinsic" property of knots in a 3-subspace of the 3-sphere S3 to characterize how the subspace is embedded in S3. Specifically, we show that every knot in a subspace of the 3-sphere is transient if and only if the exterior of the subspace is a disjoint union of handlebodies, i.e. regular neighbor…
CNNs improve transient detection in DES-SN images.
problem Automated identification of transients in astronomical images.
method Convolutional Neural Networks (CNNs) for image classification.
result CNNs achieve efficiency in identifying non-artifacts from artifacts.
This paper considers the ideal gas-like model of trading markets, where each individual is identified as a gas molecule that interacts with others trading in elastic or money-conservative collisions. Traditionally this model introduces different rules of random selection and exchange between pair agents. Real economic …
We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their predictions do not violate physical laws. This is achieved by introducing an additional lo…
Optimal trading strategy adapts to signals in markets with price impact.
problem Optimal liquidation in markets with linear price impact and predictive signals.
method Formulated as a stochastic control problem, solved using probabilistic and convex analytic techniques.
result Explicit solution for optimal trading strategy in terms of SDEs.
We study a multiplicative transient price impact model for an illiquid financial market, where trading causes price impact which is multiplicative in relation to the current price, transient over time with finite rate of resilience, and non-linear in the order size. We construct explicit solutions for the optimal contr…
New method uses machine learning to analyze catalyst reactions.
problem Understanding complex reaction mechanisms in catalytic materials.
method Combining transient kinetics and machine learning.
result Correct estimates of micro-kinetic coefficients and mechanism.
Study optimal execution in a transient price impact model with multiple traders.
problem Optimal execution among multiple traders with transient price impact.
method Analyzed N-player optimal execution games in an Obizhaeva--Wang model with and without regularization. Derived equilibrium solutions and explained their behavior. result Existence of equilibrium restored with a specific time-dependent cost on block trades, and equilibrium is tractable.
Due to the dynamic nature, chaotic time series are difficult predict. In conventional signal processing approaches signals are treated either in time or in space domain only. Spatio-temporal analysis of signal provides more advantages over conventional uni-dimensional approaches by harnessing the information from both …
Gradient descent with chaotic perturbations improves generalization.
problem Improving generalization of gradient descent.
method Introducing chaotic perturbations to gradient descent to achieve improved generalization.
result Gradient descent with chaotic perturbations converges to a heavy-tailed SDE, leading to improved generalization.
New algorithm improves understanding of decentralized SBO transient iteration complexity.
problem Limited understanding of how network topology, data heterogeneity, and nested structures affect SBO.
method D-SOBA framework with two variants: D-SOBA-SO and D-SOBA-FO, providing non-asymptotic convergence analysis and transient iteration complexity.
result First theoretical understanding of how network topology, data heterogeneity, and nested structures influence decentralized SBO.
The geometry of oscillatory integrals on manifolds with intermediate symmetry.
problem Classification of curvature conditions in Sogge's program.
method Proposing a classification of curvature conditions.
result No manifolds satisfy the chaotic curvature condition of order 1.
A ML model accurately replicates chaotic dynamics across various parameters.
problem Replicating chaotic characteristics of non-linear dynamics using machine learning.
method A ML model trained to predict one-step-ahead states from historic states captures bifurcation diagrams and Lyapunov exponents universally.
result Variational quantum circuit outperforms classical models in reproducing long-term chaotic characteristics.
Investigates chaotic financial time series with monthly contributions and devaluation.
problem Analyzing chaotic behavior in financial processes with piecewise contributions and negative interest rates.
method Examines a financial process with monthly contributions and devaluation, showing dichotomy in behavior.
result Financial time series exhibit either periodic sequences or Cantor set of ω-limit points, with chaotic behavior at points of a Cantor attractor.
We use standard deep neural networks to classify univariate time series generated by discrete and continuous dynamical systems based on their chaotic or non-chaotic behaviour. Our approach to circumvent the lack of precise models for some of the most challenging real-life applications is to train different neural netwo…
RNNs struggle with chaotic dynamics due to exploding gradients, but we found a way to optimize training.
problem Challenging training of RNNs with chaotic dynamics due to exploding gradients.
method Relating loss gradients to Lyapunov spectrum to optimize training on chaotic data.
result RNNs with chaotic dynamics always have diverging gradients, while stable ones have bounded gradients.
This paper proves long-time accuracy of ensemble Kalman filters for chaotic and machine-learned systems.
problem Ensuring long-term accuracy of ensemble Kalman filters for complex dynamical systems.
method Established conditions for long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems.
result Ensemble Kalman filters maintain small estimation error over long time horizons for chaotic and machine-learned systems.
SMC analysis reveals key transient effects in macroeconomic ABM.
problem Analysis of complex ABMs is challenging and often relies on ad hoc methods.
method Statistical model checking (SMC) implemented through MultiVeStA.
result Clear contrast across parameter families in macro-financial and structural sweeps.
Apparently random financial fluctuations often exhibit varying levels of complexity, chaos. Given limited data, predictability of such time series becomes hard to infer. While efficient methods of Lyapunov exponent computation are devised, knowledge about the process driving the dynamics greatly facilitates the complex…
Random matrix theory explains transient signal detectability in early-stopped gradient flow.
problem Transient signal detectability in early-stopped gradient flow.
method Random matrix theory applied to gradient flow in a linear teacher-student setting.
result Transient Baik-Ben Arous-Péché (BBP) transition in learning dynamics due to anisotropy and noise.
FCOC framework improves financial volatility forecasting.
problem Tackles dual challenges of feature fidelity and model responsiveness in financial volatility forecasting.
method Synergizes fractal feature extraction and dynamic chaotic oscillation processing.
result Demonstrates profound and generalizable impact on S\&P 500 and DJI datasets.
A new framework reduces inconsistencies in chaotic surrogate modeling.
problem Consistency issues between probabilistic objectives and dynamical system dynamics.
method KAFFEE (Kalman-Aware Framework For Ergodic Emulation), a differentiable extended Kalman filter.
result KAFFEE mitigates the dynamic-probabilistic consistency gap, improving reconstruction and predictive scores.
We present a sparse and invariant representation with low asymptotic complexity for robust unsupervised transient and onset zone detection in noisy environments. This unsupervised approach is based on wavelet transforms and leverages the scattering network from Mallat et al. by deriving frequency invariance. This frequ…
Improves inverse uncertainty quantification for time-dependent data using PCA and deep neural networks.
problem Efficiently quantify model input uncertainties from time-dependent experimental data.
method Functional PCA for dimensionality reduction, deep neural networks for surrogate modeling, Bayesian neural networks for uncertainty estimation.
result The proposed method reduces the computational cost and improves the agreement with experimental data.
A model-based approach to forecasting chaotic dynamical systems utilizes knowledge of the physical processes governing the dynamics to build an approximate mathematical model of the system. In contrast, machine learning techniques have demonstrated promising results for forecasting chaotic systems purely from past time…