Proposes a new measure to evaluate stability of statistical parameters under distributional shifts.
problem Difficulty in transferring knowledge across data sets due to distributional changes.
method Introduces a measure of instability quantifying sensitivity of statistical parameters to Kullback-Leibler divergence and directional shifts.
result The proposed measure can elucidate the type of shifts a parameter is sensitive to and improve estimation accuracy under shifted distributions.
Large learning rates cause parameter instability, leading to better generalization.
problem Understanding why deep neural networks perform well despite operating outside the traditional stability regime.
method Analyzing the effect of large learning rates on the orientation of Hessian eigenvectors and parameter exploration.
result Large learning rates induce parameter instability, leading to better generalization through exploration of flatter regions of the loss landscape.
Mapper is an unsupervised machine learning algorithm generalising the notion of clustering to obtain a geometric description of a dataset. The procedure splits the data into possibly overlapping bins which are then clustered. The output of the algorithm is a graph where nodes represent clusters and edges represent the …
Investment strategies in financial markets can lead to instability due to market impacts.
problem Market impacts make it impossible for investors to accurately optimize their strategies.
method Built an agent-based model with technical analysis strategy agents to investigate optimization instability.
result Investment strategies' parameters never converged but continued to change, leading to unstable market price evolution.
We study analytically and numerically Minsky instability as a combination of top-down, bottom-up and peer-to-peer positive feedback loops. The peer-to-peer interactions are represented by the links of a network formed by the connections between firms, contagion leading to avalanches and percolation phase transitions pr…
Many industrial machine learning (ML) systems require frequent retraining to keep up-to-date with constantly changing data. This retraining exacerbates a large challenge facing ML systems today: model training is unstable, i.e., small changes in training data can cause significant changes in the model's predictions. In…
New framework assesses regularization norms in ill-posed problems, revealing L2 instability and proposing adaptive fractional RKHS solutions.
problem Comparative analysis of regularization norms in ill-posed problems.
method Small noise analysis framework for Tikhonov and RKHS regularizations.
result Optimal convergence rates achieved with adaptive fractional RKHS, but hyper-parameters decay too fast.
Dual-objective GANs reduce training instabilities with tunable α-loss parameters.
problem Training instabilities in Generative Adversarial Networks (GANs).
method Introduce (αD,αG)-GANs with dual objectives modeled using α-loss. result Upper bounds on estimation error show improved performance under certain conditions.
Topic models are Bayesian models that are frequently used to capture the latent structure of certain corpora of documents or images. Each data element in such a corpus (for instance each item in a collection of scientific articles) is regarded as a convex combination of a small number of vectors corresponding to `topic…
Predictive geometric models deliver excellent results for many Machine Learning use cases. Despite their undoubted performance, neural predictive algorithms can show unexpected degrees of instability and variance, particularly when applied to large datasets. We present an approach to measure changes in geometric models…
Topic models can provide us with an insight into the underlying latent structure of a large corpus of documents. A range of methods have been proposed in the literature, including probabilistic topic models and techniques based on matrix factorization. However, in both cases, standard implementations rely on stochastic…
The paper shows instability in Minkowski spacetime for a quantum system.
problem Linear instability of the semiclassical Einstein-Klein-Gordon system in Minkowski spacetime.
method Formulated a forcing problem for metric and state perturbations, used tensor decomposition and quantum Møller operator.
result Metric perturbations grow exponentially, bounded by a universal scale H, indicating quantum backreaction.
We improve current instability-based methods for the selection of the number of clusters k in cluster analysis by developing a normalized cluster instability measure that corrects for the distribution of cluster sizes, a previously unaccounted driver of cluster instability. We show that our normalized instability mea…
New findings on optimal transport gradient for generative models, addressing numerical instabilities.
problem Numerical instabilities in training Wasserstein Generative Adversarial Networks (WGAN).
method Valid differentiation theorem for entropic regularized transport, semi-discrete gradient formulation, and optimization algorithm.
result Existence of optimal transport gradient for generative models under specified conditions.
Price fluctuations in financial markets can be characterized by Lévy's stable distribution, which is supported by the generalized central limit system. When the stable parameters were estimated from four different stock markets in long term, they similarly indicated an unique value. On the other hand, when analyzed in …
Modeling HFT interactions reveals market instability.
problem Market instability caused by HFT dynamic coupling.
method Developed a recurrence relations framework to model HFT interactions.
result Unexpected latency and feedback can trigger market instability.
We show that financial correlations exhibit a non-trivial dynamic behavior. We introduce a simple phenomenological model of a multi-asset financial market, which takes into account the impact of portfolio investment on price dynamics. This captures the fact that correlations determine the optimal portfolio but are affe…
New proof of instability for certain Einstein metrics.
problem Einstein metrics on specific 4-manifolds.
method Proving instability of conformally Kähler, Einstein metrics.
result Proven instability of certain Einstein metrics.
Study stability and instability of Ricci-flat metrics under generalized Ricci flow.
problem Stability and instability of Ricci-flat metrics under Ricci flow.
method Analysis of generalized Ricci flow for Ricci-flat metrics and vanishing 3-forms.
result Dynamical stability and instability results for Ricci-flat metrics and vanishing 3-forms.
Some exotic compact objects possess evanescent ergosurfaces: timelike submanifolds on which a Killing vector field, which is timelike everywhere else, becomes null. We show that any manifold possessing an evanescent ergosurface but no event horizon exhibits a linear instability of a peculiar kind: either there are solu…
In this paper we consider the training of single hidden layer neural networks by pseudoinversion, which, in spite of its popularity, is sometimes affected by numerical instability issues. Regularization is known to be effective in such cases, so that we introduce, in the framework of Tikhonov regularization, a matricia…
Interval Neural Networks detect instabilities in image reconstructions.
problem Detecting instabilities in deep learning image reconstructions.
method Employed uncertainty quantification methods with Interval Neural Networks.
result Interval Neural Networks effectively reveal image reconstruction instabilities.
Note on instabilities in super-time-stepping methods for Heston model.
problem Instabilities in super-time-stepping methods applied to Heston model.
method Exploration of explicit super-time-stepping schemes (RK-Chebyshev, RK-Legendre) for Heston model.
result Relevance of stability remarks beyond super-time-stepping schemes.
We orthogonalize the NSS model to condition and diagnose its ill-conditioned parameters.
problem The ill-conditioning of the NSS model's design matrix.
method Exact orthogonal reparametrization via QR decomposition.
result Orthogonalization isolates the conditioning structure and maintains fit uncertainty.
Study on market instability in multi-agent trading with price impact and transaction costs.
problem Analyzing market instability in multi-agent trading with price impact and transaction costs.
method Analytical and numerical methods to study Nash equilibria and stability conditions.
result Conditions on model parameters determine market stability, including scaling of market impact and transaction cost.
Binary perceptron's instability linked to replica symmetry breaking.
problem Understanding the relationship between algorithmic instability and replica symmetry breaking in binary perceptron learning.
method Established the connection between algorithmic instability and replica symmetry breaking by comparing the instability condition around the fixed point to the instability for breaking the replica symmetric solution of the free energy function.
result The instability condition around the algorithmic fixed point is identical to the instability for breaking the replica symmetric saddle point solution of the free energy function.
A central area of research in nonlinear science is the study of instabilities that drive the emergence of extreme events. Unfortunately, experimental techniques for measuring such phenomena often provide only partial characterization. For example, real-time studies of instabilities in nonlinear fibre optics frequently …
The study examines stability and instability of Poincaré-Einstein metrics using Ricci flow.
problem Stability and instability of Poincaré-Einstein metrics.
method Variant of expander entropy for asymptotically hyperbolic manifolds, local positive mass theorem, volume comparison.
result Characterization of stability and instability in terms of local positive mass theorem and volume comparison.
Slow feature analysis (SFA) is a method for extracting slowly varying features from a quickly varying multidimensional signal. An open source Matlab-implementation sfa-tk makes SFA easily useable. We show here that under certain circumstances, namely when the covariance matrix of the nonlinearly expanded data does not …
Study shows instability of naked singularities in perfect fluid models.
problem Instability of naked singularities in Einstein equations coupled with isothermal perfect fluid.
method Investigated spherically symmetric self-similar naked singularities under C1,α perturbations of an external massless scalar field. result Spherically symmetric self-similar naked singularities are unstable to trapped surface formation.
Study on spectral stability of Riemannian coverings.
problem Stability of eigenvalues in Riemannian coverings.
method Analysis of Laplacian eigenvalues under finite coverings.
result Necessary conditions for spectral stability or instability.
Clinical models can be unstable, leading to unreliable predictions.
problem Stability of clinical prediction models developed using statistical or machine learning methods.
method Simulation and case studies of statistical and machine learning approaches to show instability in model predictions.
result Model instability often leads to miscalibration of predictions in new data.
A data-driven approach predicts morphological development under structural instability.
problem Understanding and predicting spatiotemporal complexities of morphogenesis under structural instability.
method Machine-learning framework based on physical modeling of morphogenesis.
result Identification of key bifurcation characteristics and prediction of history-dependent development.
Study shows instability of naked singularities in scalar field models.
problem Stability of naked singularities in spherically symmetric Einstein-Scalar field systems.
method Analysis of a family of incoming null cones becoming increasingly singular.
result Naked singularities are unstable to black hole formation under certain perturbations.
Study shows instability of certain MOTSs with continuous symmetry.
problem Stability of MOTSs with continuous symmetry.
method Analysis of initial data sets with continuous symmetry and non-preserved MOTSs.
result Exotic MOTSs are unstable except in exceptional cases.
The paper studies stability and instability of minimal submanifolds in complex Einstein spaces.
problem Stability and instability of minimal submanifolds in complex Einstein spaces.
method Computation of index and nullity, investigation of stability, and algorithm for higher eigenvalues.
result Criterion for instability of minimal submanifolds in some cases.
The study examines the stability of Einstein metrics on Sasaki Einstein and nearly parallel G2 manifolds.
problem Linear instability of Einstein metrics on Sasaki Einstein and nearly parallel G2 manifolds.
method Analysis of the second and third Betti numbers for Sasaki Einstein and nearly parallel G2 manifolds.
result Positive second and third Betti numbers lead to linear instability for the respective manifolds.
Paper extends Simons theorem to F-Yang-Mills connections for instability.
problem Tackles instability of F-Yang-Mills connections. method Extends Simons theorem to F-Yang-Mills connections using Kobayashi-Ohnita-Takeuchi's method. result Derives a sufficient condition for instability of non-flat F-Yang-Mills connections. In this short article, we improve the dynamical stability and instability results for Ricci-flat metrics under Ricci flow proved by Sesum and Haslhofer, getting rid of the integrability assumption.
New method proves instability of naked singularity and censors it.
problem Proving instability and censoring naked singularity.
method Einstein-scalar field system, hyperbolic short-pulse method, non-perturbative elliptic arguments.
result Tiny anisotropic perturbation leads to anisotropic apparent horizon censoring the naked singularity.
Proposes a Doubly Robust mean-CVaR portfolio method to improve investment risk management.
problem Portfolio optimization challenges in unstable financial markets.
method Doubly Robust approach to mean-CVaR portfolio optimization.
result The proposed method outperforms traditional mean-variance optimization.
The paper analyzes numerical instability in variational flows and proposes a diagnostic method.
problem Numerical instability in variational flows affects sampling, density evaluation, and ELBO estimation.
method Treated variational flows as dynamical systems, used shadowing theory for theoretical guarantees, and developed a diagnostic procedure.
result Despite numerical instability, results from variational flows can be accurate enough for practical applications.
Threats on the stability of a financial system may severely affect the functioning of the entire economy, and thus considerable emphasis is placed on the analyzing the cause and effect of such threats. The financial crisis in the current and past decade has shown that one important cause of instability in global market…
Proposes a continuous flow model to understand and control instability in gradient descent for deep learning.
problem Understanding and controlling the instability of gradient descent in deep learning.
method Introduces the Principal Flow (PF), a continuous time flow that approximates gradient descent dynamics.
result The PF captures divergent and oscillatory behaviors of gradient descent, including escaping local minima and saddle points.
In this paper, we study stability for harmonic foliations on locally conformal Kähler manifolds with complex leaves. We also discuss instability for harmonic foliations on compact submanifolds immersed in Euclidean spaces and compact homogeneous spaces.
Study on instability of extreme Reissner-Nordström spacetime perturbations.
problem Linear stability of gravitational and electromagnetic perturbations in extreme Reissner-Nordström spacetime.
method Extends Giorgi's framework to prove instability results for a set of gauge invariant quantities along the event horizon.
result Proves decay, non-decay, and polynomial blow-up estimates for certain quantities along the event horizon, depending on the number of derivatives.
An expanding literature articulates the view that Taylor rules are helpful in predicting exchange rates. In a changing world however, Taylor rule parameters may be subject to structural instabilities, for example during the Global Financial Crisis. This paper forecasts exchange rates using such Taylor rules with Time V…
Reinforcement learning (RL) tasks are challenging to implement, execute and test due to algorithmic instability, hyper-parameter sensitivity, and heterogeneous distributed communication patterns. We argue for the separation of logical component composition, backend graph definition, and distributed execution. To this e…