Many industrial machine learning (ML) systems require frequent retraining to keep up-to-date with constantly changing data. This retraining exacerbates a large challenge facing ML systems today: model training is unstable, i.e., small changes in training data can cause significant changes in the model's predictions. In…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “embedding instability”
MCE reduces embedding instability in nonlinear dimensionality reduction.
problem Embedding instability caused by random initialization.
method Median of multiple embeddings (MCE) based on large deviation theory.
result MCE achieves consistency at an exponential rate and effectively mitigates instability.
Study finds significant instability in node embeddings due to randomness.
problem Stability of node embeddings under random variations.
method Evaluated five node embedding algorithms (HOPE, LINE, node2vec, SDNE, GraphSAGE) on synthetic and empirical graphs.
result Significant instability in embedding spaces and downstream task accuracy.
New research shows hyperbolic embeddings are useful for global consistency tasks in graphs.
problem The usefulness of hyperbolic representations in graph learning tasks.
method Computed hyperbolic embeddings for node classification and link prediction tasks, addressing optimization issues at zero curvature.
result Hyperbolic embeddings are more effective for tasks requiring global consistency, while Euclidean models are superior for other tasks.
We present a deformation for constant mean curvature tori in the 3-sphere. We show that the moduli space of equivariant constant mean curvature tori in the 3-sphere is connected, and we classify the minimal, the embedded, and the Alexandrov embedded tori therein. We conclude with an instability result.
Paper uses TDA to assess cryptocurrency risk by measuring phase space instability.
problem Traditional risk measures fail to capture market dynamics' geometric structure.
method Applied Takens' Delay Embedding Theorem to generate point cloud, computed persistent homology groups, defined Topological Persistence Norm.
result Proposed leverage calibration heuristic based on persistence of 1-dimensional cycles.
New findings on embedding simplicial complexes, showing instability under joins.
problem Conditions for embedding simplicial complexes into double dimension.
method Study of van Kampen obstructions and Smith classes.
result Smith index is not stable under joins, leading to new embeddability results.
We improve current instability-based methods for the selection of the number of clusters in cluster analysis by developing a normalized cluster instability measure that corrects for the distribution of cluster sizes, a previously unaccounted driver of cluster instability. We show that our normalized instability mea…
Modeling HFT interactions reveals market instability.
problem Market instability caused by HFT dynamic coupling.
method Developed a recurrence relations framework to model HFT interactions.
result Unexpected latency and feedback can trigger market instability.
New proof of instability for certain Einstein metrics.
problem Einstein metrics on specific 4-manifolds.
method Proving instability of conformally Kähler, Einstein metrics.
result Proven instability of certain Einstein metrics.
We study stable surfaces, i.e., second order minima of the area for variations of fixed volume, in sub-Riemannian space forms of dimension . We prove a stability inequality and provide sufficient conditions ensuring instability of volume-preserving area-stationary surfaces with a non-empty singular set of curv…
Study stability and instability of Ricci-flat metrics under generalized Ricci flow.
problem Stability and instability of Ricci-flat metrics under Ricci flow.
method Analysis of generalized Ricci flow for Ricci-flat metrics and vanishing 3-forms.
result Dynamical stability and instability results for Ricci-flat metrics and vanishing 3-forms.
Some exotic compact objects possess evanescent ergosurfaces: timelike submanifolds on which a Killing vector field, which is timelike everywhere else, becomes null. We show that any manifold possessing an evanescent ergosurface but no event horizon exhibits a linear instability of a peculiar kind: either there are solu…
Interval Neural Networks detect instabilities in image reconstructions.
problem Detecting instabilities in deep learning image reconstructions.
method Employed uncertainty quantification methods with Interval Neural Networks.
result Interval Neural Networks effectively reveal image reconstruction instabilities.
Note on instabilities in super-time-stepping methods for Heston model.
problem Instabilities in super-time-stepping methods applied to Heston model.
method Exploration of explicit super-time-stepping schemes (RK-Chebyshev, RK-Legendre) for Heston model.
result Relevance of stability remarks beyond super-time-stepping schemes.
In this paper we find smooth embeddings of solenoids in smooth foliations. We show that if a smooth foliation F of a manifold M contains a compact leaf L with H^1(L;R)= 0 and if the foliation is a product foliation in some saturated open neighbourhood U of L, then there exists a foliation F' on M which is C^1-close to …
Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systemscond-mat.dis-nn
Binary perceptron's instability linked to replica symmetry breaking.
problem Understanding the relationship between algorithmic instability and replica symmetry breaking in binary perceptron learning.
method Established the connection between algorithmic instability and replica symmetry breaking by comparing the instability condition around the fixed point to the instability for breaking the replica symmetric solution of the free energy function.
result The instability condition around the algorithmic fixed point is identical to the instability for breaking the replica symmetric saddle point solution of the free energy function.
A central area of research in nonlinear science is the study of instabilities that drive the emergence of extreme events. Unfortunately, experimental techniques for measuring such phenomena often provide only partial characterization. For example, real-time studies of instabilities in nonlinear fibre optics frequently …
The study examines stability and instability of Poincaré-Einstein metrics using Ricci flow.
problem Stability and instability of Poincaré-Einstein metrics.
method Variant of expander entropy for asymptotically hyperbolic manifolds, local positive mass theorem, volume comparison.
result Characterization of stability and instability in terms of local positive mass theorem and volume comparison.
Study shows instability of naked singularities in perfect fluid models.
problem Instability of naked singularities in Einstein equations coupled with isothermal perfect fluid.
method Investigated spherically symmetric self-similar naked singularities under perturbations of an external massless scalar field.
result Spherically symmetric self-similar naked singularities are unstable to trapped surface formation.
Study on spectral stability of Riemannian coverings.
problem Stability of eigenvalues in Riemannian coverings.
method Analysis of Laplacian eigenvalues under finite coverings.
result Necessary conditions for spectral stability or instability.
Stability of clinical prediction models developed using statistical or machine learning methodsstat.ME
Clinical models can be unstable, leading to unreliable predictions.
problem Stability of clinical prediction models developed using statistical or machine learning methods.
method Simulation and case studies of statistical and machine learning approaches to show instability in model predictions.
result Model instability often leads to miscalibration of predictions in new data.
A data-driven approach predicts morphological development under structural instability.
problem Understanding and predicting spatiotemporal complexities of morphogenesis under structural instability.
method Machine-learning framework based on physical modeling of morphogenesis.
result Identification of key bifurcation characteristics and prediction of history-dependent development.
Study shows instability of naked singularities in scalar field models.
problem Stability of naked singularities in spherically symmetric Einstein-Scalar field systems.
method Analysis of a family of incoming null cones becoming increasingly singular.
result Naked singularities are unstable to black hole formation under certain perturbations.
Study shows instability of certain MOTSs with continuous symmetry.
problem Stability of MOTSs with continuous symmetry.
method Analysis of initial data sets with continuous symmetry and non-preserved MOTSs.
result Exotic MOTSs are unstable except in exceptional cases.
Improved vector quantization using Gaussian mixtures for better codebook utilization.
problem Training instability and information loss in discrete vector quantization.
method Generalized vector quantization with Gaussian mixture model and aggregated categorical posterior evidence lower bound.
result GM-VQ improves codebook utilization and reduces information loss without heuristics.
The paper studies stability and instability of minimal submanifolds in complex Einstein spaces.
problem Stability and instability of minimal submanifolds in complex Einstein spaces.
method Computation of index and nullity, investigation of stability, and algorithm for higher eigenvalues.
result Criterion for instability of minimal submanifolds in some cases.
The study examines the stability of Einstein metrics on Sasaki Einstein and nearly parallel G2 manifolds.
problem Linear instability of Einstein metrics on Sasaki Einstein and nearly parallel G2 manifolds.
method Analysis of the second and third Betti numbers for Sasaki Einstein and nearly parallel G2 manifolds.
result Positive second and third Betti numbers lead to linear instability for the respective manifolds.
Paper extends Simons theorem to -Yang-Mills connections for instability.
problem Tackles instability of -Yang-Mills connections.
method Extends Simons theorem to -Yang-Mills connections using Kobayashi-Ohnita-Takeuchi's method.
result Derives a sufficient condition for instability of non-flat -Yang-Mills connections.
In this short article, we improve the dynamical stability and instability results for Ricci-flat metrics under Ricci flow proved by Sesum and Haslhofer, getting rid of the integrability assumption.
Proposes a new measure to evaluate stability of statistical parameters under distributional shifts.
problem Difficulty in transferring knowledge across data sets due to distributional changes.
method Introduces a measure of instability quantifying sensitivity of statistical parameters to Kullback-Leibler divergence and directional shifts.
result The proposed measure can elucidate the type of shifts a parameter is sensitive to and improve estimation accuracy under shifted distributions.
The paper analyzes numerical instability in variational flows and proposes a diagnostic method.
problem Numerical instability in variational flows affects sampling, density evaluation, and ELBO estimation.
method Treated variational flows as dynamical systems, used shadowing theory for theoretical guarantees, and developed a diagnostic procedure.
result Despite numerical instability, results from variational flows can be accurate enough for practical applications.
Proposes a continuous flow model to understand and control instability in gradient descent for deep learning.
problem Understanding and controlling the instability of gradient descent in deep learning.
method Introduces the Principal Flow (PF), a continuous time flow that approximates gradient descent dynamics.
result The PF captures divergent and oscillatory behaviors of gradient descent, including escaping local minima and saddle points.
In this paper, we study stability for harmonic foliations on locally conformal Kähler manifolds with complex leaves. We also discuss instability for harmonic foliations on compact submanifolds immersed in Euclidean spaces and compact homogeneous spaces.
Study on instability of extreme Reissner-Nordström spacetime perturbations.
problem Linear stability of gravitational and electromagnetic perturbations in extreme Reissner-Nordström spacetime.
method Extends Giorgi's framework to prove instability results for a set of gauge invariant quantities along the event horizon.
result Proves decay, non-decay, and polynomial blow-up estimates for certain quantities along the event horizon, depending on the number of derivatives.
Improved CAEs reduce training time and enhance generalization.
problem Stability issues in Concrete Autoencoders (CAEs) for feature selection.
method Indirectly Parameterized Concrete Autoencoders (IP-CAEs) learn parameters of Gumbel-Softmax distributions.
result IP-CAEs achieve significant improvements in generalization and training time.
Dual-objective GANs reduce training instabilities with tunable α-loss parameters.
problem Training instabilities in Generative Adversarial Networks (GANs).
method Introduce -GANs with dual objectives modeled using -loss.
result Upper bounds on estimation error show improved performance under certain conditions.
A Björling Representation for Jacobi Fields on Minimal Surfaces and Soap Film Instabilitiescond-mat.soft
We develop a general framework for the description of instabilities on soap films using the Björling representation of minimal surfaces. The construction is naturally geometric and the instability has the interpretation as being specified by its amplitude and transverse gradient along any curve lying in the minimal sur…
This paper quantifies hyperparameter transfer and finds embedding layer learning rate is key.
problem Quantifying optimal hyperparameters for large language models across scales.
method Developed three metrics to quantify hyperparameter transfer and investigated the importance of embedding layer learning rate.
result Maximal Update (μP) parameterization offers high-quality learning rate transfer compared to standard parameterization (SP).
Study uses DNM theory to detect early warning signals of market instability.
problem Detecting early warning signals of financial market instability.
method Applying Dynamical Network Marker (DNM) theory to trading data from the Tokyo Stock Exchange.
result Early warning signals of large price movements can be detected on a daily time scale.
Codimension one stability of the catenoid under the vanishing mean curvature flow in Minkowski spacemath.AP
We study time-like hypersurfaces with vanishing mean curvature in the (3+1) dimensional Minkowski space, which are the hyperbolic counterparts to minimal embeddings of Riemannian manifolds. The catenoid is a stationary solution of the associated Cauchy problem. This solution is linearly unstable, and we show that this …
We prove the instability of some families of Riemannian manifolds with non-trivial real Killing spinors. These include the invariant Einstein metrics on the Aloff-Wallach spaces (which are all nearly except ), and Sasaki Einstein circle bundles over certain ir…
Graph neural networks benefit from a new initialization method that improves node learning.
problem Poor initialization in GNNs leads to slower convergence and increased training instability.
method Integrates a statistically grounded one-hot graph encoder embedding (GEE) into standard GNNs.
result GG framework provides consistent and substantial performance gains in node classification.
Study shows instability of specific cone solutions in high-dimensional spaces.
problem Unstable solutions of minimal graphs in high codimension.
method Min-max technique applied to Euclidean spaces.
result First examples of non-smooth unstable minimal graphs.
Following the financial crisis of 2007-2008, a deep analogy between the origins of instability in financial systems and complex ecosystems has been pointed out: in both cases, topological features of network structures influence how easily distress can spread within the system. However, in financial network models, the…
The paper proves instability of translating λ-solitons and provides bounds on their length.
problem Stability of translating λ-solitons in cylindrical geometry.
method Analytical proof of instability and explicit length bounds.
result Explicit bounds on the length of unstable translating λ-solitons.
Graph auto-encoders predict stock market instability by measuring graph structure changes.
problem Forecasting stock market instability and volatility.
method Use graph auto-encoders to reconstruct graph structure and measure changes.
result Higher GAE reconstruction error correlates with higher volatility.
New diagnostics detect variability in individual risk estimates from machine learning models in healthcare.
problem Variability in individual risk estimates from machine learning models in healthcare, leading to unreliable treatment decisions.
method Proposed evaluation framework using empirical prediction interval width and empirical decision flip rate diagnostics.
result Randomness in optimization and initialization can lead to substantial individual-level variability in risk estimates, affecting clinical decisions.