Study shows overparametrization can shift and bend loss landscapes, affecting signal recovery.
problem Understanding how overparametrization affects loss landscapes in neural networks.
method Field theory analysis of Hessian spectrum at initialization.
result Overparametrization can shift the BBP transition point, potentially reaching weak-recovery threshold.
Study of correlated Wigner matrices with BBP transitions.
problem Understanding spectral transitions in correlated Wigner matrices.
method Analyzes a Wigner-type matrix with row/column correlations, decomposes into bulk and outliers, and uses integral operators to model transitions.
result Correlated Wigner matrices exhibit multiple BBP transitions at critical points.
New method detects global factors near BBP phase transition in high-dimensional data.
problem Detecting the number of global factors in noisy high-dimensional correlation matrices.
method Iterative Global Factor (IGF) algorithm combining adaptive edge recalibration and PR delocalization filter.
result IGF algorithm successfully detects global factors near BBP transition, improving over eigenvalue-only methods.
Optimal spectral method found for inhomogeneous spiked Wigner model.
problem Structured noise in learning scenarios.
method Random matrix theory and spectral analysis.
result Optimal threshold for phase transition in block-structured Wigner model.
Random matrix theory explains transient signal detectability in early-stopped gradient flow.
problem Transient signal detectability in early-stopped gradient flow.
method Random matrix theory applied to gradient flow in a linear teacher-student setting.
result Transient Baik-Ben Arous-Péché (BBP) transition in learning dynamics due to anisotropy and noise.
Gradient flow in phase retrieval escapes spurious minima with high probability.
problem Understanding gradient-based optimization in high-dimensional non-convex functions.
method Analytical and numerical study of gradient dynamics in phase retrieval.
result Gradient flow avoids spurious minima by drifting along unstable directions.
Study quantifies performance gap between tensor and matrix-based approaches in nested matrix-tensor model.
problem Estimating a planted signal in a nested matrix-tensor model.
method Comparing tensor-based and matrix-based approaches for best rank-one approximation of tensor data.
result Derives precise algorithmic threshold for the unfolding approach and shows BBP-type transition behavior.
Estimates rank-one spikes from heavy-tailed noise using self-avoiding walks.
problem Estimating rank-one spikes from heavy-tailed noise.
method Self-avoiding walks to count and estimate the spikes.
result Optimal estimation up to the BBP threshold for heavy-tailed noise.
Study reveals how attention helps in signal recovery from sequence models using random matrix theory.
problem Signal recovery from sequence models with attention mechanisms.
method Analysis of sample covariance matrices constructed from pooled sequence representations with attention weights.
result Optimal attention weights maximize signal-to-noise ratio and improve signal recovery.
The paper studies phase transitions in random matrices and tensor unfolding for detecting signals.
problem Phase transitions in singular values and vectors of large random matrices.
method Analysis of singular values and vectors of long rectangular random matrices, and tensor unfolding algorithm for asymmetric rank-one spiked tensor models.
result An exact threshold for tensor unfolding to detect signals, independent of unfolding procedure.
We apply a local differential geometric framework from Kähler toric geometry to (re)construct Calabi's extremal Kähler metrics on $\bbC\bbP^n$ blown-up at a point from data on the moment polytope.
Improves signal detection in non-Gaussian noise using transformed data.
problem Signal detection in rank-one signal-plus-noise data matrices.
method Pre-transforming matrix entries and using linear spectral statistics for hypothesis testing.
result Sharp phase transition of largest eigenvalues in spiked rectangular matrices.
PLS-SVD struggles with missing data in multimodal datasets, showing a phase transition in performance.
problem Missing data in PLS-SVD for multimodal datasets.
method Replica-symmetric analysis of spiked rectangular random matrices with missing entries.
result PLS-SVD performance transitions from uninformative to informative singular vectors at a critical signal-to-noise threshold.
Improves detection of low-rank signals from noisy data matrices.
problem Statistical detection of low-rank signals in noisy data matrices.
method Entrywise pre-transforming data matrix for non-Gaussian noise, sharp phase transition thresholds, central limit theorem for linear spectral statistics, hypothesis test.
result Improves detection of low-rank signals from noisy data matrices, generalizing known results.
Study on signal recovery from low-rank matrix with sparse noise.
problem Inference of a rank-one signal in the presence of sparse noise.
method Replica method from statistical physics, recursive distributional equations, population dynamics algorithm.
result Critical signal strength for recovery via top eigenvector identified.
Study reveals limits of PLS in multi-modal learning with correlated signals.
problem Understanding PLS performance in multi-modal learning with correlated signals.
method Random matrix theory analysis of spiked cross-covariance models.
result Identifies SNR and correlation regimes where PLS fails to recover any signal.
New analysis reveals masked self-supervised learning's effectiveness in extracting data structure.
problem Analyzing masked self-supervised learning in high-dimensional data.
method Developed precise high-dimensional analysis of masked modeling objectives.
result Identified phase transitions and structured regimes for masked self-supervised learning.
We consider a stochastic volatility model with Lévy jumps for a log-return process Z=(Zt)t≥0 of the form Z=U+X, where U=(Ut)t≥0 is a classical stochastic volatility process and X=(Xt)t≥0 is an independent Lévy process with absolutely continuous Lévy measure ν. Small-time expansio…
Randomized SVD shows phase transitions in noisy data.
problem Noise sensitivity of randomized SVD in large rank matrices.
method Analyzed R-SVD under low-rank signal plus noise model.
result R-SVD exhibits BBP-like phase transition with outliers above detectability threshold.
The local geometry of high dimensional neural network loss landscapes can both challenge our cherished theoretical intuitions as well as dramatically impact the practical success of neural network training. Indeed recent works have observed 4 striking local properties of neural loss landscapes on classification tasks: …
RBM learns in high dimensions via AMP and GD, reaching optimal weak recovery.
problem Learning from high-dimensional data with RBM.
method AMP and GD analysis for RBM training in high dimensions.
result RBM reaches optimal weak recovery threshold in spiked covariance model.
Consistent model selection for spiked Wigner model via AIC-type criteria.
problem Estimating the number of spiked eigenvalues in the spiked Wigner model.
method AIC-type model selection criteria with parameters γ.
result Strong consistency for γ > 2 and weak consistency for γ = 2 + δ_N.
We analyze the landscape of empirical risk minimization for high-dimensional models, predicting phase transitions and critical point properties.
problem Understanding the complexity and structure of high-dimensional empirical risk landscapes.
method Using the Kac-Rice formula, we analyze the expected number of critical points and their spectral properties, providing detailed predictions.
result We derive complete topological phase diagrams for the phase retrieval problem, predicting BBP-type transitions and critical point stability.
Study of eigenvalues in nonlinear kernels for classification of separable data.
problem Understanding the applicability of linear equivalents in nonlinearly separable data classification.
method Analysis of conjugate kernels and their quadratic equivalents for a canonical nonlinearly separable dataset (XOR problem).
result Identification of regimes where nonlinear kernels deviate from linear equivalents, leading to label-aligned eigenspaces.
Efficient algorithm for robust recovery in stochastic block models.
problem Robust recovery in stochastic block models.
method Convex optimization framework, addressing optimization landscape challenges.
result Achieves robust recovery without a price of robustness.
Holomorphic splitting theorem for Calabi-Yau manifolds with specific properties.
problem Constructing a complete Calabi-Yau metric on a manifold with a specific divisor.
method Solved Monge-Ampère equation on generalized ALG manifolds, used solution to prove holomorphic splitting theorem.
result Proved biholomorphic equivalence of a Calabi-Yau manifold to a product space.
Gradient-based algorithms are effective for many machine learning tasks, but despite ample recent effort and some progress, it often remains unclear why they work in practice in optimising high-dimensional non-convex functions and why they find good minima instead of being trapped in spurious ones. Here we present a qu…
Develops methods to simulate rare transitions in molecular systems.
problem Rare transitions between metastable states in molecular systems are difficult to study due to limited data.
method Two novel methods: chain-based and midpoint-based approaches.
result Demonstrates effectiveness of methods in both data-rich and data-scarce scenarios.
The paper models market crashes as phase transitions, finding dynamic transitions offer better predictions.
problem Understanding and predicting extreme financial events like market crashes.
method Employing phase transition theory, focusing on endogenous crashes, and comparing DPT, CPT, and SPT.
result Dynamic phase transitions provide more accurate predictions of market crashes compared to critical and stochastic models.
This paper establishes an equivalence between transitive double Lie algebroids and core diagrams.
problem Understanding and characterizing transitive double Lie algebroids.
method Using core diagrams and equivalence of transitive core diagrams with transitive double Lie groupoids.
result Transitive double Lie algebroids are completely determined by their core diagrams.
This paper shows semi-equivelar toroidal maps are vertex-transitive covers.
problem Understanding the relationship between semi-equivelar and vertex-transitive toroidal maps.
method Proving semi-equivelar toroidal maps are quotients of vertex-transitive toroidal maps.
result Each semi-equivelar toroidal map has a finite vertex-transitive cover.
Two-dimensional transition rates improve life insurance reserve calculations.
problem Calculating life insurance reserves with Markov assumptions.
method Introducing two-dimensional forward and backward transition rates.
result Two-dimensional transition rates enable more accurate reserve calculations.
We study the problem of detecting the presence of a single unknown spike in a rectangular data matrix, in a high-dimensional regime where the spike has fixed strength and the aspect ratio of the matrix converges to a finite limit. This setup includes Johnstone's spiked covariance model. We analyze the likelihood ratio …
Machine learning approximates phase transitions using Fisher information.
problem Understanding phase transitions from data using machine learning.
method Information geometry and Fisher information.
result Machine learning indicators approximate the square root of Fisher information.
Double-well transitions are stiffer than minimal surfaces.
problem Rigidity of double-well phase transitions compared to minimal hypersurfaces.
method Comparison of rigidity properties between double-well phase transitions and minimal hypersurfaces.
result Double-well phase transitions exhibit more rigidity than minimal hypersurfaces.
Dual-T method improves transition matrix estimation in noisy label learning.
problem Large estimation error in noisy class posterior leads to poor transition matrix estimation.
method Introducing an intermediate class to avoid direct estimation of noisy class posterior, factorizing the transition matrix into two easier-to-estimate matrices.
result The dual-T estimator leads to better classification performances.
Defines SETR to measure carbon transition risk for investors.
problem Difficulty in measuring the magnitude of carbon transition risk for investors.
method Defines Single Event Transition Risk (SETR) and illustrates its use.
result SETR can approximate the magnitude of low-carbon transition risk.
New algorithm achieves data-dependent regret bounds in MDPs with unknown transitions.
problem Achieving best-of-both-worlds guarantees with data-dependent regret bounds in MDPs with unknown transitions.
method Optimistic follow-the-regularized-leader algorithm with new optimistic Q-function estimators and transition bonus.
result First-order, second-order, and path-length bounds with polylog(T) regret in the stochastic regime.
Develops a flexible model for regime transitions in time series data.
problem Nonlinear and context-dependent regime transitions in time series data.
method Semi-parametric state-space model with learned transition functions.
result Improved recovery of nonlinear transition dynamics and earlier detection of regime changes.
Study measures investment funds' climate transition risk, finds moderate losses.
problem Measuring the impact of climate transition on investment portfolios.
method Comprehensive framework using geographical, sectoral, company and ISIN-level data.
result Investment funds suffer a moderate 5.7% loss in high transition risk scenario.
Study shows continuity of non-Kähler Calabi-Yau conifold transitions.
problem Understanding the geometry of Calabi-Yau conifold transitions.
method Use of balanced and Hermitian-Yang-Mills metrics to analyze conifold transitions.
result The conifold transition is continuous in the Gromov-Hausdorff topology.
If a given behavior of a multi-agent system restricts the phase variable to a invariant manifold, then we define a phase transition as change of physical characteristics such as speed, coordination, and structure. We define such a phase transition as splitting an underlying manifold into two sub-manifolds with distinct…
Study shows Elo models fail to accurately measure transitive strength in competitive games.
problem Elo models fail to correctly identify the transitive component in real-world competitive games.
method Investigated the challenge of identifying the transitive component in games, proposed an extension of the Elo score.
result Disc ranking system assigns two scores: skill and consistency.
Proves robust transitivity for geodesic flows from metrics with conjugate points.
problem Transitivity of geodesic flows from metrics with conjugate points.
method General criterion for robust transitivity of partially hyperbolic geodesic flows.
result First example of a C2 open set of Riemannian metrics with conjugate points and transitive geodesic flow. New method improves robustness of deep learning with noisy labels.
problem Robust deep learning on corrupted labels with noisy samples.
method Meta-transition adaptation through clean meta data guidance.
result More accurate estimation of noise transition matrix and classifier parameters.
We present a continuous-time maximum likelihood estimation methodology for credit rating transition probabilities, taking into account the presence of censored data. We perform rolling estimates of the transition matrices with exponential time weighting with varying horizons and discuss the underlying dynamics of trans…
We address the problem of necessary conditions and topological obstructions for the existence of robustly transitive maps on surfaces. Concretely, we show that partial hyperbolicity is a necessary condition in order to have C1 robustly transitive endomorphisms with critical points on surfaces, and the only surfaces …
We generalized the periodic links to \emph{transitive} links in a 3-manifold M. We find a complete classification theorem of transitive links in a 3-dimensional sphere R3. We study these links from several different aspects including polynomial invariants using the relation between link polynomials of…