A new model corrects SBM's bias for power-law degree networks.
problem SBM's incapability to handle power-law degree distributions.
method Introducing degree decay variables to encode varying degree distributions.
result PLD-SBM approximately preserves the scale-free feature in real networks and corrects SBM's bias.
Study on Kähler manifolds connects curvature decay with growth of holomorphic functions.
problem Analyzing properties of Kähler manifolds with nonnegative bisectional curvature.
method Established precise relations among minimal degree, volume growth, and scalar curvature decay.
result Unified understanding of Kähler-Ricci flow through polynomial growth holomorphic functions.
Study shows rapid decay of Hitchin metric from semi-flat metric on Higgs bundles.
problem Analyzing the asymptotic behavior of the Hitchin metric on moduli spaces of Higgs bundles.
method Examined the decay rate of the difference between Hitchin and semi-flat metrics on smooth spectral curves.
result Exponential decay of the difference between Hitchin and semi-flat metrics as t approaches infinity.
Adaptive weight-decay improves deep neural network performance.
problem Overfitting in deep neural networks.
method AdaDecay adjusts weight-decay adaptively based on gradient norms within each layer.
result AdaDecay improves generalization and accuracy across various datasets and models.
In this article we study the dependence degree of the traded volume of the Dow Jones 30 constituent equities by using a nonextensive generalised form of the Kullback-Leibler information measure. Our results show a slow decay of the dependence degree as a function of the lag. This feature is compatible with the existenc…
Adaptive time decay functions improve financial product recommendation accuracy.
problem Inaccurate recommendations due to static historical data in finance.
method Time-dependent collaborative filtering with personalized decay functions.
result Significant improvements over state-of-the-art benchmarks in financial product recommendation.
Study examines implied volatility behavior in Bachelier model.
problem Characterizing implied volatility in Bachelier model for large strikes.
method Exploiting regular variation theory, derived explicit expressions for Bachelier implied volatility.
result Established a rigorous connection between characteristic function analyticity and volatility smile asymptotic slope.
Study improves the exponential rate of metric difference in Higgs bundles.
problem Improving the exponential rate of metric difference in Higgs bundles.
method Analyzes the Hitchin metric and semi-flat metric in rank two Higgs bundles.
result Exponential rate of metric difference is improved.
The study examines polynomial growth functions on gradient shrinking Ricci solitons.
problem Characterizing harmonic and caloric functions with polynomial growth on gradient shrinking Ricci solitons.
method Analysis of polynomial growth functions under different curvature conditions.
result Finite dimensional estimates for harmonic and caloric functions with polynomial growth.
Graphs with non-negative Ollivier-Ricci curvature cannot be expanders.
problem Understanding the relationship between graph curvature and expansion properties.
method Proving an inequality linking isoperimetric profiles to total variation decay of random walks.
result Graphs with non-negative Ollivier-Ricci curvature cannot be expanders.
Adaptive LR improves neural network Lipschitz regularity without slowing convergence.
problem Training neural networks with high Lipschitz constant.
method Adaptive learning rate (decay) in gradient descent for two-layer networks.
result Decaying learning rate maintains convergence rate and Lipschitz regularity.
We study the geometry of infinitely presented groups satisfying the small cancelation condition C'(1/8), and define a standard decomposition (called the criss-cross decomposition) for the elements of such groups. We use it to prove the Rapid Decay property for groups with the stronger small cancelation property C'(1/10…
New CH covariance class improves spatial statistics by balancing differentiability and tail behavior.
problem Lack of control over mean-square differentiability and tail behavior in Matérn covariance functions.
method Developed a new Confluent Hypergeometric (CH) covariance class using a scale mixture of Matérn and polynomial covariances.
result The CH class offers improved theoretical properties and better performance in extrapolative settings.
Study examines how training regime affects neural networks' forgetting.
problem Catastrophic forgetting in neural networks when learning multiple tasks sequentially.
method Analyzes the impact of different training regimes (learning rate, batch size, regularization) on forgetting.
result Training regimes that widen tasks' local minima help prevent catastrophic forgetting.
Two new algorithms reduce online kernel regression's computational cost while maintaining optimal regret bounds.
problem Trade-off between regret and computational cost in online kernel regression.
method AOGD-ALD and NONS-ALD algorithms dynamically maintain nearly orthogonal basis to approximate kernel mapping and control approximate error.
result Achieves nearly optimal regret bounds at sublinear computational complexity.
High-dimensional kernel regression struggles due to rotational invariance.
problem Kernel ridge regression struggles in high dimensions due to rotational invariance.
method Analysis of kernel properties and their impact on high-dimensional data.
result Lower bound on generalization error for high-dimensional kernel regression.
We study by theoretical analysis and by direct numerical simulation the dynamics of a wide class of asynchronous stochastic systems composed of many autocatalytic degrees of freedom. We describe the generic emergence of truncated power laws in the size distribution of their individual elements. The exponents α of the…
In this paper we consider the cluster estimation problem under the Stochastic Block Model. We show that the semidefinite programming (SDP) formulation for this problem achieves an error rate that decays exponentially in the signal-to-noise ratio. The error bound implies weak recovery in the sparse graph regime with bou…
A variation of the preferential attachment random graph model of Barabási and Albert is defined that incorporates planted communities. The graph is built progressively, with new vertices attaching to the existing ones one-by-one. At every step, the incoming vertex is randomly assigned a label, which represents a commun…
An analysis of the stylized facts in financial time series is carried out. We find that, instead of the heavy tails in asset return distributions, the slow decay behaviour in autocorrelation functions of absolute returns is actually directly related to the degree of clustering of large fluctuations within the financial…
Study on Lp cohomology and Hodge decomposition for ALE manifolds.
problem Understanding Lp cohomology dimensions and harmonic forms in ALE manifolds. method Relating dimensions of Lp cohomology spaces to decaying harmonic forms, proving independence and jumps in dimensions, and providing Hodge decompositions. result Dimension of Lp reduced cohomology spaces in degree k is independent of p for k not equal to 1 or n-1, and jumps by a factor N-1 for k equal to 1 or n-1. Study online learning in RKHS with dependent processes, focusing on \(β\)- and \(φ\)-mixing.
problem Online learning in RKHS with dependent data.
method Online regularized learning algorithm in RKHS, analyzing \(β\)- and \(φ\)-mixing sequences.
result Probabilistic upper bounds and convergence rates for mixing coefficients.
Characterizes eigenfunctions of Lawson-Osserman cone and proves its integrability.
problem Eigenfunctions and integrability of Lawson-Osserman cone.
method Characterization of eigenfunctions and proof of integrability.
result Lawson-Osserman cone is integrable, generating all Jacobi fields via rotations and translations.
Extends Minkowski stability proof to minimal decay assumptions.
problem Global stability of Minkowski spacetime with minimal decay.
method Extends Christodoulou-Klainerman's proof to minimal decay assumptions.
result Exterior stability of Minkowski holds with borderline decay.
New method creates vacuum data at minimal and borderline decay thresholds.
problem Creating vacuum initial data at specific decay thresholds.
method Conical solution-operator method applied to vacuum asymptotically flat initial data.
result Demonstrates global and exterior stability of Minkowski spacetime.
Learning rate annealing improves robustness in stochastic optimization.
problem Tuning learning rates in large-scale models is costly and prone to errors.
method We analyze and demonstrate the benefits of learning rate annealing schemes.
result Stochastic gradient descent with annealed schedules converges more robustly to the optimal solution.
Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
problem Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
method Reformulating Stein discrepancy construction as an explicit SNR^2 maximisation problem
result Avoiding exponential SNR^2 collapse and achieving stable SNR^2
Unique solutions found for wave-like decaying null infinity equations.
problem Wave-like decaying null infinity equations with spherically symmetric Einstein-scalar-field.
method Local and global unique solutions for small initial data.
result Sharp decaying condition for unique solutions.
New method solves Einstein constraint equations for vacuum.
problem Solving the Einstein constraint equations in vacuum.
method Prescribes four scalar quantities and reformulates equations as coupled transport and elliptic equations.
result Provides a large class of exterior solutions matching to interior solutions.
New findings on flatness of certain metrics with fast decay.
problem Rigidity of positive mass theorem under fast metric decay.
method Considered metrics with nonnegative scalar curvature and rapid decay at infinity.
result Any such metric is necessarily flat in dimensions 4 and higher if decay rate exceeds Schwarzschild metric.
Eigenvalues of random hyperbolic surface covers converge to hyperbolic plane's.
problem Eigenvalue rigidity of random hyperbolic surface covers.
method Selberg trace formula and polynomial method.
result Distribution of eigenvalues converges to hyperbolic plane's spectral measure.
It has been assumed that arbitrage profits are not possible in efficient markets, because future prices are not predictable. Here we show that predictability alone is not a sufficient measure of market efficiency. We instead propose to measure inefficiencies of markets in terms of the maximal profit an ideal trader can…
Study on curvature decay in steady Ricci solitons, proving dichotomy.
problem Curvature decay in steady Ricci solitons.
method Established a dichotomy for curvature decay in specific types of solitons.
result Proved a dichotomy on curvature decay for certain steady Ricci solitons.
Method samples triangulations of manifolds using biased random walks.
problem Efficiently sample triangulations of manifolds.
method Biased random walk through Pachner graph with Metropolis-Hastings accept/reject probabilities.
result Samples triangulations at random from chosen probability, estimating rare triangulations.
Cautious Weight Decay modifies weight decay for better optimization.
problem Improving optimization in deep learning models.
method Applies weight decay selectively based on parameter sign alignment.
result Consistently improves model performance across various tasks and scales.
Study on scalar curvature decay on non-compact manifolds linked at infinity.
problem Understanding scalar curvature decay on non-compact manifolds with topological linking at infinity.
method Analyzing polynomial decay, developing obstruction theory, using μ--bubble exhaustions, and index theory. result Topological linking at infinity forces polynomial decay of scalar curvature on manifolds of weakly bounded geometry.
Study on massless Vlasov equation on Reissner-Nordström spacetimes, showing decay rates and non-decay phenomena.
problem Analyzing decay and non-decay rates of solutions to the massless Vlasov equation on Reissner-Nordström spacetimes.
method Quantitative analysis of geodesic flow and comparison to wave equation instability results.
result Exponential decay rates in subextremal cases and polynomial rates in extremal cases, with non-decay of transversal derivatives in extremal cases.
Introduces gradient decay in Softmax for better generalization.
problem Improving generalization performance in neural networks.
method Gradient decay hyperparameter in Softmax for varying gradient rates based on probability.
result Gradient decay rate affects generalization performance and can be tuned for better optimization.
Study examines wave equation decay and Strichartz estimates on conic manifolds.
problem Analyzing wave equation behavior on conic spaces with critical electromagnetic potentials.
method Established decay and Strichartz estimates through localized spectral measure construction.
result Extended and improved previous results on wave equation behavior with critical potentials.
Weight decay stabilizes training dynamics by slowing progressive sharpening.
problem Understanding how weight decay affects training stability in deep learning models.
method Analyzing weight decay effects at the Edge of Stability, developing a mathematical framework.
result Weight decay dampens oscillations and stabilizes sharpness in CNNs, causing a phase transition in MLPs.
Study shows uniform decay rate for singular mean curvature flows.
problem Understanding singularities in mean curvature flows.
method Rescaled flow analysis near compact singularities.
result Uniform decay order bound for the rescaled flow.
Polynomial decay of correlations shown for curved surfaces.
problem Analyzing geodesic flows on curved surfaces.
method Proving polynomial decay of correlations for geodesic flows on nonpositively curved surfaces.
result Polynomial decay of correlations for geodesic flows on nonpositively curved surfaces.
In this paper we investigate the computational complexity of learning the graph structure underlying a discrete undirected graphical model from i.i.d. samples. We first observe that the notoriously difficult problem of learning parities with noise can be captured as a special case of learning graphical models. This lea…
Last SGD iterate bounds for overparameterized linear regression.
problem Analyzing the last iterate risk bounds of SGD with decaying stepsize for overparameterized linear regression.
method Problem-dependent analysis of last iterate risk bounds of SGD with geometrically decaying stepsize.
result Proved nearly matching upper and lower bounds on the excess risk for last iterate SGD with geometrically decaying stepsize.
Optimal learning rates decay to zero in easy tasks and maintain a warmup phase in hard tasks.
problem Optimizing learning rates under functional scaling laws for model training.
method Deriving optimal learning-rate schedules based on exponents s and β. result Sharp phase transition between easy and hard tasks, with different decay behaviors.
We found that factors decay over time, with momentum fitting best.
problem Understanding how factors decay over time and their impact on performance.
method Derived a hyperbolic decay model for factors, tested against linear and exponential alternatives.
result Momentum exhibits hyperbolic decay, outperforming linear and exponential models.
The paper predicts and explains the decay of stock anomaly performance over time.
problem Predicting and explaining the drop in risk-adjusted performance of stock anomalies.
method The authors propose ex-ante characteristics based on hypotheses of out-of-sample decay and in-sample overfitting.
result The year of publication explains 30% of the variance in Sharpe decay across factors.
Sharp decay found for solutions of a specific equation in Lie groups.
problem Asymptotic decay of solutions to a Yamabe type equation.
method Analysis of a specific pseudodifferential operator in a homogeneous Lie group.
result Established sharp asymptotic decay of positive solutions.