A new PGA algorithm ensures stable, robust, and noise-immune solutions for non-negative inverse problems.
problem Stable convergence and suboptimal solutions in inverse problems due to negative values and high sensitivity to hyperparameters.
method A novel multiplicative update proximal gradient algorithm (SSO-PGA) that enforces non-negativity and boundedness through a learnable sigmoid-based operator.
result Significantly surpasses traditional PGA and other state-of-the-art algorithms in performance and stability.
New method finds optimal learning rates for neural nets.
problem Finding optimal learning rates in stochastic neural networks.
method Gradient-only line searches using Non-negative Associative Gradient Projection Points (NN-GPPs).
result Learning rates can be reliably resolved as step sizes along search directions.
Proposes a new method for posterior sampling using MMD with negative distance kernel.
problem Posterior sampling and conditional generative modeling.
method Approximates joint distribution using discrete Wasserstein gradient flows of MMD with negative distance kernel.
result Establishes an error bound for posterior distributions and proves the method is a Wasserstein gradient flow.
A new method using negative-shifted gradient descent improves overparameterized linear regression by avoiding structural limitations of negative ridge endpoints.
problem Structural limitations of negative ridge endpoints in overparameterized linear regression.
method Negative-shifted gradient descent, which avoids the pole constraint of negative ridge endpoints.
result The method improves over all admissible endpoints by a polynomial factor in risk under explicit conditions.
New gradient flows for non-negative and probability measures combining optimal transport and interaction forces.
problem Optimizing non-negative and probability measures using interaction forces and optimal transport.
method Interaction-Force Transport (IFT) gradient flows and their spherical variant, developed via infimal convolution of Wasserstein and spherical MMD tensors, with a particle-based optimization algorithm.
result The spherical IFT gradient flow provides global exponential convergence guarantees for both MMD and KL energy.
Morse theory connects low energy submanifolds in 3-sphere.
problem Understanding low energy submanifolds in the 3-sphere.
method Morse-theoretic techniques and negative gradient flow.
result Constructs connections between low energy critical submanifolds.
Paper proposes an adversarial sampling method for efficient extreme classification.
problem Training classifiers over many classes is computationally expensive.
method Adversarial sampling to draw negative samples from an adversarial model.
result Significantly reduces training time by an order of magnitude.
We study pointwise and Lp gradient estimates of the heat kernel, on manifolds that may have some amount of negative Ricci curvature, provided it is not too negative (in an integral sense) at infinity. We also prove uniform boundedness results on Lp spaces for the heat operator of the Hodge Laplacian on differenti…
Study on gradient steady Kähler Ricci solitons with specific curvature properties.
problem Characterize gradient steady Kähler Ricci solitons with non-negative Ricci curvature and integrable scalar curvature.
method Analyzing the structure of these solitons and their universal covering spaces.
result Gradient steady Kähler Ricci solitons are quotients of specific manifolds.
The study shows ends of shrinking gradient ρ-Einstein solitons are non-parabolic.
problem Characterizing the ends of shrinking gradient ρ-Einstein solitons. method Proving non-parabolicity of ends and connectivity at infinity for specific conditions.
result Gradient shrinking ρ-Einstein solitons have non-parabolic ends under certain conditions. New kernel improves MMDs with theoretical guarantees for gradient flows.
problem Non-smoothness of negative distance kernel in MMDs.
method Smoothed 1D absolute value function followed by fractional integral transform.
result Improved theoretical guarantees for Wasserstein gradient flows.
GOLS finds activation functions affect training robustness, especially ReLU.
problem Investigate how different activation functions impact GOLS in neural network training.
method Identify SNN-GPPs for GOLS, analyze activation function effects on gradient continuity.
result GOLS robust for most activation functions but sensitive to ReLU.
Paper extends Aronson-Bénilan estimates for porous medium equations on manifolds with negative curvature.
problem Estimating gradients for porous medium equations on manifolds with negative curvature.
method Develops Aronson-Bénilan gradient estimates for porous medium equations under lower bounds of N-weighted Ricci curvature with N<0. result Generalizes gradient estimates for porous medium equations to manifolds with negative curvature.
In this paper, we study the gradient estimates of Li-Yau-Hamilton type for positive solutions to both drifting heat equation and the simple nonlinear heat equation problem ut−Δu=aulogu, u>0 on the compact Riemannian manifold (M,g) of dimension n and with non-negative (Bakry-Emery)-Ricci curvature. Here…
We improve the well known local gradient estimate of Cheng and Yau in the case when Ricci curvature has a negative lower bound.
Gradient flow studies Spin(7)-structures on compact 8-manifolds.
problem Formulating and studying the gradient flow of Spin(7)-structures.
method Negative gradient flow of an energy functional of Spin(7)-structures.
result Short-time existence and uniqueness of solutions to the flow.
DCGD improves training of PINNs by adjusting gradients to avoid negative inner products.
problem Pathological behaviors in PINNs training, especially gradient imbalance.
method Dual Cone Gradient Descent (DCGD) framework to adjust gradient direction.
result DCGD outperforms other optimization algorithms in various evaluation metrics.
A1GM method improves efficiency in reconstructing missing data using KL divergence.
problem Efficiently reconstructing missing data in matrices.
method Fast non-gradient-based rank-1 NMF using KL divergence.
result A1GM outperforms gradient methods in efficiency with competitive reconstruction errors.
Although the word-popularity based negative sampler has shown superb performance in the skip-gram model, the theoretical motivation behind oversampling popular (non-observed) words as negative samples is still not well understood. In this paper, we start from an investigation of the gradient vanishing issue in the skip…
The study proves triviality and rigidity results for Ricci solitons and estimates their conjugate radius.
problem Understanding the properties and behavior of Ricci solitons.
method Analytical proofs and estimates for various types of Ricci solitons.
result Upper bounds and estimates for conjugate radius of Ricci solitons.
Paper proves equivalences in portfolio optimization with new risk measures.
problem Portfolio optimization with novel risk measures.
method Derive subgradients and gradients for negative expectile and omega ratio.
result Negative expectile can be used as a portfolio optimization objective.
New degree theory proves existence of solitons on 4D manifolds.
problem Existence of gradient expanding solitons on 4D manifolds.
method Developed new degree theory for 4D, asymptotically conical gradient expanding solitons.
result Existence of solitons asymptotic to any cone over S^3 with non-negative scalar curvature.
In this paper, we study the gradient estimate for positive solutions to the following nonlinear heat equation problem ut−Δu=aulogu+Vu, u>0 on the compact Riemannian manifold (M,g) of dimension n and with non-negative Ricci curvature. Here a≤0 is a constant, V is a smooth function on M with $-…
A new approach improves numerical tabular data imputation by addressing diffusion models' limitations.
problem Inaccurate and difficult training in numerical tabular data imputation.
method Kernelized Negative Entropy-regularized Wasserstein gradient flow Imputation (KnewImp) based on Wasserstein gradient flow (WGF) framework.
result KnewImp significantly outperforms existing methods in numerical tabular data imputation.
Advances geometric structure flows, proving short-time existence and uniqueness for various flows.
problem Analyzing flows of geometric structures, focusing on non-isometric flows and specific subgroups.
method Developed algebra and compared two flows: negative gradient and Ricci-harmonic. Proved existence and uniqueness for Ricci-harmonic flow.
result Proved short-time existence and uniqueness for Ricci-harmonic flow for arbitrary lower-order torsion-quadratic terms.
Games generalize the single-objective optimization paradigm by introducing different objective functions for different players. Differentiable games often proceed by simultaneous or alternating gradient updates. In machine learning, games are gaining new importance through formulations like generative adversarial netwo…
DG improves policy gradients by weighting actions with a sigmoid of advantage and surprisal.
problem Pathologies in standard policy gradients, leading to poor updates and over-allocation of gradient budget.
method Introduces Delightful Policy Gradient (DG) that gates each term with a sigmoid of advantage and surprisal.
result DG provably improves directional accuracy in a single context and shifts the expected gradient closer to the oracle across multiple contexts.
Study growth rates of harmonic functions on curved surfaces.
problem Understanding the growth rates of harmonic functions on curved surfaces.
method Gradient estimate and frequency analysis on complete surfaces and manifolds with non-negative curvature.
result Existence and properties of nonconstant polynomial growth harmonic functions on manifolds with maximal volume growth.
In this note, we complete the classification of the geometry of non-compact two-dimensional gradient Ricci solitons. As a consequence, we obtain two corollaries: First, a complete two-dimensional gradient Ricci soliton has bounded curvature. Second, we give examples of complete two-dimensional expanding Ricci solitons …
Sharp Liouville theorem for minimal graphs on manifolds with nonnegative Ricci curvature.
problem Characterizing smooth solutions to minimal hypersurface equations on manifolds with nonnegative Ricci curvature.
method Gradient estimate for minimal graphs over Σ with small linear growth of the negative parts of graphic functions via iteration. result Every smooth solution u to minimal hypersurface equation on Σ is a constant provided u has sublinear growth for its negative part. Constructs new steady gradient Ricci solitons for higher dimensions.
problem Finding new steady gradient Ricci solitons with non-negative curvature.
method Constructing continuous families of Ricci flows from spherical polyhedra, proving stability.
result Produces new examples of steady gradient Ricci solitons for n≥4. In this paper, we prove that the Lp essential spectra of the Laplacian on functions are [0,+∞) on a non-compact complete Riemannian manifold with non-negative Ricci curvature at infinity. The similar method applies to gradient shrinking Ricci soliton, which is similar to non-compact manifold with non-negative…
Accelerated gradient (AG) methods are breakthroughs in convex optimization, improving the convergence rate of the gradient descent method for optimization with smooth functions. However, the analysis of AG methods for non-convex optimization is still limited. It remains an open question whether AG methods from convex o…
Non-negative matrix factorization is a basic tool for decomposing data into the feature and weight matrices under non-negativity constraints, and in practice is often solved in the alternating minimization framework. However, it is unclear whether such algorithms can recover the ground-truth feature matrix when the wei…
By extending Koiso's examples to the non-compact case, we construct complete gradient Kahler-Ricci solitons of various types on certain holomorphic line bundles over compact Kahler-Einstein manifolds. Moreover, a uniformization result on steady gradient Kahler-Ricci solitons with non-negative Ricci curvature is obtaine…
Eigenfunction gradients on curved spaces imply rigid structure.
problem Eigenfunction gradient estimates on curved manifolds.
method Sharp Li-Yau type gradient estimates for Neumann or Dirichlet eigenfunctions.
result Compact manifolds with specific curvature properties are rigidly structured.
In this paper, we prove that complete gradient steady Kähler-Ricci solitons with harmonic Bochner tensor are necessarily Kähler-Ricci flat, i.e., Calabi-Yau, and that complete gradient shrinking (or expanding) Kähler-Ricci solitons with harmonic Bochner tensor must be isometric to a quotient of $N^k\times \mathbb{C}^{n…
This article shows that if the negative part of Ricci curvature lies in the Kato class, the heat kernel satisfies a Li-Yau type estimate. Additionally, using the resulting heat kernel bound, we show that the obtained heat kernel estimate leads to bounds on the first Betti number only depending on the Kato constant.
Characterizes gradient Yamabe solitons with specific conditions.
problem Understanding properties of gradient Yamabe solitons.
method Proved conditions leading to constant scalar curvature, subharmonicity, and harmonic potential.
result Gradient Yamabe solitons under certain conditions are of constant scalar curvature.
In this paper we consider the Martin compactification, associated with the operator L=Δ−1, of a complete non-compact surface (Σ2,ds2) with negative curvature. In particular, we investigate positive eigenfunctions with eigenvalue one of the Laplace operator Δ of (Σ2,ds2) and prove a uniqueness …
Minimal graphs grow slowly on curved spaces, proving constant solutions.
problem Characterizing minimal graphs with sublinear growth on manifolds.
method New technique to get gradient bounds by integral estimates, no further geometric assumptions.
result Entire solutions are constant when negative part grows like r/logr. Every connected, weighted graph with non-negative curvature has exactly two ends.
problem Characterizing the structure of connected, weighted graphs with non-negative curvature.
method Extremal Lipschitz extensions, variational principle, study of harmonic functions.
result Every salami has exactly two ends and no vertices with positive curvature.
Corrected CBOW performs similarly to Skip-gram.
problem CBOW embeddings underperform Skip-gram embeddings in word2vec.
method Fixed a bug in CBOW gradient update to improve performance.
result Corrected CBOW embeddings are competitive with Skip-gram on various tasks.
We prove gradient estimates for hypersurfaces in the hyperbolic space Hn+1, expanding by negative powers of a certain class of homogeneous curvature functions. We obtain optimal gradient estimates for hypersurfaces evolving by certain powers p>1 of F−1 and smooth convergence of the properly rescale…
In this paper, we prove some classification results for four-dimensional gradient Ricci solitons. For a four-dimensional gradient shrinking Ricci soliton with div4Rm±=0, we show that it is either Einstein or a finite quotient of R4, S2×R2 or S3×R. T…
Stochastic gradient Langevin dynamics (SGLD) is a computationally efficient sampler for Bayesian posterior inference given a large scale dataset. Although SGLD is designed for unbounded random variables, many practical models incorporate variables with boundaries such as non-negative ones or those in a finite interval.…
GBHT uses gradient boosting for density estimation with theoretical guarantees.
problem Density estimation for unsupervised learning.
method Gradient Boosting Histogram Transform (GBHT) with Negative Log Likelihood loss.
result GBHT achieves faster convergence rates and better performance than base learners in density estimation.
Sharp gradient estimates for positive Ricci curvature manifolds.
problem Understanding geometric properties of manifolds with positive Ricci curvature.
method Proving sharp gradient estimates and monotonicity formulae.
result Sharp gradient estimates and monotonicity formulae for positive Ricci curvature manifolds.