Adaptive momentum method solves non-convex min-max problems.
problem Non-convex min-max optimization problems in training generative adversarial networks.
method Proposes an adaptive momentum algorithm for non-convex min-max optimization.
result Establishes non-asymptotic convergence rates for the proposed algorithm.
Localized min-max method proves minimal hypersurface existence.
problem Existence of minimal hypersurfaces in complete manifolds.
method Localized min-max approach to prove existence.
result Existence of complete embedded minimal hypersurface with index at most one.
New methods solve min-max problems on manifolds using Riemannian Hamiltonians.
problem Min-max optimization on Riemannian manifolds.
method Riemannian Hamiltonian methods (RHM) to minimize the Hamiltonian function.
result RHM leads to correct search directions and global optimality in min-max problems.
Equity-Transformer solves NP-hard min-max routing problems efficiently.
problem Min-max routing problems with multiple agents and large-scale applications.
method Sequential planning approach with Transformer and equitable workload distribution inductive biases.
result Significant runtime and cost reductions in min-max mTSP and min-max mPDP tasks.
Epoch-GDA achieves optimal convergence rate for SCSC min-max problems.
problem Solving stochastic min-max problems with strong convexity and strong concavity.
method Epoch-wise stochastic gradient descent ascent method (Epoch-GDA) without additional assumptions.
result Achieves the optimal rate of O(1/T) for the duality gap of general SCSC min-max problems. Study introduces statistical mechanics for min-max problems.
problem Understanding the properties of min-max problems in high dimensions.
method Statistical mechanical formalism for analyzing min-max problems.
result Derives the relationship between training data and generalization error.
Improved algorithms for convex-concave min-max optimization and monotone variational inequalities.
problem Efficiently solving constrained convex-concave min-max problems and monotone variational inequalities.
method Higher-order methods achieving iteration complexities of O(1/T^{ rac{p+1}{2}}) for p-th order derivatives.
result Achieved improved convergence rates for min-max and monotone variational inequalities.
New algorithm solves min-max optimization problems in a decentralized manner.
problem Solving min-max saddle point games in a decentralized and adaptive manner.
method Developed a decentralized adaptive momentum (DADAM3) algorithm for min-max optimization. result DADAM3 achieves non-asymptotic rates of convergence for finding Nash equilibrium points. Proves existence of Yamabe metrics on conical 4-manifolds using min-max method.
problem Existence of Yamabe metrics on conical 4-manifolds with singular points.
method Min-max scheme adapted to singular setting, leveraging recent positive mass theorems.
result Existence of Yamabe metrics on conical 4-manifolds with finitely-many singular points.
Constructs cmc doublings of minimal surfaces via min-max theory.
problem Construct cmc doublings of minimal surfaces.
method Uses min-max theory and catenoid estimate.
result Constructs ε-cmc doublings of Σ for small ε > 0.
We reformulate LIPs as min-max problems for easier solution.
problem Recovering signals from few linear measurements.
method Proposed a min-max reformulation of LIPs.
result Saddle points characterize solutions to LIPs.
The paper bounds the min-max width of embedded circles on spheres and manifolds.
problem Bounding the min-max width of embedded circles on spheres and manifolds.
method Inducing a sweepout by pairs of points in embedded circles from a given sweepout of the sphere by closed curves.
result Lower bounds for the Birkhoff min-max invariant of a Riemannian sphere in terms of the min-max width of its embedded circles.
Bayesian optimization methods improved for min max optimization problems.
problem Min-max optimization for unknown functions.
method Extended Bayesian optimization to min-max problems with new acquisition functions.
result Improved acquisition functions lead to better solutions.
New geometric invariant from min-max width of spheres on Riemannian 2-spheres.
problem Understanding the min-max width of spheres associated to distance functions.
method Application of min-max methods to pairs of points on Riemannian 2-spheres.
result The min-max width does not always equal half the length of a simple closed geodesic.
New algorithm solves non-convex, non-differentiable min-max games.
problem Limited theoretical understanding of non-smooth min-max games.
method Proximal gradient descent-ascent algorithm for convex-strongly convex games.
result Algorithm converges to ε-Nash equilibrium with polynomial gradient evaluations.
The study bounds the topology of free boundary minimal surfaces in 3D manifolds.
problem Understanding the topology of free boundary minimal surfaces in compact 3D manifolds.
method Establishing general bounds on the topology via min-max methods and analyzing varifolds.
result The first Betti number is lower semicontinuous in the limit of min-max sequences.
Study shows strong min-max principle for phase transitions.
problem Understanding nodal sets near minimal hypersurfaces.
method Analogous to White's principle, applies to Allen-Cahn energy.
result Strong min-max principle for phase transitions.
The abstract finds conditions for creating curves of constant curvature.
problem Finding conditions for closed embedded curves of constant curvature.
method Using Almgren-Pitts min-max method for geodesic curvature.
result Closed embedded curves of any prescribed constant curvature found in S2. Upper bound for Morse index of min-max varifolds.
problem Bounding Morse index of varifolds.
method Proving upper bound for Morse index of min-max stationary integral varifolds.
result Upper bound for Morse index of min-max stationary integral varifolds.
Study finds nontrivial n-harmonic maps from Sn to closed manifolds.
problem Existence of nontrivial n-harmonic maps for n≥3. method Established via min-max constructions for p>n as pon+, with k≥1. result Nontrivial n-harmonic maps from Sn to closed manifolds are found. The paper solves min-max widths on a 3-sphere and strengthens multiplicity theorems.
problem Which min-max widths of the unit 3-sphere lie between 2π2 and 8π? method Homological min-max theory and stronger versions of multiplicity one theorems.
result Proves the 10th to 13th min-max widths of the unit 3-sphere lie between 2π2 and 8π. In this paper, we build up a min-max theory for minimal surfaces using sweepouts of surfaces of genus g≥2. We develop a direct variational methods similar to the proof of the famous Plateau problem by J. Douglas and T. Rado. As a result, we show that the min-max value for the area functional can be achieved by a …
New algorithm solves structured nonconvex-nonconcave min-max problems.
problem Min-max optimization challenges in deep learning.
method Generalized extragradient algorithm for structured nonconvex-nonconcave problems.
result Algorithm converges to stationary points in Euclidean and ℓp spaces. Paper proves finiteness and Morse index estimates for equivariant min-max hypersurfaces.
problem Existence and finiteness of G-invariant minimal hypersurfaces. method Equivariant min-max theory, compactness theorem, bumpy metrics theorem.
result Generalization of Morse index estimates to equivariant setting.
Optimizes solving complex min-max problems with stochastic and nonconvex elements.
problem Min-max problems with stochastic and nonconvex elements.
method Combines conic nonexpansiveness, refined inexact Halpern iteration, and multilevel Monte Carlo estimator.
result Optimal or best-known complexity guarantees for $ρ< rac{1}{L}$, improving previous results.
Motivated by applications in Optimization, Game Theory, and the training of Generative Adversarial Networks, the convergence properties of first order methods in min-max problems have received extensive study. It has been recognized that they may cycle, and there is no good understanding of their limit points when they…
New proof of Smale conjecture for RP^3 and lens spaces using min-max theory.
problem Proving the Smale conjecture for specific spaces.
method Minimal surfaces and min-max theory.
result New proof of Smale conjecture for RP3 and lens spaces. Paper tackles fast convergence for non-convex strongly-concave min-max problems.
problem Non-convex strongly-concave min-max problems in deep learning.
method Proximal stage-based method with PL condition for faster convergence.
result Established fast convergence in primal objective gap and duality gap.
The study finds a way to create minimal surfaces with specific shapes in 3-manifolds.
problem Creating minimal surfaces with prescribed genus in 3-manifolds with positive Ricci curvature.
method Develops a min-max theory and shows deformability of surfaces in a generic metric.
result Establishes a theorem for producing minimal surfaces with prescribed genus.
In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly concave in the variables of maximization. It has many important applications in mach…
Paper improves Morse index bound for hypersurfaces.
problem Improving Morse index bound for hypersurfaces.
method Construction of hierarchical deformations and restrictive min-max theory.
result Generalizes a result by X. Zhou for 3≤n+1≤7. Paper tackles multi-block min-max optimization with applications in deep AUC maximization.
problem Multi-block min-max bilevel optimization with non-convex strongly-concave upper level and strongly convex lower level.
method Single-loop randomized stochastic algorithm for constant number of blocks per iteration.
result Sample complexity of O(1/ε^4) for finding ε-stationary point, matching optimal complexity.
The paper explains how simple methods can converge to optimal solutions in complex neural games.
problem Finding optimal solutions in neural games with non-convex objectives.
method Theoretical framework using hidden convexity and overparameterization, with path-length bounds and PŁ conditions.
result Simple gradient methods can converge to Nash equilibria in non-convex min-max games under certain conditions.
Bound on equivariant index for min-max surfaces.
problem Bounding the index of equivariant min-max surfaces.
method Equivariant min-max procedure with group action.
result Equivariant index bound by number of parameters.
We prove that in a closed manifold of dimension between 3 and 7 with a bumpy metric, the min-max minimal hypersurfaces associated with the volume spectrum introduced by Gromov, Guth, Marques-Neves, are two-sided and have multiplicity one. This confirms a conjecture by Marques-Neves. We prove that in a bumpy metric each…
Survey of advances in non-convex min-max optimization for applications.
problem Finding optimal solutions in non-convex, non-concave min-max problems.
method Selective review of theoretical and algorithmic advances.
result Exciting recent advances in solving non-convex min-max problems.
Proves existence of special 2-spheres in curved 3-spaces.
problem Existence of constant mean curvature 2-spheres in Riemannian 3-spheres.
method Develops a min-max scheme for a weighted Dirichlet energy functional, using bi-harmonic approximation, derivative estimates, and Morse index estimates.
result Proves existence for almost every mean curvature and all for positively curved 3-spheres.
The study counts minimal surfaces in 3-manifolds with positive Ricci curvature.
problem Counting minimal surfaces in 3-manifolds with positive Ricci curvature.
method An enumerative min-max theorem linking surface counts to topological properties.
result Every 3-sphere of positive Ricci curvature contains at least 4 embedded minimal surfaces of genus 2.
Riemannian algorithms converge at Euclidean rates for geodesically convex-concave problems.
problem Min-max optimization on Riemannian manifolds.
method RCEG method and RGDA for geodesically strongly-convex-concave problems.
result RCEG achieves linear convergence rate in geodesically strongly-convex-concave cases.
Study confirms a 2-sphere metric with three geodesics of minimal length.
problem Understanding the systolic, width, and Gromov-Guth metrics on a 2-sphere.
method Classical min-max and hyperbolic geometry tools.
result Figure-eight geodesics achieve the systolic, width, and Gromov-Guth metrics on a 2-sphere.
Variational method for eigenvalues on manifolds.
problem Optimizing functionals involving eigenvalues of Riemannian manifolds.
method New Palais-Smale sequences and min-max methods for locally-Lipschitz functionals.
result Convergence of Palais-Smale sequences in Laplace and Steklov eigenvalues.
A novel feature selection method for SVM improves model accuracy and interpretability.
problem Feature selection in nonlinear SVM classification problems.
method Embedded min-max optimization problem, leveraging duality theory.
result Improves model accuracy and interpretability on benchmark data sets.
In this paper, we study the problem of constrained robust (min-max) optimization ina black-box setting, where the desired optimizer cannot access the gradients of the objective function but may query its values. We present a principled optimization framework, integrating a zeroth-order (ZO) gradient estimator with an a…
In this paper, we compare 5 different nonlinear kernels: min-max, RBF, fRBF (folded RBF), acos, and acos-χ2, on a wide range of publicly available datasets. The proposed fRBF kernel performs very similarly to the RBF kernel. Both RBF and fRBF kernels require an important tuning parameter (γ). Interestingly, for a …
We present a viscosity approach to the min-max construction of closed geodesics on compact Riemannian manifolds of arbitrary dimension. We also construct counter-examples in dimension 1 and 2 to the ε-regularity in the convergence procedure. Furthermore, we prove the lower semi-continuity of the index o…
In this paper, we study the shape of the min-max minimal hypersurface produced by Almgren-Pitts-Schoen-Simon \cite{AF62, AF65, P81, SS81} in a Riemannian manifold (Mn+1,g) of positive Ricci curvature for all dimensions. The min-max hypersurface has a singular set of Hausdorff codimension 7. We characterize the …
The study proves a generic multiplicity one theorem for G-invariant minimal hypersurfaces.
problem Proving a generic multiplicity one theorem for G-invariant minimal hypersurfaces. method Equivariant min-max theory and analysis of G-homology classes. result Shows a generic multiplicity one theorem for G-invariant minimal hypersurfaces. This research proves that two min-max theories for hypersurfaces are equivalent.
problem Comparing two min-max theories for hypersurfaces.
method Developed and proved the equivalence of Almgren-Pitts and Allen-Cahn min-max theories.
result The Almgren-Pitts widths and Allen-Cahn widths are equivalent.