Study introduces statistical mechanics for min-max problems.
problem Understanding the properties of min-max problems in high dimensions.
method Statistical mechanical formalism for analyzing min-max problems.
result Derives the relationship between training data and generalization error.
Adaptive momentum method solves non-convex min-max problems.
problem Non-convex min-max optimization problems in training generative adversarial networks.
method Proposes an adaptive momentum algorithm for non-convex min-max optimization.
result Establishes non-asymptotic convergence rates for the proposed algorithm.
We reformulate LIPs as min-max problems for easier solution.
problem Recovering signals from few linear measurements.
method Proposed a min-max reformulation of LIPs.
result Saddle points characterize solutions to LIPs.
Survey of advances in non-convex min-max optimization for applications.
problem Finding optimal solutions in non-convex, non-concave min-max problems.
method Selective review of theoretical and algorithmic advances.
result Exciting recent advances in solving non-convex min-max problems.
Proposes active sampling for improving fairness in machine learning.
problem Improving fairness in machine learning models, especially for disadvantaged groups.
method Simple active sampling and reweighting strategies for min-max fairness.
result Proves the rate of convergence to a min-max fair solution for convex problems.
Improved online learning for fuzzy min-max neural networks.
problem Classification performance issues due to expansion and contraction steps.
method Proposes an improved online learning algorithm without contraction for overlapping hyperboxes.
result Significant improvement in classification accuracy and stability.
Study shows fast rates for inverse reinforcement learning with linear rewards.
problem Entropy-regularized min-max inverse reinforcement learning in finite-horizon MDPs.
method Structural and statistical analysis of Min-Max-IRL with pseudo-self-concordance.
result Both trajectory-level KL divergence and parameter error decay at O(n−1). Bayesian optimization methods improved for min max optimization problems.
problem Min-max optimization for unknown functions.
method Extended Bayesian optimization to min-max problems with new acquisition functions.
result Improved acquisition functions lead to better solutions.
New Gaussian min-max theorem extends classical results to non-i.i.d. Gaussian matrices.
problem Extending classical Gaussian min-max theorems to non-i.i.d. Gaussian matrices.
method Identifying a new pair of Gaussian processes that satisfy comparison inequalities.
result New Gaussian min-max and convex Gaussian min-max theorems with applications in multi-source Gaussian regression and binary classification.
General fuzzy min-max (GFMM) neural network is a generalization of fuzzy neural networks formed by hyperbox fuzzy sets for classification and clustering problems. Two principle algorithms are deployed to train this type of neural network, i.e., incremental learning and agglomerative learning. This paper presents a comp…
Study shows strong min-max principle for phase transitions.
problem Understanding nodal sets near minimal hypersurfaces.
method Analogous to White's principle, applies to Allen-Cahn energy.
result Strong min-max principle for phase transitions.
Equity-Transformer solves NP-hard min-max routing problems efficiently.
problem Min-max routing problems with multiple agents and large-scale applications.
method Sequential planning approach with Transformer and equitable workload distribution inductive biases.
result Significant runtime and cost reductions in min-max mTSP and min-max mPDP tasks.
Upper bound for Morse index of min-max varifolds.
problem Bounding Morse index of varifolds.
method Proving upper bound for Morse index of min-max stationary integral varifolds.
result Upper bound for Morse index of min-max stationary integral varifolds.
Localized min-max method proves minimal hypersurface existence.
problem Existence of minimal hypersurfaces in complete manifolds.
method Localized min-max approach to prove existence.
result Existence of complete embedded minimal hypersurface with index at most one.
The paper solves min-max widths on a 3-sphere and strengthens multiplicity theorems.
problem Which min-max widths of the unit 3-sphere lie between 2π2 and 8π? method Homological min-max theory and stronger versions of multiplicity one theorems.
result Proves the 10th to 13th min-max widths of the unit 3-sphere lie between 2π2 and 8π. Optimizes solving complex min-max problems with stochastic and nonconvex elements.
problem Min-max problems with stochastic and nonconvex elements.
method Combines conic nonexpansiveness, refined inexact Halpern iteration, and multilevel Monte Carlo estimator.
result Optimal or best-known complexity guarantees for $ρ< rac{1}{L}$, improving previous results.
Paper proves finiteness and Morse index estimates for equivariant min-max hypersurfaces.
problem Existence and finiteness of G-invariant minimal hypersurfaces. method Equivariant min-max theory, compactness theorem, bumpy metrics theorem.
result Generalization of Morse index estimates to equivariant setting.
New proof of Smale conjecture for RP^3 and lens spaces using min-max theory.
problem Proving the Smale conjecture for specific spaces.
method Minimal surfaces and min-max theory.
result New proof of Smale conjecture for RP3 and lens spaces. New algorithms improve DRSL for large-scale problems.
problem Distributionally robust learning for real-world applications.
method Variance-reduced stochastic extra-gradient algorithms for min-max optimization.
result Provable faster convergence rates than existing approaches.
Paper improves Morse index bound for hypersurfaces.
problem Improving Morse index bound for hypersurfaces.
method Construction of hierarchical deformations and restrictive min-max theory.
result Generalizes a result by X. Zhou for 3≤n+1≤7. Paper tackles fast convergence for non-convex strongly-concave min-max problems.
problem Non-convex strongly-concave min-max problems in deep learning.
method Proximal stage-based method with PL condition for faster convergence.
result Established fast convergence in primal objective gap and duality gap.
New methods solve min-max problems on manifolds using Riemannian Hamiltonians.
problem Min-max optimization on Riemannian manifolds.
method Riemannian Hamiltonian methods (RHM) to minimize the Hamiltonian function.
result RHM leads to correct search directions and global optimality in min-max problems.
Bound on equivariant index for min-max surfaces.
problem Bounding the index of equivariant min-max surfaces.
method Equivariant min-max procedure with group action.
result Equivariant index bound by number of parameters.
We prove that in a closed manifold of dimension between 3 and 7 with a bumpy metric, the min-max minimal hypersurfaces associated with the volume spectrum introduced by Gromov, Guth, Marques-Neves, are two-sided and have multiplicity one. This confirms a conjecture by Marques-Neves. We prove that in a bumpy metric each…
We consider the problem of two-player zero-sum games. This problem is formulated as a min-max Markov game in the literature. The solution of this game, which is the min-max payoff, starting from a given state is called the min-max value of the state. In this work, we compute the solution of the two-player zero-sum game…
The paper tackles robust statistical methods using Wasserstein DRO formulations.
problem Distributional uncertainty in learning from limited samples.
method Min-max distributionally robust optimization with Wasserstein DRO formulations.
result Error bounds free from the curse of dimensionality.
In this paper, we study the problem of constrained robust (min-max) optimization ina black-box setting, where the desired optimizer cannot access the gradients of the objective function but may query its values. We present a principled optimization framework, integrating a zeroth-order (ZO) gradient estimator with an a…
Epoch-GDA achieves optimal convergence rate for SCSC min-max problems.
problem Solving stochastic min-max problems with strong convexity and strong concavity.
method Epoch-wise stochastic gradient descent ascent method (Epoch-GDA) without additional assumptions.
result Achieves the optimal rate of O(1/T) for the duality gap of general SCSC min-max problems. The paper bounds the min-max width of embedded circles on spheres and manifolds.
problem Bounding the min-max width of embedded circles on spheres and manifolds.
method Inducing a sweepout by pairs of points in embedded circles from a given sweepout of the sphere by closed curves.
result Lower bounds for the Birkhoff min-max invariant of a Riemannian sphere in terms of the min-max width of its embedded circles.
Study confirms a 2-sphere metric with three geodesics of minimal length.
problem Understanding the systolic, width, and Gromov-Guth metrics on a 2-sphere.
method Classical min-max and hyperbolic geometry tools.
result Figure-eight geodesics achieve the systolic, width, and Gromov-Guth metrics on a 2-sphere.
In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly concave in the variables of maximization. It has many important applications in mach…
Paper tackles multi-block min-max optimization with applications in deep AUC maximization.
problem Multi-block min-max bilevel optimization with non-convex strongly-concave upper level and strongly convex lower level.
method Single-loop randomized stochastic algorithm for constant number of blocks per iteration.
result Sample complexity of O(1/ε^4) for finding ε-stationary point, matching optimal complexity.
Develops robust learning methods for datasets with sub-populations.
problem Robust performance and generalization to unseen testing populations in datasets with sub-populations.
method Min-max-regret (MMR) formulation for distribution-free robust hierarchical model.
result Empirical MMR enjoys regret guarantees on training and unseen testing populations.
In this paper, we study the shape of the min-max minimal hypersurface produced by Almgren-Pitts-Schoen-Simon \cite{AF62, AF65, P81, SS81} in a Riemannian manifold (Mn+1,g) of positive Ricci curvature for all dimensions. The min-max hypersurface has a singular set of Hausdorff codimension 7. We characterize the …
Proposes an efficient alternative to nonconvex-nonconcave min-max optimization.
problem Min-max optimization challenges in nonconvex-nonconcave settings.
method Introduces ε-greedy adversarial equilibrium model and proves its existence.
result Existence of ε-greedy adversarial equilibrium for smooth bounded functions.
The worst-case training principle that minimizes the maximal adversarial loss, also known as adversarial training (AT), has shown to be a state-of-the-art approach for enhancing adversarial robustness. Nevertheless, min-max optimization beyond the purpose of AT has not been rigorously explored in the adversarial contex…
The study proves a generic multiplicity one theorem for G-invariant minimal hypersurfaces.
problem Proving a generic multiplicity one theorem for G-invariant minimal hypersurfaces. method Equivariant min-max theory and analysis of G-homology classes. result Shows a generic multiplicity one theorem for G-invariant minimal hypersurfaces. Constructs cmc doublings of minimal surfaces via min-max theory.
problem Construct cmc doublings of minimal surfaces.
method Uses min-max theory and catenoid estimate.
result Constructs ε-cmc doublings of Σ for small ε > 0.
This research proves that two min-max theories for hypersurfaces are equivalent.
problem Comparing two min-max theories for hypersurfaces.
method Developed and proved the equivalence of Almgren-Pitts and Allen-Cahn min-max theories.
result The Almgren-Pitts widths and Allen-Cahn widths are equivalent.
Motivated by applications in Game Theory, Optimization, and Generative Adversarial Networks, recent work of Daskalakis et al \cite{DISZ17} and follow-up work of Liang and Stokes \cite{LiangS18} have established that a variant of the widely used Gradient Descent/Ascent procedure, called "Optimistic Gradient Descent/Asce…
This study reveals a Min-Max property in LeNet's convolutional layers, enhancing adversarial robustness.
problem Uncertainty in the connection weights of convolutional layers in neural networks.
method Demonstrates the Min-Max property through back propagation-based training and a simplified convolution formulation.
result The Min-Max property improves adversarial robustness, indicating a stronger uncertainty in the model parameters.
New algorithm solves non-convex, non-differentiable min-max games.
problem Limited theoretical understanding of non-smooth min-max games.
method Proximal gradient descent-ascent algorithm for convex-strongly convex games.
result Algorithm converges to ε-Nash equilibrium with polynomial gradient evaluations.
Generic density of equivariant min-max hypersurfaces in Riemannian manifolds.
problem Finding generic density of equivariant min-max hypersurfaces in Riemannian manifolds.
method Weyl asymptotic law for G-equivariant volume spectrum, generic density result. result Generic density of equivariant min-max hypersurfaces in Riemannian manifolds.
We characterize the Zoll Riemannian metrics on a given simply connected spin closed manifold as those Riemannian metrics for which two suitable min-max values in a finite dimensional loop space coincide. We also show that on odd dimensional Riemannian spheres, when certain pairs of min-max values in the loop space coin…
New geometric invariant from min-max width of spheres on Riemannian 2-spheres.
problem Understanding the min-max width of spheres associated to distance functions.
method Application of min-max methods to pairs of points on Riemannian 2-spheres.
result The min-max width does not always equal half the length of a simple closed geodesic.
Given a Riemannian manifold and a closed submanifold, we find a geodesic segment with free boundary on the given submanifold. This is a corollary of the min-max theory which we develop in this article for the free boundary variational problem. In particular, we develop a modified Birkhoff curve shortening process to ac…
Anisotropic min-max theory constructs stable minimal surfaces in 3-manifolds.
problem Constructing stable anisotropic minimal surfaces in 3-manifolds.
method Anisotropic min-max theory, removable singularity theorems.
result Constructs stable anisotropic minimal surfaces in 3-manifolds without singularities.
In this paper, we develop a min-max theory for the construction of constant mean curvature (CMC) hypersurfaces of prescribed mean curvature in an arbitrary closed manifold. As a corollary, we prove the existence of a nontrivial, smooth, closed, almost embedded, CMC hypersurface of any given mean curvature c. Moreover…