Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

79157236314 · Jun 202019922001200920172026
48 results for minimax solution

Minimax optimization plays a key role in adversarial training of machine learning algorithms, such as learning generative models, domain adaptation, privacy preservation, and robust learning. In this paper, we demonstrate the failure of alternating gradient descent in minimax optimization problems due to the discontinu…

2018-05-29abs ↗pdf ↗

New fairness concept extends minimax fairness to lexicographic fairness.

problem Fairness in supervised learning, especially lexicographic fairness.
method Introduced approximate lexifairness, derived algorithms for finding solutions, and proved generalization bounds.
result Proved that approximate lexifairness on training data implies approximate lexifairness on true distribution.

A new algorithm solves minimax problems without needing parameters.

problem Convex-concave minimax optimization problems in machine learning.
method Proposes a fully parameter-free LF-CR and FF-CR algorithms for solving these problems.
result The FF-CR algorithm achieves the best iteration complexity under gradient norm termination criterion.

Paper finds solutions to a complex equation on surfaces with boundary conditions.

problem Existence of solutions to a super-Liouville equation on compact Riemannian surfaces with boundary.
method Introduced a weighted Dirac operator and constructed a Nehari manifold to show existence of non-trivial solutions.
result Existence of non-trivial solutions to the super-Liouville equation.

Optimal multistage method solves noisy minimax problems.

problem Minimizing/maximizing in noisy conditions with smooth and strongly convex-strongly concave settings.
method Multistage Stochastic Gradient Descent Ascent (M-GDA) and Optimistic Gradient Descent Ascent (M-OGDA).
result Achieves optimal linear decay rate with respect to initial error and condition number.

New findings suggest minimax optimality doesn't guarantee distribution learning for GANs.

problem Understanding when GANs can truly learn the underlying distribution.
method Using cryptographic assumptions and ReLU network generators, the paper shows that achieving minimax optimality is insufficient for distribution learning.
result Achieving minimax optimality is insufficient for distribution learning in the usual statistical sense.

Paper proposes SMO for solving bilevel optimization problems efficiently.

problem Solving bilevel optimization problems with nonsmooth convex lower-level and nonconvex upper-level objectives.
method Sequential minimax optimization (SMO) method using modified augmented Lagrangian and penalty schemes.
result Improves operation complexity for finding ε\varepsilon-KKT solutions.

Paper explores generalization of minimax learners, proposing a new metric.

problem Understanding how minimax learners perform on unseen data.
method Proposes a new metric, the primal gap, to study generalization of minimax learners.
result Derives generalization error bounds for the primal gap in nonconvex-concave settings.

Paper tackles bilevel optimization problems using penalty methods.

problem Unconstrained and constrained bilevel optimization problems with nonsmooth lower levels.
method Introduces first-order penalty methods and O(ε4logε1)O(\varepsilon^{-4}\log\varepsilon^{-1}) and O(ε7logε1)O(\varepsilon^{-7}\log\varepsilon^{-1}) operation complexities.
result Establishes operation complexities for finding ε\varepsilon-KKT solutions.

VRPG algorithm optimizes convex constraints with non-asymptotic guarantees.

problem Stochastic convex optimization under convex constraints.
method Natural variance reduced proximal gradient (VRPG) algorithm.
result VRPG achieves local minimax lower bound up to constants and log factor of NN.

This paper tackles convex-submodular minimax problems in mixed continuous-discrete domains.

problem Convex-submodular minimax problems in mixed continuous-discrete domains.
method Introduces new notions of optimality and proposes iterative algorithms combining discrete and continuous optimization.
result Characterizes convergence rates, computational complexity, and quality of solutions for convex and monotone-submodular minimax problems.

The paper tackles individualized decision-making under unmeasured confounding, providing a novel minimax solution and a paradox.

problem Unmeasured confounding in causal inference leads to biased estimates and affects individualized decision-making.
method The authors establish a formal link between individualized decision-making under partial identification and classical decision theory, providing a minimax solution and a paradox.
result A novel minimax solution for individualized decision-making/policy assignment is provided, and an interesting paradox is drawn.

Bayesian PINNs learn elliptic PDEs with near-minimax posterior contraction rate.

problem Learning elliptic PDEs with noisy data and non-homogeneous boundary conditions.
method Bayesian approach with a Hölder space prior on neural network weights.
result Posterior contracts at near-minimax rate without prior knowledge of solution smoothness.

This study improves estimation of the first principal component in multivariate functional data.

problem Estimating the first principal component of multivariate random processes.
method Defined covariance functions and operators, introduced LASSO optimization, and established minimax lower bounds.
result The method provides an optimal variance in the minimax sense for estimating eigenelements.

This paper analyzes neural networks for solving complex optimization problems.

problem Minimax optimization problems in infinite-dimensional function spaces.
method Mean-field analysis of stochastic gradient descent-ascent in neural networks.
result The algorithm converges to a stationary point at a sublinear rate.

SDP achieves optimal error in noisy phase synchronization.

problem Phase synchronization with noisy measurements.
method SDP relaxation of Maximum Likelihood Estimation (MLE).
result Achieves error bound of (1+o(1))σ22np(1+o(1))\frac{σ^2}{2np} under normalized squared 2\ell_2 loss, matching minimax lower bound.

Adversarial representation learning is a promising paradigm for obtaining data representations that are invariant to certain sensitive attributes while retaining the information necessary for predicting target attributes. Existing approaches solve this problem through iterative adversarial minimax optimization and lack…

2019-10-16abs ↗pdf ↗

Study on clustering in high dimensions with anisotropic Gaussian mixtures, showing interpolation can be optimal and robust.

problem Clustering in high-dimensional anisotropic Gaussian mixtures.
method Derive minimax bounds, analyze 2\ell_2-regularized classifiers, and investigate interpolation's robustness.
result Interpolating solutions can be optimal and robust under certain conditions.

Extends robust methods for causal inference, improving estimator performance.

problem Estimating causal effects in the presence of latent confounders.
method Minimax kernel machine learning for doubly robust functionals.
result Proposed method leads to robust and high-performance estimators.

New method avoids IV limitations for flexible estimation.

problem Nonparametric estimation of IV regressions with multiple solutions.
method Minimax penalized estimator avoiding identification and closedness conditions.
result Strong L2L_2 convergence rate without closedness condition.

Two new algorithms solve nonconvex-strongly concave problems efficiently.

problem Solving nonconvex-strongly concave minimax problems.
method Proposed MINIMAX-TR and MINIMAX-TRACE algorithms.
result Find (ε,ε)(ε, \sqrtε)-second order stationary points within O(ε1.5)\mathcal{O}(ε^{-1.5}) iterations.

New approach transfers rewards learned in one environment to reinforcement learning in a new environment.

problem Transfer of rewards learned using inverse reinforcement learning from one environment to a new, different environment.
method Formulate the problem as a joint system of Bellman equations, develop minimax estimators for the target soft-qq-function, solve the source and target system of equations jointly.
result The coupled approach removes the first-order influence of source Bellman residual error compared to the sequential approach.

A novel decentralized algorithm improves minimax optimization in federated learning.

problem Minimax optimization in federated learning with data heterogeneity.
method Decentralized Gradient Tracking (K-GT-Minimax) for nonconvex-strongly-concave optimization.
result Demonstrates superior convergence rate for NC-SC minimax optimization.

We investigate the use of Minimax distances to extract in a nonparametric way the features that capture the unknown underlying patterns and structures in the data. We develop a general-purpose and computationally efficient framework to employ Minimax distances with many machine learning methods that perform on numerica…

2019-04-27abs ↗pdf ↗

We present a new machine learning approach to estimate personalized treatment effects in the classical potential outcomes framework with binary outcomes. To overcome the problem that both treatment and control outcomes for the same unit are required for supervised learning, we propose surrogate loss functions that inco…

2018-03-10abs ↗pdf ↗

Many tasks in modern machine learning can be formulated as finding equilibria in \emph{sequential} games. In particular, two-player zero-sum sequential games, also known as minimax optimization, have received growing interest. It is tempting to apply gradient descent to solve minimax optimization given its popularity a…

2019-10-16abs ↗pdf ↗

Kernel method improves instrumental variable regression rates.

problem Nonparametric instrumental variable regression with weak instruments.
method Kernel-based two-stage least-squares method, strong L2L_2 convergence analysis.
result Minimax optimal rates for instrumental regression under standard assumptions.

We develop a worst-case analysis of aggregation of classifier ensembles for binary classification. The task of predicting to minimize error is formulated as a game played over a given set of unlabeled data (a transductive setting), where prior label information is encoded as constraints on the game. The minimax solutio…

2015-03-05abs ↗pdf ↗

Paper proposes an algorithm to solve complex minimax problems efficiently.

problem Stochastic nonconvex-concave minimax problems in various fields.
method Accelerated first-order regularized momentum descent ascent algorithm (FORMDA).
result Achieves best-known complexity bound of ildeO(ε6.5) ilde{\mathcal{O}}(\varepsilon ^{-6.5}) for single-loop algorithms.

A new decentralized method solves minimax problems with reduced communication and sample complexity.

problem Solving minimax optimization problems in a distributed setting.
method Decentralized stochastic gradient descent ascent with variance reduction.
result Achieved optimal sample and communication complexities for nonconvex-strongly-concave problems.