Study optimizes sampling to avoid extreme tail risks in unknown heavy-tailed distributions.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Optimized concentric helices minimize the ropelength of non-alternating torus knots.
Alternative proof of Michael-Simon-Sobolev inequality using optimal transport.
Investigates optimal consumption and investment using alternative data sources.
We propose a method for finding alternate features missing in the Lasso optimal solution. In ordinary Lasso problem, one global optimum is obtained and the resulting features are interpreted as task-relevant features. However, this can overlook possibly relevant features not selected by the Lasso. With the proposed met…
Alt-GDA outperforms Sim-GDA in minimax games with near-optimal local convergence.
A meta-learning approach improves the performance of alternating minimization for non-convex optimization problems.
TSSM splits neural networks for parallel training with minimal accuracy loss.
Alternative method improves SVM for data classification.
Stochastic algorithm achieves sublinear convergence for bi-objective optimization.
Nonparametric tests via kernel embedding of distributions have witnessed a great deal of practical successes in recent years. However, statistical properties of these tests are largely unknown beyond consistency against a fixed alternative. To fill in this void, we study here the asymptotic properties of goodness-of-fi…
Proposes an efficient alternative to nonconvex-nonconcave min-max optimization.
Flexible framework for CMTF with ADMM for various constraints and couplings.
The use of alternative measures to evaluate classifier performance is gaining attention, specially for imbalanced problems. However, the use of these measures in the classifier design process is still unsolved. In this work we propose a classifier designed specifically to optimize one of these alternative measures, nam…
Chirality affects the curvature of molecular networks, influencing their shape and stability.
Many machine learning problems involve iteratively and alternately optimizing different task objectives with respect to different sets of parameters. Appropriately scheduling the optimization of a task objective or a set of parameters is usually crucial to the quality of convergence. In this paper, we present AutoLoss,…
Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is an iterative scheme born from the adaptation of proximal point algorithm to nois…
Matrix Factorization is a popular non-convex optimization problem, for which alternating minimization schemes are mostly used. They usually suffer from the major drawback that the solution is biased towards one of the optimization variables. A remedy is non-alternating schemes. However, due to a lack of Lipschitz conti…
Introduces a new geometric method for optimal experimental design.
Paper proposes an algorithm for PARAFAC2-based CMTF models with various constraints.
Games generalize the single-objective optimization paradigm by introducing different objective functions for different players. Differentiable games often proceed by simultaneous or alternating gradient updates. In machine learning, games are gaining new importance through formulations like generative adversarial netwo…
This paper presents a model to describe contractual dispute resolution by mediation in situations where a defaulting supplier is near insolvent. While each party has internal constraints, and if alternate performances are available, such as more costly alternative goods, the proposed approach allows the mediator to fin…
The (global) Lipschitz smoothness condition is crucial in establishing the convergence theory for most optimization methods. Unfortunately, most machine learning and signal processing problems are not Lipschitz smooth. This motivates us to generalize the concept of Lipschitz smoothness condition to the relative smoothn…
Paper formulates mutual information optimal control for discrete-time systems.
Chandrasekaran, Parrilo and Willsky (2010) proposed a convex optimization problem to characterize graphical model selection in the presence of unobserved variables. This convex optimization problem aims to estimate an inverse covariance matrix that can be decomposed into a sparse matrix minus a low-rank matrix from sam…
Paper develops efficient AltMin algorithm for SRPCP robust matrix recovery.
Quasi-alternating links of determinant 1, 2, 3, and 5 were previously classified by Greene and Teragaito, who showed that the only such links are two-bridge. In this paper, we extend this result by showing that all quasi-alternating links of determinant at most 7 are connected sums of two-bridge links, which is optimal…
Paper tackles risk-sensitive decision-making under uncertainty.
We present an objective function for learning with unlabeled data that utilizes auxiliary expectation constraints. We optimize this objective function using a procedure that alternates between information and moment projections. Our method provides an alternate interpretation of the posterior regularization framework (…
Paper tackles efficient SGD methods for constrained bilevel optimization.
We propose two new alternating direction methods to solve "fully" nonsmooth constrained convex problems. Our algorithms have the best known worst-case iteration-complexity guarantee under mild assumptions for both the objective residual and feasibility gap. Through theoretical analysis, we show how to update all the al…
Understanding the evolution of human society, as a complex adaptive system, is a task that has been looked upon from various angles. In this paper, we simulate an agent-based model with a high enough population tractably. To do this, we characterize an entity called \textit{society}, which helps us reduce the complexit…
We study the global convergence of generative adversarial imitation learning for linear quadratic regulators, which is posed as minimax optimization. To address the challenges arising from non-convex-concave geometry, we analyze the alternating gradient algorithm and establish its Q-linear rate of convergence to a uniq…
Consider the optimal dividend problem for an insurance company whose uncontrolled surplus precess evolves as a spectrally negative Levy process. We assume that dividends are paid to the shareholders according to admissible strategies whose dividend rate is bounded by a constant. The objective is to find a dividend poli…
A new framework tackles CASH problem with alternating optimization and Rising Bandits.
We analyze the performance of alternating minimization for loss functions optimized over two variables, where each variable may be restricted to lie in some potentially nonconvex constraint set. This type of setting arises naturally in high-dimensional statistics and signal processing, where the variables often reflect…
New method recovers matrices with nonlinear structures using optimization on Grassmann manifold.
We give an alternative proof for the fact that in -dimensional Alexandrov spaces with curvature bounded below there exists a unique optimal transport plan from any purely -unrectifiable starting measure, and that this plan is induced by an optimal map.
Derives FACT, an alternative to NFA for neural networks, explaining feature learning.
Proposes a partitioned least squares model for feature grouping.
LCBO tackles constrained optimization in high dimensions, offering a polynomial convergence rate.
Recently, Andrews and Clutterbuck [AC13] gave a new proof of the optimal lower eigenvalue bound on manifolds via modulus of continuity for solutions of the heat equation. In this short note, we give an alternative proof of Theorem 2 in [AC13]. More precisely, following Ni's method ([Ni13, Section 6]) we give an ellipti…
AGD converges in polynomial iterations to optimal matrix factorization.
New algorithms improve convergence of minimax optimization.
We present DANTE, a novel method for training neural networks using the alternating minimization principle. DANTE provides an alternate perspective to traditional gradient-based backpropagation techniques commonly used to train deep networks. It utilizes an adaptation of quasi-convexity to cast training a neural networ…
We propose a general technique for improving alternating optimization (AO) of nonconvex functions. Starting from the solution given by AO, we conduct another sequence of searches over subspaces that are both meaningful to the optimization problem at hand and different from those used by AO. To demonstrate the utility o…
The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an alternating manner, in which a gradient step is taken on one block, while keeping the …
A/B testing refers to the task of determining the best option among two alternatives that yield random outcomes. We provide distribution-dependent lower bounds for the performance of A/B testing that improve over the results currently available both in the fixed-confidence (or delta-PAC) and fixed-budget settings. When…