Three algorithms improve starting solutions for clustering problems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Efficient algorithms find solutions in a rare well-connected cluster at low constraint densities.
We consider a class of finite Markov moment problems with arbitrary number of positive and negative branches. We show criteria for the existence and uniqueness of solutions, and we characterize in detail the non-unique solution families. Moreover, we present a constructive algorithm to solve the moment problems numeric…
Paper corrects GIRP algorithm to ensure isotonic models.
In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study, instead of the single optimal solution, we consider finding a set of diverse yet nea…
In this paper we introduce an algorithm to determine the equivalence of five dimensional spacetimes, which generalizes the Karlhede algorithm for four dimensional general relativity. As an alternative to the Petrov type classification, we employ the alignment classification to algebraically classify the Weyl tensor. To…
New algorithmic view of ℓ2 regularization using ODEs and path-following methods.
Developed a simulation method for 3/2 stochastic volatility model.
Minimax optimization plays a key role in adversarial training of machine learning algorithms, such as learning generative models, domain adaptation, privacy preservation, and robust learning. In this paper, we demonstrate the failure of alternating gradient descent in minimax optimization problems due to the discontinu…
Pareto MTL finds optimal solutions for multiple tasks with different trade-offs.
The FastICA algorithm is one of the most popular iterative algorithms in the domain of linear independent component analysis. Despite its success, it is observed that FastICA occasionally yields outcomes that do not correspond to any true solutions (known as demixing vectors) of the ICA problem. These outcomes are comm…
Simple DP algorithms find approximate solutions for nonconvex ERM.
New algorithm reduces communication in distributed eigenspace estimation.
This paper concerns a fundamental class of convex matrix optimization problems. It presents the first algorithm that uses optimal storage and provably computes a low-rank approximation of a solution. In particular, when all solutions have low rank, the algorithm converges to a solution. This algorithm, SketchyCGM, modi…
Improved iterative hard thresholding for faster, sparser solutions.
Paper presents a randomized algorithm for SPCA with high probability approximation.
NHC learns scalable algorithmic solutions from diverse tasks.
This paper is devoted to the prediction of solutions to a stochastic discrete optimization problem. Through an application, we illustrate how we can use a state-of-the-art neural machine translation (NMT) algorithm to predict the solutions by defining appropriate vocabularies, syntaxes and constraints. We attend to app…
AgABC improves ABC algorithm by balancing exploration and exploitation.
Modified K-means ensures local optimality with same complexity.
Paper proposes efficient algorithms for bandit problems with costly sampling.
Algorithm ensures privacy while strictly adhering to constraints.
New dual formulation reduces generalization error for ERM-fDR.
The paper proposes a technique to speed up evolutionary algorithms by using lower-cost approximations of the objective function.
Study finds methods to learn multiple solutions from single task in offline RL.
Improved Sinkhorn algorithm for UOT with near-linear complexity.
Two sweeps of the Brennan-Schwartz algorithm solve American options under negative rates.
We construct the solution to the periodic Cauchy problem of the Schrödinger flow on the sphere. Such construction of solutions is formulated explicitly and therefore a geometric algorithm of solving this periodic Cauchy problem follows. Theoretical and experimental results will be discussed.
Combines k-means and hill climbing for stratification and allocation.
In this paper is proposed a new heuristic approach belonging to the field of evolutionary Estimation of Distribution Algorithms (EDAs). EDAs builds a probability model and a set of solutions is sampled from the model which characterizes the distribution of such solutions. The main framework of the proposed method is an…
Reweighted l1-algorithms have attracted a lot of attention in the field of applied mathematics. A unified framework of such algorithms has been recently proposed by Zhao and Li. In this paper we construct a few new examples of reweighted l1-methods. These functions are certain concave approximations of the l0-norm func…
The paper analyzes the generalization performance of spectral clustering algorithms and proposes new methods to improve their effectiveness.
Typically clustering algorithms provide clustering solutions with prespecified number of clusters. The lack of a priori knowledge on the true number of underlying clusters in the dataset makes it important to have a metric to compare the clustering solutions with different number of clusters. This article quantifies a …
A new method for 3D surface registration using dynamic programming.
The convergence of many reinforcement learning (RL) algorithms with linear function approximation has been investigated extensively but most proofs assume that these methods converge to a unique solution. In this paper, we provide a complete characterization of non-uniqueness issues for a large class of reinforcement l…
New algorithm reduces robust optimization scale for better constraint satisfaction.
Approximate algorithms for structured prediction problems---such as LP relaxations and the popular alpha-expansion algorithm (Boykov et al. 2001)---typically far exceed their theoretical performance guarantees on real-world instances. These algorithms often find solutions that are very close to optimal. The goal of thi…
Deep learning approximates SPDE solutions from noise trajectories.
A key feature of intelligent behavior is the ability to learn abstract strategies that transfer to unfamiliar problems. Therefore, we present a novel architecture, based on memory-augmented networks, that is inspired by the von Neumann and Harvard architectures of modern computers. This architecture enables the learnin…
Neural model with parameterized algorithms improves graph CO problem solving.
The paper proposes an efficient algorithm for solving Schatten- quasi-norm problems.
In the NIPS 2017 Learning to Run challenge, participants were tasked with building a controller for a musculoskeletal model to make it run as fast as possible through an obstacle course. Top participants were invited to describe their algorithms. In this work, we present eight solutions that used deep reinforcement lea…
This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new guarantees that hold in the case where the conditional probabilities for the sour…
Over the course of the past decade, a variety of randomized algorithms have been proposed for computing approximate least-squares (LS) solutions in large-scale settings. A longstanding practical issue is that, for any given input, the user rarely knows the actual error of an approximate solution (relative to the exact …
One-bit measurements widely exist in the real world, and they can be used to recover sparse signals. This task is known as the problem of learning halfspaces in learning theory and one-bit compressive sensing (1bit-CS) in signal processing. In this paper, we propose novel algorithms based on both convex and nonconvex s…
A new algorithm for solving constrained convex optimization problems efficiently.
We develop several deep learning algorithms for approximating families of parametric PDE solutions. The proposed algorithms approximate solutions together with their gradients, which in the context of mathematical finance means that the derivative prices and hedging strategies are computed simulatenously. Having approx…
Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known EM algorithm, their application to high-dimensional problems is still therefore c…