Unified framework for gradient-free MDS improves efficiency and accuracy.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New stochastic gradient descent with random search directions improves efficiency and convergence.
New algorithms allow multiple robots to search efficiently without central coordination.
This paper provides a block coordinate descent algorithm to solve unconstrained optimization problems. In our algorithm, computation of function values or gradients is not required. Instead, pairwise comparison of function values is used. Our algorithm consists of two steps; one is the direction estimate step and the o…
New algorithm improves mean-variance optimization with finite-sample guarantees.
Isometry pursuit identifies orthonormal submatrices from wide matrices.
Optimal Coordinate Ascent (OCA) improves feature selection in machine learning.
No Shimura-Teichmüller curves found in genus 5.
Greedy coordinate descent achieves linear convergence for non-smooth composite problems.
Motivation: Cell-biological processes are regulated through a complex network of interactions between genes and their products. The processes, their activating conditions, and the associated transcriptional responses are often unknown. Organism-wide modeling of network activation can reveal unique and shared mechanisms…
In this paper, we propose a convergent parallel best-response algorithm with the exact line search for the nondifferentiable nonconvex sparsity-regularized rank minimization problem. On the one hand, it exhibits a faster convergence than subgradient algorithms and block coordinate descent algorithms. On the other hand,…
New adaptive stepsize method for stochastic approximation converges to target point.
Recently several methods were proposed for sparse optimization which make careful use of second-order information [10, 28, 16, 3] to improve local convergence rates. These methods construct a composite quadratic approximation using Hessian information, optimize this approximation using a first-order method, such as coo…
In this paper we study the fundamental problems of maximizing a continuous non-monotone submodular function over the hypercube, both with and without coordinate-wise concavity. This family of optimization problems has several applications in machine learning, economics, and communication systems. Our main result is the…
Ancestry improves genealogy search results by ranking diverse record types.
RGBM improves GBM efficiency with randomization.
New framework learns interpretable rule ensembles without sacrificing accuracy.
We propose a general technique for improving alternating optimization (AO) of nonconvex functions. Starting from the solution given by AO, we conduct another sequence of searches over subspaces that are both meaningful to the optimization problem at hand and different from those used by AO. To demonstrate the utility o…
New method selects sparse predictors in large LMMs.
This work investigates the training of conditional random fields (CRFs) via the stochastic dual coordinate ascent (SDCA) algorithm of Shalev-Shwartz and Zhang (2016). SDCA enjoys a linear convergence rate and a strong empirical performance for binary classification problems. However, it has never been used to train CRF…
A Lissajous knot is one that can be parameterized by a single cosine function in each coordinate. Lissajous knots are highly symmetric, and for this reason, not all knots are Lissajous. We prove several theorems which allow us to place bounds on the number of Lissajous knot types with given frequencies and to efficient…
New approach treats coordination as an architectural layer to improve LLM-based multi-agent systems.
Deep RL for uncoordinated cognitive radios finds near-optimal policies.
Generalized linear model with and regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the fields like text mining and clickstream data analysis parallelization and the us…
In this paper, we study two general classes of optimization algorithms for kernel methods with convex loss function and quadratic norm regularization, and analyze their convergence. The first approach, based on fixed-point iterations, is simple to implement and analyze, and can be easily parallelized. The second, based…
An attractive approach for fast search in image databases is binary hashing, where each high-dimensional, real-valued image is mapped onto a low-dimensional, binary vector and the search is done in this binary space. Finding the optimal hash function is difficult because it involves binary constraints, and most approac…
A new overlapping space solves the configuration search problem for graph embeddings.
Paper details Hilbert-curve for high-performance data mining.
MORBO improves multi-objective BO for high-dimensional problems.
Selective clustering annotated using modes of projections (SCAMP) is a new clustering algorithm for data in . SCAMP is motivated from the point of view of non-parametric mixture modeling. Rather than maximizing a classification likelihood to determine cluster assignments, SCAMP casts clustering as a searc…
Automatically searching for optimal hyperparameter configurations is of crucial importance for applying deep learning algorithms in practice. Recently, Bayesian optimization has been proposed for optimizing hyperparameters of various machine learning algorithms. Those methods adopt probabilistic surrogate models like G…
mlr3mbo is a modular R toolbox for Bayesian optimization.
KOLMOGOROV-OPTIMAL RESOLUTION ESTIMATION (KORE) solves spline regression without exhaustive search
Interesting theoretical associations have been established by recent papers between the fields of active learning and stochastic convex optimization due to the common role of feedback in sequential querying mechanisms. In this paper, we continue this thread in two parts by exploiting these relations for the first time …
The ABC algorithm's social interactions are characterized through a novel interaction network.
Cautious Weight Decay modifies weight decay for better optimization.
Paper introduces a structured prediction approach for multi-agent reinforcement learning.
This paper is a sequel of arxiv:1709.09045 and deals with privileged coordinates and nilpotent approximation of Carnot manifolds. By a Carnot manifold it is meant a manifold equipped with a filtration by subbundles of the tangent bundle which is compatible with the Lie bracket of vector fields. In this paper, we single…
Coordinate descent methods usually minimize a cost function by updating a random decision variable (corresponding to one coordinate) at a time. Ideally, we would update the decision variable that yields the largest decrease in the cost function. However, finding this coordinate would require checking all of them, which…
PLOT uses optimal transport to find neural site handles for causal abstraction.
This work bridges theory and practice in spiking reservoirs, identifying robust parameter ranges.
New findings on Kähler manifolds restrict orthogonal coordinates existence.
Defines Fenchel-Nielsen coordinates for SL(3,C) representations.
Submanifolds of coordinate finite-type were introduced in HV1. A submanifold of a Euclidean space is called a coordinate finite-type submanifold if its coordinate functions are eigenfunctions of Δ. In the present study we consider coordinate finite-type surfaces in E^4. We give necessary and sufficient conditions for g…
In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise control policies for individual stages of the process might not be applicable, and in…
We consider complex Fenchel-Nielsen coordinates on the quasi-Fuchsian space of punctured tori. These coordinates arise from a generalisation of Kra's plumbing construction and are related to earthquakes on Teichmueller space. They also allow us to interpolate between two coordinate systems on Teichmueller space, namely…
Dynnikov system maps Teichmüller space boundary, aiding pseudo-Anosov braid study.
Method constructs orthogonal curvilinear coordinates in constant curvature spaces.