Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3597191,0781,437 · Jun 202019922001200920172026
48 results for consensus based optimization

A new algorithm reduces communication in decentralized optimization.

problem Reducing communication in decentralized optimization problems.
method Adaptive randomized communication-efficient algorithmic framework that periodically tracks disagreement error and selects influential edges for communication.
result Strong theoretical convergence guarantees and performance quantification under standard assumptions.

In distributed machine learning, where agents collaboratively learn from diverse private data sets, there is a fundamental tension between consensus and optimality. In this paper, we build on recent algorithmic progresses in distributed deep learning to explore various consensus-optimality trade-offs over a fixed commu…

2018-05-30abs ↗pdf ↗

To devise efficient solutions for approximating a mean partition in consensus clustering, Dimitriadou et al. [3] presented a necessary condition of optimality for a consensus function based on least square distances. We show that their result is pivotal for deriving interesting properties of consensus clustering beyond…

2016-04-22abs ↗pdf ↗

Develop intrinsic consensus-based optimization framework on Riemannian manifolds with bounded curvature.

problem Nonconvex optimization on manifolds
method Intrinsic consensus-based optimization on Riemannian manifolds with bounded curvature
result Global convergence of the mean-field equation toward a global minimizer of the objective function.

New voting strategies show committee-based consensus can scale efficiently.

problem Ensuring honest committees in committee-based consensus protocols.
method Empirical analysis of simpler voting strategies and their convergence to optimality.
result Simpler voting strategies converge to optimality exponentially quickly, ensuring robustness and efficiency.

The paper connects PSO and CBO methods using stochastic modeling and mean-field limits.

problem Global optimization problems with particle swarm optimization and consensus based optimization.
method Stochastic differential equations and mean-field approximation to derive macroscopic hydrodynamic equations.
result Derives mean-field approximation for PSO and links it to CBO methods.

FedCBO solves clustered federated learning by optimizing groups of users without knowing their structure.

problem Training models for multiple users with privacy and communication constraints, especially in clustered settings.
method FedCBO uses a particle system approach inspired by consensus-based optimization to train models for each user group.
result FedCBO outperforms other methods in training models for clustered federated learning.

Paper proves PI consensus algorithm converges exponentially under restricted secant inequality.

problem Proving convergence of PI consensus algorithm without convexity.
method Lyapunov theory, restricted secant inequality, rate-matching discretization, local pre-conditioning.
result Exponential convergence of PI consensus algorithm for non-convex functions.

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization consists of a set of computational nodes arranged in a graph, each having a local ob…

2019-03-19abs ↗pdf ↗

A novel decentralized deep learning algorithm using gradient-based optimization.

problem Decentralized deep learning in networked systems without a central server.
method Heavy-ball acceleration method and consensus protocol for model and gradient-momentum sharing.
result The proposed algorithm outperforms competing methods in various communication topologies.

A new framework for clustering high-dimensional data using vertical shards.

problem Clustering high-dimensional data with the curse of dimensionality.
method Vertical Consensus Inference (VCI) that splits data into vertical shards for posterior inference.
result VCI can approximate inference on random partitions for high-dimensional data.

WISCA generates consensus explanations from conflicting model-agnostic interpretability methods.

problem Conflicting explanations from diverse interpretability algorithms.
method WISCA integrates class probability and normalized attributions to generate consistent explanations.
result WISCA consistently aligns with the most reliable individual method, improving explanation reliability.

CBO interprets as SGD, leading to global convergence for nonconvex functions.

problem Understanding and improving gradient-based learning algorithms.
method Interpreting CBO as a stochastic relaxation of SGD.
result CBO provably converges globally to minimizers for nonsmooth nonconvex functions.

New approach for distributed online optimization of non-convex losses with sublinear regret.

problem Regret evaluation and consensus in distributed, multi-agent systems with non-convex losses.
method Composite regret metric and consensus-based online normalized gradient (CONGD) approach for pseudo-convex losses; offline optimization oracle for general non-convex losses.
result First sublinear regret bound for general distributed online non-convex learning.

New method for summarizing ranking distributions using consensus ranking distributions.

problem Summarizing ranking distributions efficiently and accurately.
method Introducing consensus ranking distributions and a top-down tree-structured statistical algorithm.
result Optimal distortion can be expressed as a function of pairwise probabilities, enabling efficient learning methods.

We study the convergence of a variant of distributed gradient descent (DGD) on a distributed low-rank matrix approximation problem wherein some optimization variables are used for consensus (as in classical DGD) and some optimization variables appear only locally at a single node in the network. We term the resulting a…

2018-11-07abs ↗pdf ↗

New algorithms optimize decentralized convex optimization with near optimal communication and computation.

problem Decentralized convex optimization in large-scale machine learning and sensor networks.
method Novel algorithms combining Nesterov's acceleration, multi-consensus, and gradient-tracking.
result Achieves optimal computation and near optimal communication complexity, matching lower bounds.

The present paper considers distributed consensus algorithms that involve N agents evolving on a connected compact homogeneous manifold. The agents track no external reference and communicate their relative state according to a communication graph. The consensus problem is formulated in terms of the extrema of a cost f…

2008-11-26abs ↗pdf ↗

This paper optimizes cryptocurrency portfolios by clustering price correlations and improving risk-return profiles.

problem Volatility and regulatory uncertainty in cryptocurrency markets make portfolio construction challenging.
method The paper combines network analysis, price forecasting, and portfolio theory to identify stable groups of correlated cryptocurrencies.
result Predictive consensus-clustering portfolios maintain positive and stable performance up to a 14-day horizon, with favourable gain-loss asymmetry and tighter tail-risk control.

Decentralized optimization on dynamic manifolds with improved regret bound.

problem Optimizing on nonstationary Riemannian manifolds in decentralized systems.
method Decentralized projected Riemannian gradient descent with weighted Frechet mean consensus.
result Achieved dynamic regret bound of O(T(1+PT)/(1σ2(W))){\cal O}(\sqrt{T(1+P_T)}/\sqrt{(1-σ_2(W))}).

This study analyzes and optimizes hyperparameters for machine learning models.

problem Optimizing hyperparameters for machine learning models to improve performance.
method Experimental analysis of 30 hyperparameters from six machine learning algorithms using R and SPOT.
result A new consensus ranking method for analyzing results from multiple algorithms.

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of the nodes exchange information only with their neighbors in the absence of a fus…

2015-04-14abs ↗pdf ↗

New algorithm improves decentralized learning in the presence of Byzantine faults.

problem Byzantine faults in decentralized learning on arbitrary graphs.
method Proposes ClippedGossip for Byzantine-robust consensus and optimization.
result First to provably converge to a specified neighborhood of the stationary point for non-convex objectives.

Constructing the adjacency graph is fundamental to graph-based clustering. Graph learning in kernel space has shown impressive performance on a number of benchmark data sets. However, its performance is largely determined by the chosen kernel matrix. To address this issue, the previous multiple kernel learning algorith…

2019-03-14abs ↗pdf ↗

A new topology improves decentralized learning efficiency and accuracy.

problem Finding efficient decentralized learning topologies with fast consensus and low maximum degree.
method Proposed the Base-(k+1)(k + 1) Graph topology for decentralized learning.
result The Base-(k+1)(k + 1) Graph enables faster convergence and better communication efficiency than the exponential graph.

Unified parallel ADMM for high-dimensional regression with combined regularizations.

problem Efficiently solving high-dimensional regression problems with combined regularization terms in parallel.
method Unified constrained optimization formulation based on consensus problem, parallel ADMM algorithms.
result Global convergence and linear convergence rate of the proposed algorithm.

Since deep neural networks are over-parameterized, they can memorize noisy examples. We address such a memorization issue in the presence of label noise. From the fact that deep neural networks cannot generalize to neighborhoods of memorized features, we hypothesize that noisy examples do not consistently incur small l…

2019-10-22abs ↗pdf ↗

We present two related methods for deriving connectivity-based brain atlases from individual connectomes. The proposed methods exploit a previously proposed dense connectivity representation, termed continuous connectivity, by first performing graph-based hierarchical clustering of individual brains, and subsequently a…

2018-08-10abs ↗pdf ↗

Bayesian consensus improves accuracy of forecasts from miscalibrated sources.

problem Aggregating predictions from miscalibrated and noisy sources.
method Bayesian approach to adjust for bias and noise, using hierarchical models.
result Bayesian consensus estimator is unbiased and more efficient than alternatives.

ARCO-BO optimizes multi-agent design under heterogeneity, improving efficiency and performance.

problem Heterogeneous multi-agent optimization challenges in resource use and information sharing.
method ARCO-BO integrates a consensus mechanism, budget-aware sampling, and partial input sharing for heterogeneous design spaces.
result ARCO-BO outperforms independent and collaborative BO methods in complex multi-agent settings.

Unified framework for sampling and approximating high-dimensional energy landscapes.

problem Sampling and approximating complex energy landscapes in physical systems with constraints and energy barriers.
method Formulates a minimax optimization problem that jointly adapts surrogate approximation and adaptive sampling.
result Demonstrates effectiveness in biomolecular systems with up to 30 collective variables.

Decentralized ranking consensus via gossip for robust and scalable systems.

problem Achieving reliable and resilient consensus on collective rankings in a decentralized setting.
method Random gossip communication for decentralized computation of global rankings.
result Robust and scalable consensus on collective rankings achieved through decentralized, local interactions.

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual gradient descents on a local variable. We propose a new way of sharing information bet…

2018-04-04abs ↗pdf ↗

When solving consensus optimization problems over a graph, there is often an explicit characterization of the convergence rate of Gradient Descent (GD) using the spectrum of the graph Laplacian. The same type of problems under the Alternating Direction Method of Multipliers (ADMM) are, however, poorly understood. For i…

2017-10-02abs ↗pdf ↗

Paper defines a new pseudometric for measuring consensus among subsets of relations.

problem Measuring consensus among subsets of relations.
method Introduces a new pseudometric and provides a concise restatement with a functor interpretation. Also, describes an algorithm to calculate the pseudometric bound efficiently.
result The pseudometric can be bounded without an expensive search of possible mappings, based solely on the dimensions of the relations.