Bayesian consensus improves accuracy of forecasts from miscalibrated sources.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper analyzes convergence of decentralized algorithms with noise and bias.
High-probability bound for distributed stochastic approximation tracking error.
A new algorithm reduces communication in decentralized optimization.
LEAD algorithm speeds up decentralized optimization with compression.
Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large datasets typical of modern machine learning. The recently proposed consensus Monte Car…
Decentralized mechanism for collective predictions without sharing data or models.
We consider the problem of decentralized consensus optimization, where the sum of smooth and strongly convex functions are minimized over distributed agents that form a connected network. In particular, we consider the case that the communicated local decision variables among nodes are quantized in order to all…
Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization consists of a set of computational nodes arranged in a graph, each having a local ob…
In this work, we study stability of distributed filtering of Markov chains with finite state space, partially observed in conditionally Gaussian noise. We consider a nonlinear filtering scheme over a Distributed Network of Agents (DNA), which relies on the distributed evaluation of the likelihood part of the centralize…
WISCA generates consensus explanations from conflicting model-agnostic interpretability methods.
Processing data collected by a network of agents often boils down to solving an optimization problem. The distributed nature of these problems calls for methods that are, themselves, distributed. While most collaborative learning problems require agents to reach a common (or consensus) model, there are situations in wh…
A method for consensus prediction from probabilistic classifier outputs.
Bayesian framework for online consensus prediction from expert feedback.
In distributed machine learning, where agents collaboratively learn from diverse private data sets, there is a fundamental tension between consensus and optimality. In this paper, we build on recent algorithmic progresses in distributed deep learning to explore various consensus-optimality trade-offs over a fixed commu…
CB-APM uses analyst consensus as a bottleneck to interpret stock returns.
New model corrects bias in crowdsourced ratings for diverse items.
Paper proves PI consensus algorithm converges exponentially under restricted secant inequality.
We use a cluster ensemble to determine the number of clusters, k, in a group of data. A consensus similarity matrix is formed from the ensemble using multiple algorithms and several values for k. A random walk is induced on the graph defined by the consensus matrix and the eigenvalues of the associated transition proba…
To devise efficient solutions for approximating a mean partition in consensus clustering, Dimitriadou et al. [3] presented a necessary condition of optimality for a consensus function based on least square distances. We show that their result is pivotal for deriving interesting properties of consensus clustering beyond…
Consensus clustering fuses diverse basic partitions (i.e., clustering results obtained from conventional clustering methods) into an integrated one, which has attracted increasing attention in both academic and industrial areas due to its robust and effective performance. Tremendous research efforts have been made to t…
We present here an introduction to Brainstorming approach, that was recently proposed as a consensus meta-learning technique, and used in several practical applications in bioinformatics and chemoinformatics. The consensus learning denotes heterogeneous theoretical classification method, where one trains an ensemble of…
Adversaries can manipulate cooperative MARL networks.
A novel framework for consensus clustering is presented which has the ability to determine both the number of clusters and a final solution using multiple algorithms. A consensus similarity matrix is formed from an ensemble using multiple algorithms and several values for k. A variety of dimension reduction techniques …
Determinantal consensus clustering improves clustering robustness.
CoHiRF extends clustering methods to handle high-dimensional data efficiently.
Energy-efficient detection of natural errors in deep networks.
IMPACC improves consensus clustering for bioinformatics data.
The distribution of price returns for a class of uncorrelated diffusive dynamics is considered. The basic assumptions are (1) that there is a "consensus" value associated with a stock, and (2) that the rate of diffusion depends on the deviation of the stock price from the consensus value. We find an analytical expressi…
Consensus dimension reduction combines multiple visualizations to identify shared patterns.
The rapid adoption of machine learning has increased concerns about the privacy implications of machine learning models trained on sensitive data, such as medical records or other personal information. To address those concerns, one promising approach is Private Aggregation of Teacher Ensembles, or PATE, which transfer…
SBO uses dual voting to build consensus in noisy feedback settings.
The present paper considers distributed consensus algorithms that involve N agents evolving on a connected compact homogeneous manifold. The agents track no external reference and communicate their relative state according to a communication graph. The consensus problem is formulated in terms of the extrema of a cost f…
Study on consensus formation in manifolds with curvature constraints.
New Ising models improve consensus clustering on specialized hardware.
Deep learning has demonstrated abilities to learn complex structures, but they can be restricted by available data. Recently, Consensus Networks (CNs) were proposed to alleviate data sparsity by utilizing features from multiple modalities, but they too have been limited by the size of labeled data. In this paper, we ex…
Suppose that multiple experts (or learning algorithms) provide us with alternative Bayesian network (BN) structures over a domain, and that we are interested in combining them into a single consensus BN structure. Specifically, we are interested in that the consensus BN structure only represents independences all the g…
Crowdlab uses classifiers to estimate consensus labels and annotator quality.
A new framework for clustering high-dimensional data using vertical shards.
ANN clusters multi-view data by agglomerating subviews and avoiding postprocessing.
This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of the nodes exchange information only with their neighbors in the absence of a fus…
New voting strategies show committee-based consensus can scale efficiently.
Paper defines a new pseudometric for measuring consensus among subsets of relations.
Unified view connects CoCoA and ADMM for distributed ERM.
New optimization model converges to global minimizers on spheres.
Paper introduces robust methods for consensus ranking in AI systems.
This work presents a two-stage neural architecture for learning and refining structural correspondences between graphs. First, we use localized node embeddings computed by a graph neural network to obtain an initial ranking of soft correspondences between nodes. Secondly, we employ synchronous message passing networks …
New methods reveal consensus and dissensus in network partitions.