New algorithms for Bayesian inference in decentralized learning.
problem Bayesian inference in decentralized learning settings.
method Decentralized SGLD and Decentralized SGHMC.
result Convergence of iterates to target distribution in 2-Wasserstein distance.
While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional statistical failures---operate as intended within the algorithmic framework. In r…
Decentralized framework for spatial data inference over vulnerabilities.
problem Vulnerabilities in centralized frameworks for spatial data.
method Low-rank models, decentralized optimization, evidence lower bound, block descent method.
result Consistency and asymptotic normality of the estimator in spatial low-rank models.
This paper develops efficient federated learning and unlearning methods in Bayesian models.
problem Managing epistemic uncertainty and legal right to be forgotten in decentralized networks.
method Develops federated variational inference solutions based on decentralized local free energy minimization.
result Demonstrates efficient unlearning mechanisms in federated learning and unlearning.
NFTs raise concerns like scams, racism, and sexism; centralization vs decentralization debate.
problem Concerns and value judgments of stakeholders in NFT market.
method Mixed quantitative and qualitative methods: social media analysis and interviews.
result Identified financial scams, counterfeit NFTs, hacking, and unethical NFTs as major issues.
The paper analyzes distributed Bayesian inference and its Frequentist guarantees.
problem Analyzing large decentralized datasets with distributed Bayesian inference.
method Establishes Frequentist properties for distributed (non-)Bayesian inference.
result Distributed Bayesian inference retains parametric efficiency and enhances robustness.
A framework for decentralized optimization using first-order methods.
problem Optimization of finite sums over networked nodes.
method Decentralized first-order gradient and stochastic methods.
result General framework for undirected and directed networks.
Study finds significant price declines and capital reallocation from centralized to decentralized exchanges after FTX collapse.
problem Quantifying trust dynamics and redistribution between centralized and decentralized exchanges.
method Interdisciplinary approach combining causal inference and computational text analysis.
result Significant price declines and capital reallocation from centralized to decentralized exchanges following the FTX collapse.
New approach estimates treatment effects from decentralized data.
problem Estimating treatment effects from multiple studies with limited data.
method Three classes of ATE estimators derived from Plug-in G-Formula.
result Asymptotic variance of estimators for linear models derived.
Privacy preserving networks can be modelled as decentralized networks (e.g., sensors, connected objects, smartphones), where communication between nodes of the network is not controlled by an all-knowing, central node. For this type of networks, the main issue is to gather/learn global information on the network (e.g.,…
We consider the problem of decentralized clustering and estimation over multi-task networks, where agents infer and track different models of interest. The agents do not know beforehand which model is generating their own data. They also do not know which agents in their neighborhood belong to the same cluster. We prop…
This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the alternating-direction method of multipliers (ADMM) so as to gain the desired degree of paralleliza…
Paper tackles scalable VFL with data augmentation and amortized inference.
problem Collaborative model estimation across multiple clients with distinct covariates.
method Data augmentation, amortized variational approximation, factorized likelihoods.
result Scalable Bayesian VFL framework for various models.
Paper introduces ITD for detecting distributional changes in decentralized learning environments.
problem Detecting distributional changes in decentralized learning environments with data privacy and heterogeneity concerns.
method Introduces Integrated Transportation Distance (ITD) for two-sample testing in federated learning.
result ITD effectively aggregates information across distributed clients, detecting subtle distributional shifts.
We propose a decentralized learning algorithm over a general social network. The algorithm leaves the training data distributed on the mobile devices while utilizing a peer to peer model aggregation method. The proposed algorithm allows agents with local data to learn a shared model explaining the global training data …
We consider the decentralized exploration problem: a set of players collaborate to identify the best arm by asynchronously interacting with the same stochastic environment. The objective is to insure privacy in the best arm identification problem between asynchronous, collaborative, and thrifty players. In the context …
This study compares decentralized banks and finds some lack decentralization.
problem Decentralized banks do not fully decentralize transactions as expected.
method Network analysis of transaction data from four banks using core-periphery features.
result MakerDao and Compound are more decentralized than Aave and Liquity.
We consider the problem of \emph{fully decentralized} multi-agent reinforcement learning (MARL), where the agents are located at the nodes of a time-varying communication network. Specifically, we assume that the reward functions of the agents might correspond to different tasks, and are only known to the corresponding…
Extends DRFGP to make GPs more robust and adaptive for dynamic, noisy data.
problem Limited scalability, static targets, and brittleness to outliers in GPs.
method Introduces robust-filtering update and dynamic adaptation mechanism.
result Enhanced stability and accuracy in modeling dynamic, noisy data.
In decentralized networks (of sensors, connected objects, etc.), there is an important need for efficient algorithms to optimize a global cost function, for instance to learn a global model from the local data collected by each computing unit. In this paper, we address the problem of decentralized minimization of pairw…
Systematizes blockchain decentralization taxonomy and metrics.
problem Lack of a unified definition for blockchain decentralization.
method Formulated a taxonomy of five facets and developed metrics.
result Provided comprehensive insights into blockchain decentralization.
Study finds Aave token network has core-periphery structure, with high decentralization predicting better returns.
problem Understanding the actual decentralization in DeFi token transactions on the Ethereum blockchain.
method Applied social network analysis to measure decentralization in Aave token transactions.
result A more decentralized Aave token network predicts higher returns and lower volatility.
MakerDAO's governance is centralized despite its decentralized claim.
problem Decentralization illusion in Decentralized Finance (DeFi) governance.
method Empirical analysis using financial, transaction, network, and sentiment indicators.
result Centralized governance impacts Maker protocol and voting power distribution.
The decentralized particle filter (DPF) was proposed recently to increase the level of parallelism of particle filtering. Given a decomposition of the state space into two nested sets of variables, the DPF uses a particle filter to sample the first set and then conditions on this sample to generate a set of samples for…
Decentralized finance uses blockchain for $70B in assets, differing from traditional finance.
problem Ensuring compliance and security in decentralized finance.
method Systematic analysis of legal, economic, security, and privacy aspects.
result Decentralized finance offers unique economic effects and security features.
This paper analyzes voter coalitions in MakerDAO's decentralized governance.
problem Understanding the governance structure and influence of voter coalitions in DAOs.
method Applied clustering algorithm to voting history of MakerDAO to identify voter coalitions.
result The emergence of a dominant voter coalition signals governance centralization in DAOs.
Study on decentralization in DAOs and its effect on financial efficiency in DeFi.
problem Understanding the impact of decentralization on financial efficiency in blockchain-based governance.
method Analysis using Gini coefficient as an inequality indicator, comparing ROI of token owners.
result Real decentralization affects financial efficiency positively in DeFi.
The paper analyzes stability and generalization of decentralized SGD.
problem Stability and generalization of decentralized stochastic gradient descent.
method Novel formulation of decentralized stochastic gradient descent combined with non/convex optimization theory.
result First stability and generalization guarantees for decentralized stochastic gradient descent.
A decentralized approach for multi-source domain adaptation.
problem Transfer knowledge from multiple related domains to an unlabeled target domain.
method Federated Dataset Dictionary Learning (FedDaDiL) framework, eliminating central server, using Wasserstein barycenters.
result Our decentralized approach effectively adapts source domains to an unlabeled target domain.
Decentralized Gaussian processes for multi-agent learning.
problem Training and prediction in multi-agent systems.
method Decentralized ADMM for GP hyper-parameter training and iterative consensus for prediction.
result Subset of agents can perform predictions using covariance-based nearest neighbor selection.
Paper tightens lower bounds on decentralized training complexity.
problem Understanding and optimizing iteration complexity in decentralized training.
method Proved a tight lower bound on iteration complexity and proposed DeTAG algorithm.
result DeTAG achieves the theoretical lower bound with only a logarithmic gap.
This study measures decentralization in blockchain finance governance.
problem Defining and measuring decentralization in blockchain finance applications.
method Aggregating and analyzing empirical data of four finance applications to calculate coefficients for governance token distribution.
result Gauges for objective evaluation of token governance capabilities and limitations.
Paper proposes decentralized annuities for better retirement security.
problem Current pension systems' limitations and fairness issues.
method Theoretical models and fairness concepts analysis.
result Decentralized annuities offer enhanced flexibility and social welfare.
Federated framework learns causal states to predict counterfactuals without centralizing data.
problem Decentralized counterfactual reasoning in coupled industrial systems with private data.
method Federated causal representation learning in state-space systems.
result Proves convergence to centralized oracle and provides privacy guarantees.
Communication is a key bottleneck in distributed training. Recently, an \emph{error-compensated} compression technology was particularly designed for the \emph{centralized} learning and receives huge successes, by showing significant advantages over state-of-the-art compression based methods in saving the communication…
Enhances parallelism in decentralized learning for larger networks.
problem Scalability limitations in decentralized learning with increasing number of machines.
method Proposes Decentralized Anytime SGD, a novel algorithm that extends parallelism threshold.
result Establishes a theoretical upper bound on parallelism surpassing current state-of-the-art.
Novel periodic momentum SGD method for decentralized training with linear speedup.
problem Lack of effective momentum schema in decentralized training methods.
method Proposes a novel periodic decentralized momentum SGD method.
result Achieves linear speedup in decentralized training.
Single global merging boosts decentralized learning performance.
problem Limited communication in decentralized learning hinders performance.
method Scheduled communication, focusing on final step with global merging.
result Single global merging improves global test performance.
Bayesian algorithms minimize cumulative regret in decentralized multi-agent bandits.
problem Minimizing cumulative regret in a decentralized multi-agent multi-armed bandit problem.
method Proposed decentralized Bayesian multi-armed bandit framework, including Thompson Sampling and Bayes-UCB algorithms.
result Regret scales logarithmically with constants matching those of an optimal centralized agent.
Unified framework for decentralized bilevel optimization with various heterogeneity-correction strategies.
problem Decentralized bilevel optimization with neighborhood communications and data heterogeneity.
method SPARKLE: Single-loop Primal-dual Algorithm for decentralized bilevel optimization, incorporating various heterogeneity-correction techniques.
result Unified convergence analysis for SPARKLE with state-of-the-art convergence rates compared to existing algorithms.
Many optimization, inference and learning tasks can be accomplished efficiently by means of decentralized processing algorithms where the network topology (i.e., the graph) plays a critical role in enabling the interactions among neighboring nodes. There is a large body of literature examining the effect of the graph s…
Flexible decentralized MARL framework for cooperative multi-agent learning.
problem Complexity and impracticality of centralized MARL in complicated applications.
method Flexible fully-decentralized actor-critic MARL framework using primal-dual hybrid gradient descent.
result Competitive performance in large-scale cooperative multi-agent environments.
This research compiles knowledge on decentralized exchanges with AMM protocols.
problem Improving and developing AMM-based decentralized exchanges.
method Established a general AMM framework, compared mechanics, discussed security and privacy.
result Illustrated conservation and slippage functions of AMM protocols.
This paper improves privacy accounting in decentralized FL using f-Differential Privacy.
problem Challenges in accurately quantifying privacy budget in decentralized FL.
method Develops two new f-DP-based accounting methods for decentralized FL.
result Yields tighter (ε,δ) bounds and improved utility compared to existing methods.
DE-PSGLD samples from constrained distributions in a decentralized manner.
problem Sampling from log-concave distributions with constraints.
method Decentralized Proximal Stochastic Gradient Langevin Dynamics with proximal regularization.
result DE-PSGLD converges to a regularized Gibbs distribution and maintains posterior concentration.
Graph neural networks learn decentralized controllers from data.
problem Finding optimal decentralized controllers for autonomous agents is challenging.
method Adapting graph neural networks to handle delayed communications and ensure scalability and transferability.
result Graph neural networks can learn decentralized controllers from data, addressing the scalability and practical implementation issues of centralized controllers.
This paper creates a comprehensive BTC transaction network dataset spanning 15 years.
problem Lack of a full-history BTC graph and network property dataset.
method Thorough analysis of BTC transaction network, creating a dataset and investigating decentralization.
result First systematic investigation of BTC's asset decentralization and design of decentralization degrees.
Many large-scale machine learning (ML) applications need to perform decentralized learning over datasets generated at different devices and locations. Such datasets pose a significant challenge to decentralized learning because their different contexts result in significant data distribution skew across devices/locatio…