Improved distributed learning with reduced communication costs.
problem Efficient communication in resource-constrained environments for distributed learning.
method Proposed a cost-effective partial communication protocol.
result Communication cost is reduced to O ( log T ) O(\log T) O ( log T ) , improving significantly on full communication. Swarm systems constitute a challenging problem for reinforcement learning (RL) as the algorithm needs to learn decentralized control policies that can cope with limited local sensing and communication abilities of the agents. While it is often difficult to directly define the behavior of the agents, simple communicatio…
MACC learns communication protocols by adapting counterfactual reasoning.
problem Credit assignment and non-stationarity in communication environments.
method Adapts counterfactual reasoning to overcome credit assignment and uses action policy and Q-function of other agents to handle non-stationarity.
result MACC outperforms state-of-the-art baselines in four scenarios.
Near-optimal regret in distributed bandit learning with efficient communication protocols.
problem Minimizing total regret in collaborative bandit learning with limited communication.
method Proposed communication protocols for distributed multi-armed and linear bandits with near-optimal regret and efficient communication costs.
result Achieved near-optimal regret with communication costs independent of time horizon and number of arms.
New protocol reduces communication costs for heterogeneous bandits over complex networks.
problem Minimizing group regret in a multi-agent, heterogeneous bandit setting over complex networks.
method Flooding with Absorption (FwA) protocol for heterogeneous bandits over complex networks.
result FwA protocol significantly reduces communication costs compared to flooding while maintaining similar regret performance.
Agents learn to communicate and solve navigation tasks efficiently.
problem Understanding and developing communication in artificial agents.
method Multi-agent navigation tasks in gridworld environments.
result Agents develop an interpretable communication protocol that optimally solves tasks.
Proves exponential sample complexity separations in local differential privacy.
problem Sample complexity in locally private protocols.
method Connection between communication complexity and sample complexity, using specific lower bounds for two problems.
result Exponential separations between differentially private protocols.
Efficiently tests discrete distributions with limited memory and communication.
problem Testing discrete distributions with constraints on memory and communication.
method Developed efficient algorithms for uniformity/identity and closeness testing in streaming and distributed models.
result Nearly-tight lower bounds on sample complexity and communication cost for uniformity testing.
We develop a secure aggregation protocol for federated learning that reduces communication and computation costs.
problem Expensive communication and privacy concerns in federated learning.
method Adapting compression-based federated techniques to additive secret sharing.
result Our protocol achieves high accuracy with low communication costs and is more efficient than prior work.
We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept drifts. This leads to a reduction of communication by an order of magnitude compared t…
Efficiently handles large support vectors in kernelized online learning.
problem Efficiency in communication for large support vectors in kernelized models.
method Extends a previously proposed protocol to kernelized online learners, introducing a novel communication criterion.
result Communication is bounded by the loss suffered, improving efficiency.
The study sets criteria for efficient communication in distributed online learning.
problem Achieving optimal learning performance while minimizing communication in distributed online learning.
method Formal criteria based on the intuition that in the worst case, every input is essential for learning performance and must be exchanged.
result The criteria hold for a simplified version of a previously published protocol, providing a communication bound that scales with the serialized prediction problem's hardness.
ODC protocol improves learning in asynchronous multi-agent bandits.
problem Cooperative multi-agent bandits with unknown, irregular pull times.
method ODC protocol for on-demand communication between agents.
result ODC protocol reduces communication complexity based on empirical pull times.
ComEx protocol reduces communication costs in cooperative bandits.
problem Minimizing communication costs in cooperative bandits while maintaining optimal performance.
method Developed ComEx protocol to reduce communication from Θ ( T ) Θ(T) Θ ( T ) to O ( log T ) O(\log T) O ( log T ) messages. result Achieves state-of-the-art performance with significantly reduced communication cost.
Machine learning aids in discovering and optimizing quantum protocols for long-distance communication.
problem Designing and optimizing quantum communication protocols for long distances.
method Projective simulation, a learning agent combining reinforcement learning and decision making.
result Machine learning identifies and improves quantum protocols like teleportation and entanglement purification.
We consider the problem of learning classifiers for labeled data that has been distributed across several nodes. Our goal is to find a single classifier, with small approximation error, across all datasets while minimizing the communication between nodes. This setting models real-world communication bottlenecks in the …
Secure Aggregation protocols allow a collection of mutually distrust parties, each holding a private value, to collaboratively compute the sum of those values without revealing the values themselves. We consider training a deep neural network in the Federated Learning model, using distributed stochastic gradient descen…
New protocol makes federated learning more scalable and private.
problem Securely aggregate data from distributed, private datasets.
method Proposes a new protocol for aggregation in the shuffled model that is more efficient in terms of communication and error.
result Achieves differential privacy guarantees with polylogarithmic scaling in the number of users.
The problem of secure friend discovery on a social network has long been proposed and studied. The requirement is that a pair of nodes can make befriending decisions with minimum information exposed to the other party. In this paper, we propose to use community detection to tackle the problem of secure friend discovery…
This study aims to improve communication between fragmented blockchain systems in finance.
problem Inefficient and insecure communication in fragmented blockchain systems.
method Analysis of cross-chain interoperability protocols and their properties.
result Comparison and evaluation of cross-chain interoperability protocols.
Agents collaboratively learn optimal policies in MDPs with limited capabilities.
problem Learning optimal policies in MDPs with heterogeneous agents and limited communication.
method Introduced concepts of leakage probabilities and proposed Federated-Q protocol (FedQ) for collaborative learning.
result FedQ protocol effectively aggregates knowledge and modifies learning problems for further training.
This paper improves MARL for networked systems through new protocols and discount factors.
problem Improving control in networked systems using multi-agent reinforcement learning.
method Formulated as a spatiotemporal Markov decision process, introduced a spatial discount factor, and proposed NeurComm.
result Appropriate spatial discount factor enhances learning curves of non-communicative MARL algorithms.
Elastic Gossip distributes neural network training using gossip-like protocols.
problem Distributing neural network training across heterogeneous environments.
method Pairwise-communication using Gossip-like protocols, building on Elastic Averaging SGD.
result Elastic Gossip performs better than Gossiping SGD in experiments, but hyper-parameter search may yield better configurations.
Aave community attack led to irretrievable debt and questioned decentralization in DeFi lending.
problem Decentralization vs. security in large DeFi lending protocols.
method Analyzed Avi Eisenberg's attack on Aave, showing how he artificially deflated CRV price.
result Attack led to irretrievable debt of over $1.5 million and highlighted decentralization vs. security.
Applying machine learning techniques to the quickly growing data in science and industry requires highly-scalable algorithms. Large datasets are most commonly processed "data parallel" distributed across many nodes. Each node's contribution to the overall gradient is summed using a global allreduce. This allreduce is t…
We optimize distributed learning algorithms to maintain linear convergence with limited communication.
problem Limited communication time affects the convergence of distributed learning algorithms.
method We design quantizers to compress algorithm information while preserving linear convergence and characterize communication time.
result We show how to co-design machine learning and communication protocols for optimal performance.
Motivated by cognitive radio networks, we consider the stochastic multiplayer multi-armed bandit problem, where several players pull arms simultaneously and collisions occur if one of them is pulled by several players at the same stage. We present a decentralized algorithm that achieves the same performance as a centra…
Novel framework for systemic risk analysis in financial markets.
problem Systemic risk in financial markets.
method Multi-scale network dynamics, transfer entropy networks, agent-based modeling, wavelet decomposition, Model Context Protocol (MCP).
result Multi-scale approach reveals hidden systemic risk patterns.
A study on the communication complexity of estimating correlations between variables.
problem Estimating the correlation between two sets of correlated random variables with limited communication.
method One-way interactive protocol exchanging k bits, optimizing over interaction protocol and estimator.
result Achieves optimal performance with communication complexity of 1/k, improving over naive schemes.
Improved privacy-preserving summation protocol with fewer messages.
problem Achieving efficient differential privacy in multi-party summation.
method Combining secure shuffling with Laplace mechanism in the shuffle model.
result Protocol with O ( 1 / ε ) O(1/ε) O ( 1/ ε ) error and O ( log ( n / δ ) ) O(\log(n/δ)) O ( log ( n / δ )) messages per party. A framework for multi-agent learning improves coordination through a memory-driven communication protocol.
problem Coordination and synchronisation in multi-agent systems with limited observations.
method A memory-driven communication protocol learned concurrently with individual policies during training.
result Superior performance in small-scale systems with up to six agents, demonstrating improved coordination.
Paper proposes a secure protocol for federated learning.
problem Combining robustness, privacy, and security in federated learning.
method Secure two-server protocol for federated learning.
result Offers both input privacy and Byzantine-robustness.
In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication required for learning classifiers while allowing for $\eps$ training error on lin…
FastSecAgg improves federated learning security and efficiency.
problem Privacy leakage in federated learning due to model parameter sharing.
method Introduces FastSecAgg, a secure aggregation protocol with FFT-based multi-secret sharing (FastShare).
result Efficient in computation and communication, robust to client dropouts.
Paper sets fundamental limits for distributed covariance estimation with constrained communication.
problem Estimating high-dimensional covariance matrices in a feature-split setting with limited communication.
method Developed a Conditional Strong Data Processing Inequality (C-SDPI) to establish minimax lower bounds and an optimal estimation protocol.
result Achieved nearly optimal estimation protocol with sample and communication requirements matching lower bounds up to logarithmic factors.
Paper improves regret bounds for distributed experts problem.
problem Minimizing loss in a distributed experts problem.
method Protocol achieving improved regret bound with minimized communication.
result Regret bound improved to R ≳ 1 T ⋅ e x t p o l y log ( n s T ) R \gtrsim \frac{1}{\sqrt{T} \cdot ext{poly}\log(nsT)} R ≳ T ⋅ e x t p o l y l o g ( n s T ) 1 . Agents are rewarded for influencing others' actions in MARL, improving coordination and communication.
problem Achieving effective coordination and communication in Multi-Agent Reinforcement Learning.
method Rewarding agents for having causal influence over other agents' actions, assessed through counterfactual reasoning.
result Influence rewards lead to enhanced coordination and communication in challenging social dilemma environments.
This paper critiques flawed MVTS anomaly detection evaluation methods and proposes a simple baseline.
problem Flawed evaluation methods in MVTS anomaly detection research.
method Robust evaluation protocols, including PCA-based baseline.
result Simple PCA-based baseline outperforms many DL approaches.
Proposes a decentralized insurance protocol for DeFi.
problem Over-insurance and inefficiencies in DeFi collateral.
method Smart contract-based economic model without external dependencies.
result Solves over-insurance and capital inefficiencies.
Proposes a credit scoring system for Aave accounts.
problem Scoring the creditworthiness of DeFi accounts.
method Tree-based binary classifier for predicting delinquency.
result Validated the credit scoring system for Aave accounts.
A scalable protocol for federated averaging with privacy and correctness guarantees.
problem Privacy and correctness in federated learning from multiple parties.
method Scalable protocol using correlated and independent Gaussian noise, analyzed for differential privacy and graph topology.
result Nearly matches trusted curator model's utility with minimal communication.
An efficient LDP protocol for QMLE with improved practicality and theoretical guarantees.
problem Difficult implementation of existing LDP QMLE for large-scale surveys.
method Developed an alternative LDP protocol without long waiting time, high communication cost, and derivative boundedness assumptions.
result Sufficient conditions for consistency and asymptotic normality of the protocol.
Study on TVL computation in DeFi protocols, proposing verifiable metrics.
problem Lack of standardization and verifiability in TVL computation.
method Systematic study of 939 DeFi projects, analyzing methodologies and proposing vTVL.
result 240 protocols use repeated balance queries, limiting verifiability.
A novel framework for adaptive multi-agent communication in reinforcement learning.
problem Manual specification of communication structures in multi-agent reinforcement learning.
method Learning Structured Communication (LSC) framework using hierarchical graph neural networks.
result Adaptive hierarchical formations and efficient message propagation among agents.
A novel algorithm reduces regret in multi-agent multi-armed bandits through gossip-based communication.
problem Minimizing average cumulative regret in a large number of agents solving the same MAB problem.
method A gossip-based protocol for decentralized decision-making and communication among agents.
result Achieves significant reduction in per-agent regret and communication complexity.
A decentralized policy achieves logarithmic regret for multi-agent MAB problems with communication constraints.
problem Decentralized policy for multi-agent MAB problems with option availability and communication constraints.
method Upper Confidence Bound (UCB) algorithms with non-stationary stochastic communication protocol.
result Guaranteed logarithmic regret for non-fully connected spatial graphs with communication constraints.
Paper develops LDP protocols for computing U-statistics with various error bounds.
problem Computing U-statistics in the local model of differential privacy.
method Quantization, randomized response, hierarchical histograms, 2-party secure computation.
result Protocols achieve MSE of O ( 1 / n ε ) O(1/\sqrt{n}ε) O ( 1/ n ε ) , O ( α 3 / n ε 2 ) O(α^3/nε^2) O ( α 3 / n ε 2 ) , and O ( 1 / n ε 2 ) O(1/nε^2) O ( 1/ n ε 2 ) . The study analyzes how cross-chain interoperability affects decentralized lending protocols' performance.
problem Understudied cross-chain elements in DeFi lending risk management.
method Panel regression fixed effects and OLS models applied to empirical analysis.
result Cross-chain activity impacts protocol performance, with bridge volume being a critical driver.