Method detects shared and private communities in multilayer networks.
problem Detecting shared and private communities in multilayer networks.
method Variational Bayes approach for jointly inferring shared and unshared hidden communities.
result Our method outperforms state-of-the-art algorithms in detecting communities.
FedLog reduces communication in federated learning by sharing data summaries.
problem Significant communication overhead in federated learning with large model parameters.
method Shares minimal sufficient statistics via Bayesian inference and differential privacy.
result High learning accuracy with low communication overhead.
ComEx protocol reduces communication costs in cooperative bandits.
problem Minimizing communication costs in cooperative bandits while maintaining optimal performance.
method Developed ComEx protocol to reduce communication from Θ ( T ) Θ(T) Θ ( T ) to O ( log T ) O(\log T) O ( log T ) messages. result Achieves state-of-the-art performance with significantly reduced communication cost.
This paper proposes a new D2D data sharing approach to improve distributed machine learning training speed.
problem Straggler dilemma in distributed edge learning.
method Proposes a D2D data sharing approach to balance computation loads and optimize radio resource allocation.
result Significantly reduces training delay and enhances training accuracy in non-i.i.d. data environments.
Paper tackles energy sharing in ZECs using DRL.
problem Improving energy status of ZECs through agent-based energy sharing.
method Modelled as a multi-agent environment, solved with DRL.
result Agents learn to collaborate and improve ZEC's energy status over time.
Optimal distributed testing under communication constraints with shared randomness.
problem Signal detection in a distributed system with limited communication.
method Derivation of minimax testing errors, distributed testing algorithms, and theoretical lower bounds.
result Consistent nonparametric distributed testing is possible even with minimal communication.
Optimized parallel algorithms for identifying strong ties in data.
problem Identifying strong ties in data with varying distances and community sizes.
method Design and analysis of sequential and parallel algorithms for partitioned local depths.
result Optimized algorithms achieve up to 19.4x speedup in parallel execution.
A new method for efficient online federated learning reduces communication overhead.
problem Real-world limitations in online federated learning, such as heterogeneous client participation and communication delays.
method Proposes a communication-efficient asynchronous online federated learning (PAO-Fed) strategy.
result Achieves the same convergence properties as online federated stochastic gradient while reducing communication overhead by 98 percent.
Multiplex networks, a special type of multilayer networks, are increasingly applied in many domains ranging from social media analytics to biology. A common task in these applications concerns the detection of community structures. Many existing algorithms for community detection in multiplexes attempt to detect commun…
Develops a model to detect shared communities in non-aligned graphs.
problem Clustering and community detection in non-aligned graphs with heterogeneous populations.
method Joint Stochastic Blockmodel (Joint SBM) and efficient spectral clustering.
result The joint model better estimates communities compared to separate SBMs on individual graphs.
A new MARL framework for community-based cooperation with transfer and active exploration.
problem Flexible coordination patterns in multi-agent systems with community structures.
method Community-based multi-agent reinforcement learning with transfer and active exploration.
result Provably convergent actor-critic algorithms for structured information sharing and transfer learning.
FedFMC improves federated learning on non-iid data without sharing data or increasing communication costs.
problem Efficiently updating a global model on non-iid data in federated learning.
method FedFMC dynamically forks devices into different global models, merges and consolidates them.
result FedFMC substantially improves upon earlier approaches to non-iid data in federated learning.
Shared workspace improves neural module coordination in deep learning.
problem Pairwise interactions in deep learning models lack global coordination.
method Introduce a shared global workspace with bandwidth limitations among neural modules.
result Capacity limitations encourage specialization and synchronization.
Exact optimality achieved in distributed mean estimation with shared randomness.
problem Achieving optimal communication, privacy, and utility tradeoffs in distributed mean estimation.
method Utilization of a rotationally symmetric shared random codebook and a k k k -closest encoding mechanism. result Proposed mechanism achieves exact optimality for randomly rotated simplex codebook.
We study the problem of distributed multi-task learning with shared representation, where each machine aims to learn a separate, but related, task in an unknown shared low-dimensional subspaces, i.e. when the predictor matrix has low rank. We consider a setting where each task is handled by a different machine, with sa…
Algorithm reduces regret in distributed kernel bandits with shared randomness.
problem Minimizing regret in collaborative function maximization.
method Uniform exploration at local agents and shared randomness with central server.
result Achieves optimal regret order with sublinear communication cost.
New algorithm reduces communication in distributed learning by sharing compressed beliefs.
problem Efficiently learning from private data in a distributed setting with large hypothesis sets.
method Proposes a belief update rule for distributed cooperative learning with compressed (sparse or quantized) beliefs.
result Beliefs converge almost surely to optimal hypotheses with a linear concentration rate.
We develop a secure aggregation protocol for federated learning that reduces communication and computation costs.
problem Expensive communication and privacy concerns in federated learning.
method Adapting compression-based federated techniques to additive secret sharing.
result Our protocol achieves high accuracy with low communication costs and is more efficient than prior work.
Deep autoencoder network solves spectrum sharing problems efficiently.
problem Resource allocation in wireless communications and D2D networks.
method Generative neural network (autoencoder) for solving linear sum assignment problems.
result Hybrid autoencoder architecture outperforms other methods in accuracy and speed.
A distributed algorithm reduces communication cost in linear bandits to near-optimal levels.
problem Cooperative linear bandit optimization with stochastic contexts.
method DisBE-LUCB algorithm, DecBE-LUCB algorithm, sharing information through a central server or immediate neighbors.
result Communication cost of DisBE-LUCB matches information-theoretic lower bound up to logarithmic factors.
PRISM-FCP improves federated prediction robustness against Byzantine attacks.
problem Byzantine attacks in federated learning.
method Partial model sharing and distance-based maliciousness scores.
result Maintains nominal coverage guarantees under Byzantine attacks.
The study examines how formal index insurance compares to informal risk sharing in managing natural disasters.
problem The challenges of natural disasters and the effectiveness of index insurance in risk management.
method A three-strategy evolutionary game model to analyze the competitive relationship between formal index insurance, informal risk sharing, and non-insurance.
result Basis risk and loss ratio significantly impact the adoption rate of index insurance, with different strategies preferred under varying conditions.
Study on limits of LLM-based multi-agent planning reliability.
problem Reliability limits of LLM-based multi-agent planning.
method Modeling LLM-based multi-agent architecture as a decision network, showing dominance by centralized Bayes decision maker.
result Optimizing multi-agent directed acyclic graphs under communication budget is equivalent to choosing a constrained experiment.
This paper tackles resource allocation in multi-user communication networks using a coordinated multi-armed bandit approach.
problem Learning unknown stochastic network characteristics and sharing resources efficiently.
method Combines Multi-Armed Bandit learning with a lightweight signalling-based coordination scheme.
result Ensures convergence to a stable allocation of resources with maximal resource utilization.
New strategy achieves optimal regret without communication or collisions in multi-player bandit.
problem Cooperative multi-player stochastic multi-armed bandit with shared randomness.
method Combination of combinatorial approach to generalize geometric intuition.
result Achieves near-optimal regret i l d e O ( T ) ilde{O}(\sqrt{T}) i l d e O ( T ) for any number of players and arms without collisions. Hierarchical FL reduces latency in HCNs by sharing model updates.
problem Latency and privacy issues in federated learning across heterogeneous cellular networks.
method Hierarchical federated learning, gradient sparsification, periodic averaging.
result Significant reduction in communication latency without compromising model accuracy.
MACC learns communication protocols by adapting counterfactual reasoning.
problem Credit assignment and non-stationarity in communication environments.
method Adapts counterfactual reasoning to overcome credit assignment and uses action policy and Q-function of other agents to handle non-stationarity.
result MACC outperforms state-of-the-art baselines in four scenarios.
Chimera model combines link, content, and time for dynamic network analysis.
problem Community detection and prediction in evolving networks with dynamic changes.
method Shared factorization model that accounts for graph links, content, and temporal analysis.
result The approach simplifies temporal analysis and enables future community prediction.
GEMS learns global models by intersecting local 'good-enough' models.
problem Aggregating data across multiple nodes with limited communication.
method GEMS framework that intersects 'good-enough' models from each node.
result GEMS improves model accuracy by 15 points on average.
We study the inference of a model of dynamic networks in which both communities and links keep memory of previous network states. By considering maximum likelihood inference from single snapshot observations of the network, we show that link persistence makes the inference of communities harder, decreasing the detectab…
CEDAR efficiently analyzes distributed EHR data without sharing patient-level info.
problem Analyzing patient-level data from multiple EHRs databases without sharing raw data.
method Tackles by turning problem into missing data, incorporating posterior samples.
result Improves efficiency and privacy of parameter estimates in sparse regressions.
Community detection algorithms are fundamental tools to understand organizational principles in social networks. With the increasing power of social media platforms, when detecting communities there are two possi- ble sources of information one can use: the structure of social network and node attributes. However struc…
Finding meaningful communities in social network has attracted the attentions of many researchers. The community structure of complex networks reveals both their organization and hidden relations among their constituents. Most of the researches in the field of community detection mainly focus on the topological structu…
New approach for sharing deep learning costs between devices and cloud.
problem Prohibitive deep learning computational requirements for embedded devices.
method Study of representation compressibility in MobileNetV2 for balancing computation, bandwidth, and accuracy.
result An optimal splitting layer for network can be found with a simple PCA-based compression scheme.
ODC protocol improves learning in asynchronous multi-agent bandits.
problem Cooperative multi-agent bandits with unknown, irregular pull times.
method ODC protocol for on-demand communication between agents.
result ODC protocol reduces communication complexity based on empirical pull times.
Efficiently estimates Cox model coefficients without sharing data.
problem Privacy and ownership concerns in multi-center biomedical studies.
method Communication-efficient iterative distributed algorithms for estimation and inference.
result Achieves convergence rate of full-sample estimator with minimal iterations.
This review explores how multiple agents learn to communicate in complex environments.
problem Learning effective communication strategies among multiple agents in partially observable environments.
method Review of recent algorithms and models for improving communication between agents, including Deep Recurrent Q-Networks.
result Introduction of a novel entropy-based evaluation metric for communication strategies.
Most real-world networks exhibit community structure, a phenomenon characterized by existence of node clusters whose intra-edge connectivity is stronger than edge connectivities between nodes belonging to different clusters. In addition to facilitating a better understanding of network behavior, community detection fin…
Algorithm improves multi-agent learning with noisy observations.
problem Challenges in learning optimal policies with noisy, weakly correlated observations.
method Enhanced multi-agent deep deterministic policy gradient algorithm (MADDPG-M) with a communication medium.
result Algorithm performs well in complex, non-stationary environments, offering significant performance gains.
Study cooperative bandit learning with imperfect communication, achieving near-optimal performance.
problem Real-world distributed decision-making with imperfect communication.
method Proposed decentralized algorithms for three communication scenarios: stochastic networks, random delays, and adversarially corrupted rewards.
result Achieved competitive performance and near-optimal guarantees on group regret.
Algorithm for stable allocation in heterogeneous ad-hoc networks.
problem Decentralized spectrum allocation in dynamic, heterogeneous networks.
method Multi-armed bandit based distributed algorithm for static and dynamic networks.
result Achieves stable orthogonal allocation in finite time with low complexity.
Much of the data being created on the web contains interactions between users and items. Stochastic blockmodels, and other methods for community detection and clustering of bipartite graphs, can infer latent user communities and latent item clusters from this interaction data. These methods, however, typically ignore t…
New method reduces communication in deep learning training.
problem Communication overhead in distributed deep learning training.
method Random-block sparsification to reduce gradients communicated.
result Performance close to standard SGD with reduced communication.
FedMA improves federated learning for neural nets, matching and averaging model elements.
problem Federated learning's communication burden and model performance.
method Layer-wise construction of shared model by matching and averaging hidden elements.
result FedMA outperforms state-of-the-art algorithms on deep CNN and LSTM architectures.
DEOT method compares distributions across agents with privacy and efficiency.
problem Comparing distributions across agents in a distributed system.
method Decentralized entropic optimal transport with mini-batch randomized block-coordinate descent and decentralized kernel approximation.
result The method provides a privacy-preserving and communication-efficient solution to distributed distribution comparison.
New analysis shows Local SGD can achieve error scaling with only fixed number of communications.
problem Speeding up SGD by parallelizing across multiple workers with reduced communication overhead.
method Proposed and analyzed Local SGD method with a fixed number of communications independent of the number of steps.
result Achieves an error scaling as 1/(nT) with only a fixed number of communications (Ω(n)).
Paper presents a collaborative learning model to improve QoE models without sharing sensitive data.
problem Limited data volume and participant profiles lead to over-fitting and poor generalization of QoE models.
method Round-Robin based Collaborative Machine Learning training without sharing datasets.
result The proposed model outperforms conventional centralized and isolated learning methods.
FastSecAgg improves federated learning security and efficiency.
problem Privacy leakage in federated learning due to model parameter sharing.
method Introduces FastSecAgg, a secure aggregation protocol with FFT-based multi-secret sharing (FastShare).
result Efficient in computation and communication, robust to client dropouts.