Study explores how to efficiently explore communities with limited budget.
problem Maximizing the number of members met with limited budget in community exploration.
method Systematic study from offline optimization to online learning, including greedy methods and upper confidence algorithms.
result Achieved logarithmic and constant regret bounds in online learning setting.
A new MARL framework for community-based cooperation with transfer and active exploration.
problem Flexible coordination patterns in multi-agent systems with community structures.
method Community-based multi-agent reinforcement learning with transfer and active exploration.
result Provably convergent actor-critic algorithms for structured information sharing and transfer learning.
Paper presents an algorithm for optimal regret in communicating Markov decision processes.
problem Achieving optimal regret in Markov decision processes with a communicating assumption.
method The algorithm explicitly tracks the constant K(M) to learn optimally, balancing exploration, co-exploration, and exploitation.
result The algorithm achieves asymptotically optimal regret K ( M ) log ( T ) + o ( log ( T ) ) K(M) \log(T) + \mathrm{o}(\log(T)) K ( M ) log ( T ) + o ( log ( T )) for communicating Markov decision processes. Paper closes the gap in MP-MAB problems with novel adaptive communication and exploration.
problem Closing the gap between decentralized MP-MAB and natural centralized lower bound.
method BEACON: Batched Exploration with Adaptive COmmunicatioN, incorporating ADC and batched exploration.
result Proves logarithmic regret for a generalized MP-MAB problem.
Improved PAC guarantees for multi-agent reinforcement learning with noisy communication.
problem Improving exploration in cooperative multi-agent reinforcement learning with communication constraints.
method Develops PAC guarantees for multiple concurrent MDPs with noisy and resource-limited communication.
result Theoretical and empirical improvements in sample complexity for information fusion.
Community detection improves stock market portfolio optimization.
problem Improving portfolio optimization in financial markets.
method Community detection in correlation-based networks of worldwide stock markets.
result Portfolios constructed using community detection outperform traditional methods.
The paper improves regret lower bounds for communicating MDPs.
problem Regret lower bounds for communicating MDPs.
method Lower bound proof and optimization problem formulation.
result Regret lower bound becomes significantly more complex in communicating MDPs.
A new algorithm reduces regret in multiplayer bandits with minimal communication.
problem Maximizing rewards in multiplayer multi-armed bandits with collisions.
method DPE (Decentralized Parsimonious Exploration) algorithm.
result Achieves the same regret as optimal centralized algorithms with less communication.
While designing the state space of an MDP, it is common to include states that are transient or not reachable by any policy (e.g., in mountain car, the product space of speed and position contains configurations that are not physically reachable). This leads to defining weakly-communicating or multi-chain MDPs. In this…
Study explores cyberbullying datasets and classifier generalization.
problem Cyberbullying detection across different online communities.
method Analysis of various cyberbullying datasets and classifier generalization.
result Insight into classifier generalization power and interaction.
Paper explores why compositionality is not the right approach for emergent communication.
problem Lack of interaction between biological and computational models of emergent communication.
method Exploring the claim that compositionality is the wrong target for explaining natural language emergence.
result Suggests reflexivity as a better target for explaining natural language emergence.
A new method detects communities in multi-relational networks.
problem Detect communities in heterogeneous multi-relational networks.
method Message passing based algorithm on a hierarchical structure of homogeneous networks.
result Effectiveness of the proposed method confirmed on synthetic and real-world networks.
Paper identifies sparse structures and communities in heterogeneous graphical models.
problem Detecting community structures in graphical models.
method Novel decomposition into sparse and low-rank parts, three-stage estimation procedure.
result Consistent model selection for adaptive ℓ 1 \ell_1 ℓ 1 penalized estimator. Paper explores exact recovery of communities in weighted graphs using Gaussian and exponential distributions.
problem Exact recovery of communities in weighted graphs with Gaussian and exponential distributions.
method Introduces a new semi-metric to describe conditions for exact recovery and analyzes conditions for both complete and incomplete graphs.
result Necessary and sufficient conditions for exact recovery are asymptotically tight and applicable to both complete and incomplete graphs.
Paper proposes efficient sample collection strategy for RL.
problem Balancing exploration and exploitation in reinforcement learning.
method Decoupled approach with objective-specific and objective-agnostic strategies.
result Improved or novel sample complexity guarantees for various RL settings.
A novel framework for adaptive multi-agent communication in reinforcement learning.
problem Manual specification of communication structures in multi-agent reinforcement learning.
method Learning Structured Communication (LSC) framework using hierarchical graph neural networks.
result Adaptive hierarchical formations and efficient message propagation among agents.
IC3Net improves communication efficiency in multiagent tasks.
problem Efficient communication in multiagent tasks, especially in semi-cooperative and competitive settings.
method IC3Net uses a gating mechanism and individualized rewards to control continuous communication, improving scalability and performance.
result IC3Net yields improved performance and convergence rates compared to baselines as task scale increases.
New clustering method ensures fairness and community preservation.
problem Fairness in clustering, especially for data points representing people.
method Developed an approach to extend k k k -center algorithms to satisfy pairwise fairness and community preservation. result Reasonable approximations of optimal clustering can be achieved while maintaining fairness.
A new decentralized policy for multi-agent MAB problems outperforms random communication.
problem Solving multi-agent multi-armed bandit problems efficiently.
method UCB strategy for individual option selection and communication strategy based on neighbor exploration potential.
result The proposed policy significantly outperforms random communication strategies.
This study analyzes satellite communication latency using a stochastic geometry model.
problem Latency analysis of LEO satellite relay communication systems.
method Stochastic geometry framework with spherical BPP models, suboptimal satellite relay selection strategy.
result Derives distance distributions and analytical expressions for transmission delays.
Method combines latent space exploration and causal inference to interpret unknown data.
problem Interpreting unknown communication system of sperm whales.
method Causal disentanglement with extreme values (CDEV) combining latent variable manipulation and causal inference.
result Sperm whales encode information using click number, timing regularity, and audio properties.
We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used for low-dimensional estimation, high-dimensional regularized estimation and Bayesian inference. For…
We propose a semidefinite programming (SDP) algorithm for community detection in the stochastic block model, a popular model for networks with latent community structure. We prove that our algorithm achieves exact recovery of the latent communities, up to the information-theoretic limits determined by Abbe and Sandon (…
This paper explores advancements in neural network communication for distributed settings.
problem Challenges in training and evaluating neural networks in distributed, privacy-constrained environments.
method Development and evaluation of novel training and evaluation schemes for neural networks.
result Advantages of novel approaches over traditional cloud solutions, including privacy-preservation, increased security, and high training speed.
Paper studies community detection in censored hypergraphs using information theory.
problem Community detection in censored hypergraphs with missing values.
method Information-theoretic approach, polynomial-time algorithm, spectral algorithm with refinement.
result Derives information-theoretic threshold for exact recovery of community structure.
A new algorithm reduces communication in deep learning training.
problem Slow convergence in deep neural networks due to exploding gradients.
method Communication-efficient distributed gradient clipping algorithm.
result Algorithm achieves linear speedup and reduced communication rounds.
Multiplex networks, a special type of multilayer networks, are increasingly applied in many domains ranging from social media analytics to biology. A common task in these applications concerns the detection of community structures. Many existing algorithms for community detection in multiplexes attempt to detect commun…
In this paper, we consider the distributed stochastic multi-armed bandit problem, where a global arm set can be accessed by multiple players independently. The players are allowed to exchange their history of observations with each other at specific points in time. We study the relationship between regret and communica…
We optimize distributed learning algorithms to maintain linear convergence with limited communication.
problem Limited communication time affects the convergence of distributed learning algorithms.
method We design quantizers to compress algorithm information while preserving linear convergence and characterize communication time.
result We show how to co-design machine learning and communication protocols for optimal performance.
This review explores how multiple agents learn to communicate in complex environments.
problem Learning effective communication strategies among multiple agents in partially observable environments.
method Review of recent algorithms and models for improving communication between agents, including Deep Recurrent Q-Networks.
result Introduction of a novel entropy-based evaluation metric for communication strategies.
Improved analysis of UCRL2 with empirical Bernstein inequality reduces exploration-exploitation regret.
problem Exploration-exploitation in communicating Markov Decision Processes.
method Analysis of UCRL2 with Empirical Bernstein inequalities (UCRL2B).
result Regret bound of O ~ ( D Γ S A T ) \widetilde{O}(\sqrt{DΓS A T}) O ( D Γ S A T ) for UCRL2B. A bandit algorithm reduces regret in noisy, communication-constrained feedback.
problem Distributed stochastic multi-armed bandit with noisy, communication-constrained feedback.
method Proposes a multi-phase bandit algorithm, UE-UCB++, that matches an information-theoretic lower bound.
result Matches an information-theoretic lower bound of Ω(√(KT/σ²)) on the minimax regret.
Efficient algorithm reduces communication costs in sparse regression.
problem Sparse linear regression with massive data.
method CESDAR algorithm, communication-efficient surrogate likelihood.
result Achieves same statistical accuracy as global estimator with reduced communication.
Modern distributed training of machine learning models suffers from high communication overhead for synchronizing stochastic gradients and model parameters. In this paper, to reduce the communication complexity, we propose \emph{double quantization}, a general scheme for quantizing both model parameters and gradients. …
We consider the problem of estimating the arithmetic average of a finite collection of real vectors stored in a distributed fashion across several compute nodes subject to a communication budget constraint. Our analysis does not rely on any statistical assumptions about the source of the vectors. This problem arises as…
Across many scientific domains, there is a common need to automatically extract a simplified view or coarse-graining of how a complex system's components interact. This general task is called community detection in networks and is analogous to searching for clusters in independent vector data. It is common to evaluate …
This paper explores ML in power line communications, from modeling to diagnostics.
problem Improving efficiency and diagnostics in power line communications.
method Discusses classical ML models and their application to PLC at various layers.
result Demonstrates how ML can enhance various aspects of PLC.
The paper analyzes distributed Bayesian inference and its Frequentist guarantees.
problem Analyzing large decentralized datasets with distributed Bayesian inference.
method Establishes Frequentist properties for distributed (non-)Bayesian inference.
result Distributed Bayesian inference retains parametric efficiency and enhances robustness.
Simulated Bifurcation outperforms quantum machines in community detection.
problem Community detection in complex networks
method Quantum-inspired Simulated Bifurcation algorithm for QUBO formulation
result Simulated Bifurcation achieves highest modularity in community detection
New method reduces regret and communication costs in federated Q-learning.
problem Worst-case regret and communication cost bounds in federated Q-learning.
method Gap-dependent analysis leveraging MDP structures.
result Achieves log T \log T log T -type regret and communication cost bounds. The paper explores distributed learning with minimal communication in high-dimensional settings.
problem Learning in high-dimensional settings with sublinear communication.
method Combining mirror descent with randomized sparsification/quantization of iterates.
result It is possible to learn a d d d -dimensional model in the distributed setting with logarithmic communication in d d d . The paper reviews methods for determining the number of communities in network data.
problem Determining the number of communities in network data.
method Statistical methods for hypothesis testing and clustering in network models.
result SCORE and NCV methods evaluated for clustering in Degree-Corrected Block Models, with NCV facing challenges.
Paper proposes MLPCD for protein community detection in large PPI networks.
problem Identifying reliable protein communities from large-scale PPI networks.
method Integrates Gene Expression Data and uses Multi-source Learning with cloud computing.
result Demonstrates superior performance compared to existing methods.
Community recovery is a central problem that arises in a wide variety of applications such as network clustering, motion segmentation, face clustering and protein complex detection. The objective of the problem is to cluster data points into distinct communities based on a set of measurements, each of which is associat…
Paper tackles invariance of demodulation in shallow water acoustic communications.
problem Frequency-selective signal distortion (Doppler effect) in shallow water environments.
method Developed ML-based demodulation methods using DBN-NN and DBN-CNN.
result Demonstrated invariance of the proposed method to Doppler effect with 2dB error margin.
Agents cooperate to make decisions in multi-armed bandits over a graph.
problem Optimizing decisions in multi-agent multi-armed bandits with shared information.
method Designs consensus-based distributed estimation and cooperative algorithms for group decision-making.
result Achieves group performance close to centralized fusion center.
Paper studies collaboration in multi-armed bandits with limited interaction.
problem Identifying the best arm collaboratively with limited communication.
method Developed techniques to quantify and prove round-speedup tradeoffs.
result Almost tight round-speedup tradeoffs for distributed exploration.
Paper explores DNNs in modulation recognition with channel effects and adversarial attacks.
problem Automatic modulation recognition in wireless communications.
method Deep neural networks applied to channel models and adversarial perturbations.
result Impact of channel variations and adversarial attacks on DNN performance.