Cooperative communication plays a central role in theories of human cognition, language, development, culture, and human-robot interaction. Prior models of cooperative communication are algorithmic in nature and do not shed light on why cooperation may yield effective belief transmission and what limitations may arise …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “communication theory”
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theorycs.LG
Optimizes communication in federated learning using rate-distortion theory.
problem Reduces communication cost in federated learning while maintaining model accuracy.
method Applies rate-distortion theory to model updates, proposing distortion as a proxy for accuracy.
result Near-optimal communication reduction, outperforming other methods on a FL benchmark.
Maximizing the speed and precision of communication while minimizing power dissipation is a fundamental engineering design goal. Also, biological systems achieve remarkable speed, precision and power efficiency using poorly understood physical design principles. Powerful theories like information theory and thermodynam…
Analyzes methods for detecting communities in networks.
problem Detecting communities in networks.
method Examined graph theory, reviewed community detection methods, classified them, and evaluated community quality.
result Developed a classification of community detection methods and evaluated their strengths and weaknesses.
Study on communication delays in decentralized learning networks.
problem Optimizing communication latency in decentralized learning networks.
method Utilized network information theory and random geometric graph theory.
result Communication delay scales as O(n^(2-3β)/βlog n).
Paper studies community detection in censored hypergraphs using information theory.
problem Community detection in censored hypergraphs with missing values.
method Information-theoretic approach, polynomial-time algorithm, spectral algorithm with refinement.
result Derives information-theoretic threshold for exact recovery of community structure.
Community detection in graphs has been extensively studied both in theory and in applications. However, detecting communities in hypergraphs is more challenging. In this paper, we propose a tensor decomposition approach for guaranteed learning of communities in a special class of hypergraphs modeling social tagging sys…
Attention to entropic communication improves message decoding and cooperation.
problem Improper weighting in attention mechanisms hinders optimal communication.
method Combining attention and relative entropy (RE) for optimal message encoding and decoding.
result Proper attention communication emerges via weighted RE, aiding optimal protocols.
A new method reduces communication costs in distributed learning.
problem Reduces communication bottlenecks in distributed learning.
method Local SGD with communication-computation overlap and delay-corrected sparse model averaging.
result Theoretical convergence guarantees for smooth non-convex objectives.
Efficiently maximizes AUC with deep nets, reducing communication rounds.
problem Maximizing AUC with deep neural networks in a distributed setting.
method Communication-efficient distributed optimization algorithm for non-convex concave AUC maximization.
result Achieves linear speedup with significantly fewer communication rounds.
The paper analyzes and improves the learning rates of distributed kernel ridge regression.
problem Generalization performance and learning rates of distributed kernel ridge regression.
method The paper derives optimal learning rates for DKRR in expectation and probability, proposes a communication strategy to improve learning performance, and evaluates these through theory and experiments.
result The communication strategy significantly improves the learning performance of DKRR, as demonstrated by both theoretical assessments and numerical experiments.
This study analyzes communication constraints in MoE architectures using information theory.
problem Communication constraints in Mixture-of-Experts (MoE) architectures.
method Developed a rate-distortion characterization of finite-rate gating in MoE architectures using information theory.
result Yielded capacity-aware limits for communication-constrained MoE systems.
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channelsstat.ML
The paper analyzes generalization of noisy iterative algorithms using communication theory.
problem Generalization of models trained by noisy iterative algorithms under different distributions.
method Connecting noisy iterative algorithms to additive noise channels in communication theory.
result Distribution-dependent generalization bounds for noisy iterative algorithms.
New model for clustering dependent community Hawkes processes in temporal networks.
problem Modeling strong dependence and community structure in temporal networks.
method Dependent Community Hawkes (DCH) models combining stochastic block models and Hawkes processes.
result Spectral clustering error bound derived for DCH models.
Edge augmentation connects disconnected graphs by elevating eigenvalues.
problem Connecting disconnected subgraphs in graphs with zero eigenvalues.
method Elevating zero eigenvalues of graph's spectrum to connect subgraphs.
result The algorithm consistently connects graph components, achieving >50% inter-community edges.
Information Theoretic Limits of Exact Recovery in Sub-hypergraph Models for Community Detectionstat.ML
Study information limits for community detection in sub-hypergraphs.
problem Identify limits for exact community detection in sub-hypergraphs.
method Use Fano's inequality to define model parameters and identify success and failure regions.
result Identify regions where algorithms succeed or fail in exact recovery.
Evaluating accuracy of community detection using the relative normalized mutual informationphysics.soc-ph
The Normalized Mutual Information (NMI) has been widely used to evaluate the accuracy of community detection algorithms. However in this article we show that the NMI is seriously affected by systematic errors due to finite size of networks, and may give a wrong estimate of performance of algorithms in some cases. We gi…
Community detection for correlation matricesphysics.data-an
A challenging problem in the study of complex systems is that of resolving, without prior information, the emergent, mesoscopic organization determined by groups of units whose dynamical activity is more strongly correlated internally than with the rest of the system. The existing techniques to filter correlations are …
New approach uses SPG for semantic communication without a known channel model.
problem Designing efficient semantic communication systems without a known channel model.
method Applying Stochastic Policy Gradient (SPG) for reinforcement learning.
result Achieves comparable performance to model-aware approaches with a decreased convergence rate.
Moniqua improves SGD convergence with quantized communication.
problem Efficiently communicating in decentralized SGD with limited bandwidth.
method Modulo quantized communication in decentralized SGD.
result Moniqua converges at the same rate as full-precision communication with less bits.
New estimator for overlapping community detection in graphs.
problem Reconstructing community relations in graphs with overlapping memberships.
method Proposes a new estimator for Mixed-Membership Stochastic Block Model (MMSB) under diverging spiked eigenvalues condition.
result New estimator matches theoretical minimax lower bound on estimation error.
Study uniform learnability of binary classification networks with communication.
problem Learning a network with communication between vertices from uniform ergodic Random Graph Process.
method Introduced structural Rademacher complexity and used martingale method and Marton's coupling.
result Uniform learnability as worst-case theoretical limits for binary classification problems.
New method reduces communication costs in distributed nonconvex optimization.
problem Large communication costs between central server and local workers in distributed learning.
method Communication-compressed AMSGrad for distributed nonconvex optimization.
result Converges to first-order stationary point with same iteration complexity as vanilla AMSGrad.
Spectral method for joint community detection and group synchronization.
problem Jointly detecting communities and synchronizing orthogonal groups in graphs.
method Spectral decomposition followed by CPQR factorization.
result Near-optimal guarantees for exact and stable recovery of cluster memberships and orthogonal transforms.
Distributed Thompson sampling improves regret convergence in constrained communication networks.
problem Maximizing a black-box function with multi-agent Bayesian optimization under communication constraints.
method Distributed Thompson sampling using Gaussian processes, with theoretical bounds on regret convergence.
result Theoretical bounds on Bayesian average and simple regret depend on communication graph structure and are applicable in constrained networks.
Language of Persuasion and Misrepresentation in Business Communication: A Textual Detection Approachcs.CL
The study detects deceptive language in business communication using AI.
problem Deceptive language in business communication.
method Combining classical rhetoric, communication psychology, and linguistic theory with computational textual analysis and transformer models.
result Detection accuracies of over 99% achieved in controlled settings.
Estimating the largest community in a mixed population via sequential sampling.
problem Identifying the largest community in a mixed population with limited sampling.
method Sequential, random sampling of individuals across multiple boxes, optimizing sampling strategy and decision rule.
result Proposed algorithms achieve optimal error probability decay rates under fixed budget constraints.
Simulated Bifurcation outperforms quantum machines in community detection.
problem Community detection in complex networks
method Quantum-inspired Simulated Bifurcation algorithm for QUBO formulation
result Simulated Bifurcation achieves highest modularity in community detection
Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory. An annotated reading list is pro…
This paper discusses the role of risk communication in macroprudential oversight and of visualization in risk communication. Beyond the soar in data availability and precision, the transition from firm-centric to system-wide supervision imposes vast data needs. Moreover, except for internal communication as in any orga…
BEER accelerates decentralized nonconvex optimization to rate.
problem Communication bottleneck in decentralized machine learning.
method Communication-compressed algorithm with gradient tracking.
result Converges at rate, matching uncompressed performance.
Community Detection in Political Twitter Networks using Nonnegative Matrix Factorization Methodscs.SI
Community detection is a fundamental task in social network analysis. In this paper, first we develop an endorsement filtered user connectivity network by utilizing Heider's structural balance theory and certain Twitter triad patterns. Next, we develop three Nonnegative Matrix Factorization frameworks to investigate th…
Community Detection in Cryptocurrencies with Potential Applications to Portfolio Diversificationq-fin.CP
The paper analyzes cryptocurrency returns and uses community detection to create an investment portfolio.
problem Understanding correlations and diversification in cryptocurrency markets.
method Cross-correlation analysis, Louvain community detection, PCA, Random Matrix Theory (RMT).
result Community detection method identifies 15 groups of cryptocurrencies, leading to an optimized investment portfolio.
Beurling-Selberg Extremization for Dual-Blind Deconvolution Recovery in Joint Radar-Communicationscs.IT
Optimal joint separation condition for radar and communications channels in dual-blind deconvolution.
problem Recovering information from overlaid radar and communications signals with unknown channels.
method Extremal functions from Beurling-Selberg interpolation theory for joint separation, nuclear norm minimization for matrix retrieval, and MUSIC for parameter estimation.
result Guaranteed well-conditioned Vandermonde matrix for MUSIC, validating theoretical findings.
New framework for dense weighted networks with community-specific patterns.
problem Dense networks with varying edge weights across communities.
method Proposes a new model with functions mapping node characteristics to edge weights, requiring few parameters.
result Developed a bootstrap methodology for generating new networks.
With the recent advances in complex networks theory, graph-based techniques for image segmentation has attracted great attention recently. In order to segment the image into meaningful connected components, this paper proposes an image segmentation general framework using complex networks based community detection algo…
The paper applies communication theory to improve language model reranking.
problem Ensuring safety and accuracy in language model outputs.
method Drawing parallels between communication theory and language model reranking, the authors propose a protocol to improve reliability.
result The proposed protocol can achieve asymptotically error-free performance in noisy communication scenarios.
FedSKETCH and FedSKETCHGATE improve privacy and efficiency in federated learning.
problem Communication and privacy challenges in federated learning.
method Compression of local gradients using count sketch to protect privacy and reduce communication.
result Sharp convergence guarantees and experimental validation of the methods.
Paper tackles community recovery in binary symmetric SBM graphs.
problem Community detection in binary symmetric SBM graphs.
method Proposes a two-stage iterative method using projected power iterations and orthogonal iterations.
result Proposed method can exactly recover communities with high probability in logarithmic sparsity regime.
Neural-prior stochastic block modelcond-mat.dis-nn
Proposes a new model for community detection using neural priors.
problem Community detection in graphs with node attributes.
method Neural-prior stochastic block model with belief propagation and approximate message passing algorithm.
result Identifies phase transitions and algorithmically hard regions for community detection.
Optimal high-dimensional and nonparametric distributed testing under communication constraintsmath.ST
Optimal distributed testing under communication constraints with shared randomness.
problem Signal detection in a distributed system with limited communication.
method Derivation of minimax testing errors, distributed testing algorithms, and theoretical lower bounds.
result Consistent nonparametric distributed testing is possible even with minimal communication.
Distributed stochastic gradient descent~(DSGD) has been widely used for optimizing large-scale machine learning models, including both convex and non-convex models. With the rapid growth of model size, huge communication cost has been the bottleneck of traditional DSGD. Recently, many communication compression methods …
Community-level Contagion among Diverse Financial Assetsphysics.soc-ph
Study examines financial contagion at community level, finding increased contagion density and widespread transmission.
problem Understanding and managing financial contagion in interconnected markets.
method High-frequency data, Louvain community detection, Vector Autoregression, Tracy-Widom random matrix theory.
result Contagion density increases over time, and there is no significant difference between intra- and inter-community contagion.
MpFL models clients as strategic players to reach equilibrium with less communication.
problem Real-world clients act independently with individual objectives, not aligned with a shared global model.
method MpFL uses game-theoretic modeling and PEARL-SGD algorithm for local updates and communication.
result PEARL-SGD reaches an equilibrium with less communication than non-local updates in stochastic setup.
New sparsification technique for SGD reduces communication costs.
problem High communication costs in distributed SGD for large-scale models.
method Statistical estimation model for sparsity and skewness of stochastic gradients.
result Concatenated top-k and random-k sparsification outperforms individual methods.
The paper proposes a new model to analyze directed networks and accurately estimate community memberships.
problem Modeling and estimating community memberships in directed networks with heterogeneous degrees.
method Directed Degree Corrected Mixed Membership (DiDCMM) model and DiMSC algorithm.
result The proposed DiMSC algorithm is asymptotically consistent and provides error bounds for community membership vectors.
New algorithm detects cores in graphs with community structure, improving vertex selection for better clustering.
problem Understanding and detecting core-periphery structures in graphs with community structure.
method Introduces relative centrality to detect cores in graphs with community and core-periphery structures.
result Relative centrality solves bias issues in core detection, leading to better vertex selection and improved clustering performance.
New method recovers radar and communication signals from overlaid data.
problem Recover radar and communication signals from overlaid data with unknown parameters.
method Propose minimizing the sum of multivariate atomic norms (SoMAN) for multi-antenna receiver.
result Minimum number of samples and antennas required for perfect recovery is logarithmically dependent on the maximum of radar targets and communications paths.