Community detection improves stock market portfolio optimization.
problem Improving portfolio optimization in financial markets.
method Community detection in correlation-based networks of worldwide stock markets.
result Portfolios constructed using community detection outperform traditional methods.
Study on efficient estimation of Gaussian mean with limited communication.
problem Estimating Gaussian mean under communication constraints.
method Decomposition into localization and refinement stages, development of communication-efficient and statistically optimal procedures.
result Established minimax rates of convergence and developed optimal procedures.
New algorithm reduces individual regret and communication costs in cooperative bandits.
problem Optimal individual and group regret in cooperative multi-agent bandits.
method Integrates a new communication policy into a learning algorithm.
result Achieves optimal individual regret and constant communication costs.
New approach reduces communication in distributed optimization.
problem Reduces communication in distributed optimization.
method Each node performs multiple local optimization steps before communication, even for an infinite number of steps.
result Communication can be significantly reduced without sacrificing convergence.
Near-optimal regret in distributed bandit learning with efficient communication protocols.
problem Minimizing total regret in collaborative bandit learning with limited communication.
method Proposed communication protocols for distributed multi-armed and linear bandits with near-optimal regret and efficient communication costs.
result Achieved near-optimal regret with communication costs independent of time horizon and number of arms.
The paper proposes gradient sparsification to reduce communication costs in distributed optimization.
problem Reduction of communication overhead in distributed machine learning.
method Formulates a convex optimization problem to minimize gradient coding length, and proposes simple algorithms for approximate solution.
result The proposed sparsification techniques significantly reduce communication costs without sacrificing accuracy.
Optimized parallel algorithms for identifying strong ties in data.
problem Identifying strong ties in data with varying distances and community sizes.
method Design and analysis of sequential and parallel algorithms for partitioned local depths.
result Optimized algorithms achieve up to 19.4x speedup in parallel execution.
The paper sets communication limits for distributed optimization with feature-based data partitions.
problem Understanding communication limits in distributed convex optimization with feature-based data partitions.
method Developed tight lower bounds on communication rounds for non-incremental and incremental algorithms.
result Established communication limits for a broad class of algorithms under feature-based data partitioning.
DESTRESS optimizes decentralized nonconvex optimization with optimal IFO complexity and efficient communication.
problem Decentralized nonconvex finite-sum optimization in multi-agent systems.
method DESTRESS uses stochastic recursive gradient updates, gradient tracking, and careful hyper-parameter choices to achieve optimal IFO complexity with efficient communication.
result DESTRESS matches the optimal IFO complexity of centralized algorithms while maintaining communication efficiency.
Paper improves communication in distributed optimization, reducing worker-to-server data exchanges.
problem Efficiency in server-to-worker communication in distributed optimization.
method MARINA-P, a novel downlink compression method using correlated compressors; M3, combining MARINA-P with uplink compression.
result MARINA-P achieves provably superior server-to-worker communication complexity with increasing number of workers.
Study explores how to efficiently explore communities with limited budget.
problem Maximizing the number of members met with limited budget in community exploration.
method Systematic study from offline optimization to online learning, including greedy methods and upper confidence algorithms.
result Achieved logarithmic and constant regret bounds in online learning setting.
Efficiently addresses federated learning challenges with reduced communication and sample complexity.
problem Heterogeneity in data volumes and distributions at different clients compromises model generalization ability.
method Introduces algorithms for communication-efficient Federated Group Distributionally Robust Optimization (FGDRO).
result Communication complexity reduced to O(1/ε4) for FGDRO-CVaR and O(1/ε3) for FGDRO-KL. Quantized Frank-Wolfe reduces communication costs in distributed optimization.
problem Efficiently reducing communication overhead in distributed machine learning optimization.
method Quantized Frank-Wolfe (QFW), a projection-free algorithm for constrained optimization.
result Strong theoretical guarantees on convergence rate, efficient compression of gradients.
We optimize distributed learning algorithms to maintain linear convergence with limited communication.
problem Limited communication time affects the convergence of distributed learning algorithms.
method We design quantizers to compress algorithm information while preserving linear convergence and characterize communication time.
result We show how to co-design machine learning and communication protocols for optimal performance.
CyBeR-0 optimizes federated learning with Byzantine resilience and reduced communication costs.
problem Byzantine attacks and communication inefficiency in federated learning.
method Transformed robust aggregation for zero-order optimization under client heterogeneity.
result CyBeR-0 achieves stable performance with minimal communication costs and reduced memory usage.
Rewiring GNNs to optimize community and feature alignment improves their performance.
problem Improving GNNs' performance by addressing over-squashing and generalization issues.
method Three rewiring strategies: ComMa, FeaSt, and ComFy, targeting community structure, node labels, and their alignment.
result Rewiring strategies enhance GNNs' performance by optimizing label-community alignment.
New method reduces communication costs in distributed nonconvex optimization.
problem Large communication costs between central server and local workers in distributed learning.
method Communication-compressed AMSGrad for distributed nonconvex optimization.
result Converges to first-order stationary point with same iteration complexity as vanilla AMSGrad.
Local network community detection is the task of finding a single community of nodes concentrated around few given seed nodes in a localized way. Conductance is a popular objective function used in many algorithms for local community detection. This paper studies a continuous relaxation of conductance. We show that con…
Paper introduces MoTEF for faster decentralized optimization with compressed communication.
problem Efficiency bottleneck in decentralized machine learning applications.
method Integrates communication compression with Momentum Tracking and Error Feedback.
result Significantly outperforms existing methods under arbitrary data heterogeneity.
Paper addresses privacy and communication in distributed learning, achieving optimal performance.
problem Balancing privacy, communication, and accuracy in distributed learning and estimation.
method Developed novel encoding and decoding mechanisms for mean and frequency estimation under local differential privacy and communication constraints.
result Achieved optimal privacy and communication efficiency in mean and frequency estimation.
Study improves communication efficiency in RIS-assisted downlink communication.
problem Improving performance of RIS-aided downlink communication over heterogeneous designs.
method Distributed learning with distributionally robust optimization.
result Our algorithm achieves 50% fewer communication rounds for similar worst-case performance.
Distributed Thompson sampling improves regret convergence in constrained communication networks.
problem Maximizing a black-box function with multi-agent Bayesian optimization under communication constraints.
method Distributed Thompson sampling using Gaussian processes, with theoretical bounds on regret convergence.
result Theoretical bounds on Bayesian average and simple regret depend on communication graph structure and are applicable in constrained networks.
Attention to entropic communication improves message decoding and cooperation.
problem Improper weighting in attention mechanisms hinders optimal communication.
method Combining attention and relative entropy (RE) for optimal message encoding and decoding.
result Proper attention communication emerges via weighted RE, aiding optimal protocols.
Optimizes pipelined computation and communication for edge learning within latency constraints.
problem Balancing data transmission and model training to meet latency requirements.
method Analyzes the optimal packet payload size tradeoff between bias and variance.
result Derives analytical bounds on the expected optimality gap for effective optimization.
Paper presents an algorithm for optimal regret in communicating Markov decision processes.
problem Achieving optimal regret in Markov decision processes with a communicating assumption.
method The algorithm explicitly tracks the constant K(M) to learn optimally, balancing exploration, co-exploration, and exploitation.
result The algorithm achieves asymptotically optimal regret K(M)log(T)+o(log(T)) for communicating Markov decision processes. Study optimizes privacy in distributed optimization, balancing accuracy and communication.
problem Privacy-preserving distributed stochastic convex optimization.
method Distributed algorithm using Vaidya's plane cutting method, with privacy guarantees via differential privacy.
result Complete characterization of accuracy-communication-privacy trade-off.
ComEx protocol reduces communication costs in cooperative bandits.
problem Minimizing communication costs in cooperative bandits while maintaining optimal performance.
method Developed ComEx protocol to reduce communication from Θ(T) to O(logT) messages. result Achieves state-of-the-art performance with significantly reduced communication cost.
New method improves FL efficiency by shuffling data, balancing privacy and accuracy.
problem Balancing privacy, communication, and accuracy in federated learning.
method Developed communication-efficient schemes for private mean estimation, combining privacy amplification and shuffled data.
result Achieved same privacy, optimization performance with lower communication cost.
Study shows market volatility affects optimal communication design for trading strategies.
problem Investigating how communication impacts trading strategy performance in multi-agent systems.
method 5-agent LLM-based trading systems across 450 experiments spanning 21 months, comparing 5 organizational structures.
result Communication improves performance but depends on market characteristics, with competitive conversation excelling in volatile tech stocks.
Optimal gradient quantization reduces communication costs in distributed deep learning.
problem High communication costs in distributed training of deep neural networks.
method Deduced optimal gradient quantization conditions for binary and multi-level quantization, developed novel schemes for dynamic quantization levels.
result Demonstrated superior performance of proposed quantization schemes on CIFAR and ImageNet datasets.
A distributed algorithm reduces communication cost in linear bandits to near-optimal levels.
problem Cooperative linear bandit optimization with stochastic contexts.
method DisBE-LUCB algorithm, DecBE-LUCB algorithm, sharing information through a central server or immediate neighbors.
result Communication cost of DisBE-LUCB matches information-theoretic lower bound up to logarithmic factors.
A new algorithm reduces communication in decentralized optimization.
problem Reducing communication in decentralized optimization problems.
method Adaptive randomized communication-efficient algorithmic framework that periodically tracks disagreement error and selects influential edges for communication.
result Strong theoretical convergence guarantees and performance quantification under standard assumptions.
Proposes COLA, a communication-efficient algorithm for decentralized optimization.
problem Decentralized consensus optimization over a network.
method Linearization and communication-censoring strategy to reduce computation and communication costs.
result Proven convergence and established convergence rates for COLA.
BEER accelerates decentralized nonconvex optimization to O(1/T) rate.
problem Communication bottleneck in decentralized machine learning.
method Communication-compressed algorithm with gradient tracking.
result Converges at O(1/T) rate, matching uncompressed performance. A new algorithm reduces communication rounds for distributed convex optimization.
problem Efficiently solving convex optimization problems in distributed systems.
method Proposes a stochastic Newton algorithm for homogeneous distributed stochastic convex optimization.
result Reduces the number and frequency of communication rounds compared to existing methods.
New algorithm reduces sample and communication complexities in federated Q-learning.
problem Optimal Q-function learning in federated Q-learning with limited communication.
method Introduced Fed-DVR-Q algorithm for order-optimal sample and communication complexities.
result Complete characterization of sample-communication complexity trade-off.
Two new algorithms optimize decentralized convex optimization with reduced communication rounds.
problem Decentralized minimization of smooth strongly convex functions in a network.
method Proposes two new algorithms based on accelerated Forward Backward methods.
result First algorithm is optimal in terms of communication rounds and gradient computations.
Paper proposes AggITD for efficient federated hypergradient computation.
problem Computing hypergradient in federated settings is challenging due to distributed and nonlinear construction of global Hessian matrices.
method AggITD: a novel communication-efficient federated hypergradient estimator via aggregated iterative differentiation.
result AggITD achieves the same sample complexity as AID-based approaches but with fewer communication rounds, especially in heterogeneous data environments.
Optimal client sampling reduces communication in federated learning.
problem Efficiently aggregate model updates from distributed clients in federated learning.
method Model weights as an Ornstein-Uhlenbeck process to estimate uncommunicated updates; optimal client sampling strategy.
result Significant reduction in communication with competitive or superior performance.
Study binary hypothesis testing with privacy and communication constraints.
problem Binary hypothesis testing under local differential privacy and communication constraints.
method Qualifies results as minimax or instance optimal, develops instance-optimal algorithms.
result Achieves minimum possible sample complexity under both privacy and communication constraints.
Optimizes communication in federated learning using rate-distortion theory.
problem Reduces communication cost in federated learning while maintaining model accuracy.
method Applies rate-distortion theory to model updates, proposing distortion as a proxy for accuracy.
result Near-optimal communication reduction, outperforming other methods on a FL benchmark.
New method detects overlapping communities in weighted graphs without pure nodes assumption.
problem Detect overlapping communities in weighted graphs without making pure nodes assumption.
method Convex optimization-based approach for weighted graphs.
result Success on artificial and real-world datasets.
SHIFT method optimally estimates heterogeneous discrete distributions with limited communication.
problem Collaborative learning of discrete distributions under heterogeneity and communication constraints.
method Two-stage method: First, users learn a central distribution; then, fine-tune this to estimate individual distributions.
result SHIFT is minimax optimal in the model of heterogeneity and under communication constraints.
Efficient algorithm reduces communication costs in sparse regression.
problem Sparse linear regression with massive data.
method CESDAR algorithm, communication-efficient surrogate likelihood.
result Achieves same statistical accuracy as global estimator with reduced communication.
A new decentralized algorithm DESTINY solves optimization over Stiefel manifold with single communication round.
problem Decentralized optimization over the Stiefel manifold with private data.
method Gradient tracking with approximate augmented Lagrangian function.
result DESTINY achieves global convergence with a single communication round.
New communication topologies improve deep reinforcement learning efficiency.
problem Optimizing communication topology for faster and more robust learning in deep reinforcement learning.
method Introduced alternative network topologies (Erdos-Renyi random graphs) and compared their performance with fully-connected and star topologies.
result Erdos-Renyi random graphs outperform fully-connected networks in deep reinforcement learning tasks.
A new method reduces communication costs in decentralized optimization.
problem Decentralized optimization with non-convex cost functions.
method LU-GT method with local updates.
result LU-GT achieves the same communication complexity as Federated Learning and maintains solution quality.
Distributed Lion optimizes large model training by reducing communication costs.
problem Training large AI models efficiently with reduced communication costs.
method Adapted Lion optimizer for distributed training, using binary or lower-precision vectors for communication.
result Distributed Lion achieves comparable performance to standard optimizers but with significantly reduced communication bandwidth.