This paper develops a federated EM algorithm for unsupervised learning of mixture models.
problem Theoretical foundations of unsupervised federated learning are lacking.
method Introduces a federated gradient EM algorithm (FedGrEM) for unsupervised learning of mixture models.
result Theoretical analysis shows FedGrEM outperforms local single-task learning.
Improved federated learning methods for privacy and efficiency.
problem Privacy and efficiency trade-offs in federated learning.
method FedHybrid and FedNewton: improved federated learning algorithms.
result Achieved comparable accuracy to FedSGD with fewer communication rounds.
Paper proposes AggITD for efficient federated hypergradient computation.
problem Computing hypergradient in federated settings is challenging due to distributed and nonlinear construction of global Hessian matrices.
method AggITD: a novel communication-efficient federated hypergradient estimator via aggregated iterative differentiation.
result AggITD achieves the same sample complexity as AID-based approaches but with fewer communication rounds, especially in heterogeneous data environments.
New approach estimates treatment effects from decentralized data.
problem Estimating treatment effects from multiple studies with limited data.
method Three classes of ATE estimators derived from Plug-in G-Formula.
result Asymptotic variance of estimators for linear models derived.
Paper explores differential privacy in high-dimensional federated learning, tackling server trustworthiness and estimation.
problem Maintaining privacy in distributed environments with high-dimensional data.
method Investigates scenarios with untrusted and trusted central servers, introduces novel federated estimation algorithms for linear regression models.
result Tight minimax rates depend on high-dimensionality even with sparsity assumptions, and novel algorithms handle slight variations among distributed models.
New algorithm reduces dimensionality in federated learning.
problem Estimating central dimension reduction subspace and variable selection in federated learning.
method Federated sparse sliced inverse regression, convex optimization, linearized alternating direction method of multipliers.
result Upper bound of statistical error rate established under heterogeneous setting.
This paper improves federated learning for industrial predictive analytics by accommodating client heterogeneity.
problem Traditional federated models assume homogeneity in degradation processes, which doesn't apply to industrial settings.
method Personalized federated prognostic model using proximal gradient descent algorithm for joint parameter estimation.
result The proposed model enhances performance and provides comprehensive failure time distributions.
Quantum federated learning improves with non-IID data using one-shot communication.
problem Performance degradation in federated learning with non-IID data.
method Quantum algorithms and local density estimators for non-IID data.
result One-shot communication complexity for non-IID quantum federated learning.
New algorithm achieves linear speedup in non-i.i.d. federated bilevel learning.
problem Linear speedup in convergence for non-i.i.d. datasets in federated bilevel optimization.
method Proposes FedMBO with a novel client sampling scheme for non-i.i.d. datasets.
result Achieves a convergence rate of O(1/√(nK) + 1/K + √n/K³/²).
Paper tackles federated learning with privacy, enhancing target data analysis.
problem Heterogeneity and privacy of distributed data in federated learning.
method Formulates federated differential privacy, studies statistical problems under privacy constraints.
result Federated differential privacy offers a balance between privacy and knowledge transfer.
New federated method preserves privacy and estimates treatment effects.
problem Privacy-preserving causal inference for multi-site studies.
method Multiply robust nuisance function estimation, transfer learning.
result Efficient and optimal treatment effect estimation under different scenarios.
Federated learning framework with uncertainty estimation.
problem Uncertainty estimation in federated learning models.
method Infers and distills posterior predictive distributions from clients to server.
result Improved accuracy and reliability in predictions and tasks like OOD detection.
Federated learning method improves covariate shift adaptation for missing target values.
problem Missing target values in federated learning.
method Federated covariate shift adaptation algorithm for missing target output values.
result Asymptotically unbiased and efficient algorithm for federated learning.
FedRD improves risk difference estimation in federated learning for clinical outcomes.
problem Privacy-preserving model co-training in medical research is hindered by server-dependent architectures and focus on relative effect measures.
method FedRD is a server-independent, communication-efficient framework for federated risk difference estimation in distributed survival data.
result FedRD provides valid confidence intervals and hypothesis testing, and is asymptotically equivalent to pooled individual-level analysis.
One-shot federated learning method for prediction sets.
problem Constructing prediction sets in a one-shot federated learning setting.
method Quantile-of-quantiles estimator for one-shot federated learning with privacy.
result Achieves desired coverage and length similar to centralized setting.
This paper introduces LR-FFS for robust feature screening in federated learning under label shift.
problem Label shift challenges in federated learning for high-dimensional classification.
method Unified feature screening framework, label-shift robust federated feature screening (LR-FFS), federated estimation procedure.
result LR-FFS outperforms existing methods in diverse client environments with varying class distributions, sample sizes, and missing data.
This paper analyzes Local SGD for federated learning, achieving both statistical and communication efficiency.
problem Statistical estimation and inference in federated learning with decentralized data.
method Local SGD, a multi-round estimation procedure using intermittent communication.
result Local SGD achieves both statistical efficiency and communication efficiency.
New methods reduce private federated learning communication automatically.
problem Reducing communication in private federated learning.
method Automatic compression rate adjustment based on training error, using secure aggregation and differential privacy.
result Provable instance-optimal for mean estimation, achieving favorable compression rates.
FedIV uses federated GMM for IV analysis in non-i.i.d. data.
problem Efficient IV analysis in non-i.i.d. federated data.
method Federated GMM via FedGDA algorithm.
result Federated solution consistently estimates local moment conditions.
Paper optimizes federated PCA for covariance estimation under privacy constraints.
problem Privacy-preserving covariance estimation in federated learning.
method Federated PCA, matrix version of van Trees' inequality, three-layer spectral decomposition.
result Optimal rates of convergence for central server's estimation, robust to inconsistent local estimators.
Proposes a federated learning approach for industrial asset failure prediction.
problem Lack of data and privacy concerns in industrial prognostics.
method Two-stage federated learning: dimension reduction and parameter estimation.
result Validated the approach using simulated and real data.
PVI combines federated learning and variational inference for probabilistic model training.
problem Federated learning's lack of probabilistic model uncertainty estimation.
method Partitioned variational inference (PVI) framework for federated probabilistic model training.
result PVI unifies fragmented literature and demonstrates effectiveness in various federated settings.
FSGLD improves federated data sampling by correcting noisy gradients.
problem Noisy gradients and delayed communication in federated data.
method Conductive gradients to correct noisy gradients in distributed SGLD.
result FSGLD converges to true posterior even with delayed communication.
New perspective on federated learning as posterior inference, improving optimization.
problem Optimizing global models in distributed learning settings.
method Formulated as posterior inference problem, using MCMC for approximate inference and federated averaging for refinement.
result Federated posterior averaging (FedPA) outperforms existing methods on benchmarks.
Paper studies optimal federated learning for nonparametric regression with privacy constraints.
problem Federated learning for nonparametric regression with heterogeneous differential privacy constraints.
method Proposes distributed privacy-preserving estimators and investigates their risk properties.
result Establishes matching minimax lower bounds for global and pointwise estimation.
Paper proposes a robust method for federated ICA with geometric median aggregation.
problem Federated ICA with permutation ambiguity in client estimations.
method Geometric median aggregation with k-means clustering to resolve permutation ambiguity.
result The method provably remains effective in highly heterogeneous scenarios.
Federated online learning for streaming data with privacy and efficiency.
problem Analyzing continuous, heterogeneous data streams in a privacy-preserving manner.
method Personalized models for each data source, subgroup assumption, penalized renewable estimation, proximal gradient descent.
result Effective model for distributed multi-source streaming data analysis with privacy and efficiency.
Paper proposes a federated learning method for quantile inference with local differential privacy.
problem Federated learning of quantile inference under local differential privacy constraints.
method Local stochastic gradient descent with randomized mechanism for privacy and efficiency.
result Asymptotic normality and functional central limit theorem for the proposed estimator.
FA-HMC improves Bayesian federated learning with rigorous guarantees.
problem Parameter estimation and uncertainty quantification in non-iid distributed data.
method Federated Averaging stochastic Hamiltonian Monte Carlo (FA-HMC) with convergence guarantees.
result FA-HMC achieves better convergence and communication efficiency than existing methods.
Develops an online federated learning framework for classification.
problem Handling streaming data from multiple clients while ensuring data privacy and efficiency.
method Leverages generalized distance-weighted discriminant technique and Majorization-Minimization principle.
result Achieves high classification accuracy, significant computational efficiency, and data security enhancements.
Federated learning on graphs tackles heterogeneity with efficient parameter estimation.
problem Parameter estimation in federated learning with data distribution and communication heterogeneity.
method Joint estimation of parameters using M-estimation framework with fused Lasso regularization, considering graph structure. result Our estimator achieves optimal rate under certain graph fidelity conditions, similar to centralized aggregation.
Paper analyzes minimax risks of personalized federated learning algorithms.
problem Statistical heterogeneity among clients in federated learning.
method Minimax analysis of FedAvg and local training approaches.
result Threshold for optimality between FedAvg and local training depends on data heterogeneity.
Federated Q-learning achieves linear speedup with heterogeneity, improving sample complexity.
problem Collaborative learning in distributed RL settings with limited data sharing.
method Analyzes synchronous and asynchronous federated Q-learning, proposes importance averaging.
result Achieves linear speedup with heterogeneity, robust to local trajectory heterogeneity.
We propose a practical approach based on federated learning to solve out-of-domain issues with continuously running embedded speech-based models such as wake word detectors. We conduct an extensive empirical study of the federated averaging algorithm for the "Hey Snips" wake word based on a crowdsourced dataset that mi…
FMP improves personalized ASR models on private devices.
problem Limited accuracy and privacy in federated fine-tuning of ASR models.
method FMP estimates global and personalized marginal distributions and adjusts NNLM probabilities.
result FMP achieves modest WER reductions on ASR rescoring tasks.
fedCI and fedCI-IOD enable federated causal discovery across diverse datasets with privacy and power enhancements.
problem Causal discovery across multiple datasets with privacy constraints and heterogeneity.
method federated conditional independence test (fedCI) and Integration of Overlapping Datasets (IOD) algorithm extension (fedCI-IOD).
result fedCI-IOD achieves comparable performance to fully pooled analyses, enhancing statistical power and privacy.
Paper explores how to design federated learning protocols that benefit all participants while maintaining privacy.
problem Privacy concerns undermine the accuracy benefits of federated learning in privacy-sensitive domains.
method The paper provides conditions for mutually beneficial federated learning protocols and designs protocols that maximize total utility and accuracy.
result The paper demonstrates that federated learning can be designed to be mutually beneficial, striking a balance between privacy and model accuracy.
FSIR extends SIR for federated learning with privacy and efficiency.
problem Privacy-preserving dimension reduction in federated learning.
method FSIR employs sliced inverse regression with differential privacy and collaborative variable screening.
result FSIR achieves effective dimension reduction and privacy protection in federated learning.
FIRE method improves model performance in federated learning by penalizing fragmentation-induced covariate shifts.
problem Performance degradation in federated learning due to data fragmentation and covariate shift.
method FIRE method accumulates fragmentation-induced covariate shift divergences via approximate Fisher information and uses it as a per-fragment loss penalty.
result FIRE outperforms importance weighting and federated learning benchmarks by up to 5.3% on shifted validation sets.
NGD method uses decentralized network for federated learning.
problem Privacy and reliability in decentralized federated learning.
method NGD method executes gradient descent on a communication-based network.
result NGD estimator can be as efficient as global estimator under certain conditions.
Federated CTMC model estimates bridge deterioration hazards without sharing raw data.
problem Bridge inspection data privacy and cross-organizational data sharing constraints.
method Federated CTMC hazard model with local optimization and FedAvg aggregation.
result Federated model converges on global benchmark parameters without data transfer.
A new algorithm for efficient clustered federated learning.
problem Federated learning with clustered users having different learning tasks.
method Iterative Federated Clustering Algorithm (IFCA) that alternates cluster estimation and model parameter optimization.
result IFCA converges with good initialization and guarantees optimal statistical error rate.
Federated Q-Learning achieves linear regret speedup with low communication cost.
problem Achieving linear regret speedup in federated reinforcement learning without high communication costs.
method Proposed two federated Q-Learning algorithms: FedQ-Hoeffding and FedQ-Bernstein, using event-triggered synchronization, novel step size selection, and concentration inequalities.
result Total regrets achieve linear speedup compared to single-agent counterparts with logarithmic communication cost.
Paper develops Gaussian approximations and bootstrap for federated LSA with trade-off bounds.
problem Analyzing convergence rates and trade-offs in federated linear stochastic approximation.
method Established Berry-Esseen-type bounds for federated LSA, developed multiplier bootstrap for inference.
result First federated Gaussian approximations with explicit trade-off terms and non-asymptotic validity guarantees.
FedIRT enables privacy-preserving psychometric estimation without centralizing data.
problem Privacy and data governance concerns in centralized IRT estimation.
method Federated Item Response Theory (FedIRT) and FedIRT-DP for differentially private estimation.
result FedIRT matches accuracy of centralized estimators while preserving privacy.
This paper tackles efficient federated learning for generalized linear bandits.
problem Limited communication efficiency restricts existing federated learning solutions to linear models.
method Proposes a communication-efficient solution framework using online and offline regression.
result Proves sub-linear regret and communication cost for generalized linear bandits.
We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computational challenges arise in Federated Learning particularly in the presence of heterogeneous data distribution (i.e., data points on different de…
Large-scale collections of electronic records constitute both an opportunity for the development of more accurate prediction models and a threat for privacy. To limit privacy exposure new privacy-enhancing techniques are emerging such as federated learning which enables large-scale data analysis while avoiding the cent…