Proposes private model aggregation methods to enhance machine learning models without sharing client data.
problem Lack of sufficient data for new clients in SaaS companies.
method Two private model aggregation approaches based on differential privacy techniques.
result Private model aggregation enables data utility and privacy guarantees.
G-PATE generates private data with high utility using teacher-discriminator aggregation.
problem Privacy concerns in large-scale data sharing for machine learning.
method Generative adversarial nets combined with private gradient aggregation among discriminators.
result Significantly improves privacy budget efficiency and data utility.
Proposes a method for private aggregation in heterogeneous federated learning.
problem Ensuring resilience to Byzantine clients and maintaining client data privacy in federated learning with heterogeneous data.
method Careful co-design of verifiable secret sharing, secure aggregation, and private information retrieval scheme.
result Achieves information-theoretic privacy guarantees and Byzantine resilience under data heterogeneity.
A system for federated learning with private data, adding discrete Gaussian noise and secure aggregation.
problem Training models on private data distributed across devices while ensuring privacy.
method Discretizes data, adds discrete Gaussian noise, and uses secure aggregation to protect privacy.
result Matches the accuracy of central differential privacy with less than 16 bits of precision per value.
Efficiently private clustering algorithms with tight approximation ratios.
problem Differentially private clustering of various types.
method Efficient algorithms achieving tight approximation ratios for clustering problems.
result Achieves approximation ratios similar to non-private algorithms with small additive errors.
Bounds on Littlestone dimension for private learning and online prediction.
problem Understanding the Littlestone dimension of composed classes for private learning.
method Deriving bounds on Littlestone dimension and transforming private learners.
result Improved bounds on sample complexity for private learning.
This paper addresses privacy in federated learning with wireless clients and base stations.
problem Privacy of clients' data in federated learning with hierarchical wireless architecture.
method Derives communication cost limits and introduces private aggregation schemes tailored for hierarchical wireless systems.
result Private aggregation schemes reduce communication costs by multiplicative factors compared to information-theoretic limits.
New protocol makes federated learning more scalable and private.
problem Securely aggregate data from distributed, private datasets.
method Proposes a new protocol for aggregation in the shuffled model that is more efficient in terms of communication and error.
result Achieves differential privacy guarantees with polylogarithmic scaling in the number of users.
Combines public and private data for better statistical estimation.
problem Estimating aggregate statistics from mixed data with varying privacy needs.
method Mixed estimators optimized for minimizing variance or median, using differential privacy techniques.
result Our mechanisms often outperform baseline methods in empirical tests.
New methods reduce private federated learning communication automatically.
problem Reducing communication in private federated learning.
method Automatic compression rate adjustment based on training error, using secure aggregation and differential privacy.
result Provable instance-optimal for mean estimation, achieving favorable compression rates.
This paper adapts PATE for semantic segmentation while maintaining privacy.
problem Preserving privacy in medical machine learning, especially for sensitive information.
method Adapting PATE for semantic segmentation using low-dimensional representations and low-sensitivity queries.
result An Autoencoder-based PATE variant achieves a higher Dice coefficient for the same privacy guarantee.
The paper addresses privacy in rank aggregation using randomized responses.
problem Preserving privacy while aggregating pairwise rankings.
method Adaptive debiasing method for randomized response rankings.
result Established minimax rates for estimation errors and optimal privacy guarantees.
The paper proposes a method to learn differentially private variational autoencoders with term-wise gradient aggregation.
problem Learning variational autoencoders with differential privacy constraints and multiple divergences.
method Term-wise Differentially Private SGD (DP-SGD) that crafts randomized gradients for each loss term, keeping sensitivity at O(1).
result The method reduces the amount of noise needed for differential privacy, allowing better learning.
Proposes a method to generate private synthetic data in a decentralized setting using correlated noise.
problem Challenges of generating private synthetic data in a decentralized setting with limited client data.
method Integrates CAPE protocol into federated DP-CDA framework to generate anti-correlated noise.
result Improves privacy-utility trade-off in federated setting compared to centralized approach.
Paper addresses privacy and robustness in stochastic linear bandits.
problem Stochastic linear bandits with differential privacy and adversarial robustness.
method Logarithmic batch queries, arm elimination algorithm, two privacy models.
result First algorithms providing differential privacy and adversarial robustness.
PATE scales to large-scale learning tasks with improved privacy and utility.
problem Privacy concerns in machine learning models trained on sensitive data.
method Private Aggregation of Teacher Ensembles (PATE) with new noisy aggregation mechanisms.
result Improved scalability and stronger privacy guarantees for PATE.
Improved private geometric median estimation with nearly-linear time complexity.
problem Estimating the geometric median of a dataset while maintaining privacy.
method Improved algorithm using subsampling and geometric aggregation, achieving nearly-linear runtime.
result Achieves the same approximation quality as previous methods but with nearly-linear runtime.
Myelin framework trains deep learning models on private data.
problem Training deep learning models on private data without revealing the data.
method Combines privacy-preserving techniques like differential privacy and trusted hardware enclaves.
result Establishes a baseline for fully private machine learning performance.
Federated learning is protected against adversarial attacks with residual-based reweighting.
problem Adversarial attacks on federated learning's aggregation process.
method Residual-based reweighting combined with iteratively reweighted least squares.
result Our aggregation algorithm outperforms other methods in label-flipping and backdoor attacks.
We empirically test the effects of unanticipated fiscal policy shocks on the growth rate and the cyclical component of real private output and reveal different types of asymmetries in fiscal policy implementation. The data used are quarterly U.S. observati ons over the period 1967:1 to 2011:4. In doing so, we use both …
Secure submodel learning protects privacy in federated learning.
problem Efficiency and privacy in federated learning for resource-constrained clients.
method Designing a secure federated submodel learning scheme with randomized response, secure aggregation, and Bloom filter.
result Demonstrated the feasibility and scalability of the scheme with practical evaluations.
Enhances privacy in federated learning with Laplacian smoothing.
problem Protecting data privacy in federated learning while maintaining model accuracy.
method Laplacian smoothing for differentially private federated learning (DP-Fed-LS).
result Improves model accuracy with differential privacy guarantee and membership privacy.
DPpack offers R tools for private data analysis and machine learning.
problem Ensuring privacy in statistical analysis and machine learning.
method Differential privacy mechanisms (Laplace, Gaussian, exponential).
result User-friendly implementation of privacy-preserving models.
A framework for private causal effect estimation without structural assumptions.
problem Estimating causal effects from private observational data.
method Model-agnostic framework that privatizes predictions and aggregation steps.
result Maintains competitive performance under realistic privacy budgets.
Locally private reinforcement learning protects individual environments from reverse engineering.
problem Protecting private information in distributed reinforcement learning environments.
method Locally differentially private algorithms that protect local agents' models from adversarial reverse engineering.
result Demonstrated that the proposed algorithm performs well under local differential privacy (LDP).
Secure Aggregation protocols allow a collection of mutually distrust parties, each holding a private value, to collaboratively compute the sum of those values without revealing the values themselves. We consider training a deep neural network in the Federated Learning model, using distributed stochastic gradient descen…
BAFFLE uses blockchain to federate learning without a central aggregator.
problem Infeasibility of orchestrating a centralized aggregator in federated learning.
method Blockchain-driven, decentralized coordination via Smart Contracts.
result Significant reduction in gas costs and scalability for federated learning on blockchain.
Private equity deals predict public market returns with up to 70% accuracy.
problem Predicting public market behavior from private equity transactions.
method Logit model using detailed analysis of private equity diligence process.
result Model predicts public market returns with up to 70% accuracy in specific sectors.
Our work specifies the fundamental cost of using secure aggregation in federated learning.
problem Training a distributed model with differential privacy constraints.
method Characterized the communication cost required for optimal accuracy under differential privacy, achieved by a linear scheme.
result The fundamental communication cost is $ ilde{O}\left( \min(n^2\varepsilon^2, d)
ight)$ bits per client, both sufficient and necessary.
We consider a group of Bayesian agents who try to estimate a state of the world θ through interaction on a social network. Each agent v initially receives a private measurement of θ: a number Sv picked from a Gaussian distribution with mean θ and standard deviation one. Then, in each discrete time iteration,…
AdaDPSyn generates synthetic examples to protect private data in ICL.
problem Protecting private data in in-context learning with large language models.
method Data-adaptive differentially private algorithm that dynamically adjusts noise level based on data properties.
result AdaDPSyn outperforms existing methods in preserving high ICL accuracy while maintaining differential privacy.
Differentially private weighted sampling improves privacy while maintaining utility.
problem Ensuring privacy in datasets with key-value pairs while preserving analytical utility.
method Private Weighted Sampling (PWS) that ensures element-level differential privacy.
result Significant performance gains in key reporting and estimation accuracy compared to prior methods.
Individual choices are either based on personal experience or on information provided by peers. The latter case, causes individuals to conform to the majority in their neighborhood. Such herding behavior may be very efficient in aggregating disperse private information, thereby revealing the optimal choice. However if …
Noise-aware Bayesian inference framework for locally private data collection.
problem Privacy-preserving data collection with non-trustworthy aggregators.
method Noise-aware probabilistic modeling framework for Bayesian inference under LDP.
result Demonstrated efficacy in parameter estimation for various distributions and regression models.
Generative models help debug data issues in private, decentralized datasets.
problem Manual data inspection is impractical for private, decentralized datasets.
method Differentially private federated generative models.
result Generative models can effectively debug data issues in private datasets.
Differentially private learning avoids iterative optimization in parameter space.
problem Differentially private training of neural networks
method Hypernetworks trained on public datasets
result Significantly reduces noise in parameter space
This work enables privacy-preserving model learning from single samples per client.
problem Learning from devices with only one sample each, especially in early rounds.
method Injects a single, calibrated noisy perturbation to transform data, then aggregates and processes for unbiased gradient update.
result Enables accurate, privacy-preserving model learning from devices with limited data.
Nowcasts consumption and investment from Turkish bank transactions for real-time GDP.
problem Lack of timely data for GDP nowcasting in Turkey.
method Used aggregated bank transactions to replicate quarterly national accounts data.
result Bank transaction data successfully nowcasts Turkish GDP, especially useful for countries with long data lags.
New method for private learning with fairness constraints.
problem Rate-constrained optimization under differential privacy.
method RaCO-DP, a DP variant of SGDA solving Lagrangian formulation.
result Empirical results show RaCO-DP outperforms existing methods.
Privacy-preserving prediction methods require more data but can be optimized.
problem Ensuring privacy of individual predictions in machine learning models.
method Formulated and analyzed privacy-preserving prediction methods for classification and regression.
result Optimized privacy-preserving prediction methods for thresholds and convex regression.
EIGAN learns private representations without centralized data, outperforming state-of-the-art.
problem Private representation learning with multiple ally and adversary attributes.
method Exclusion-Inclusion Generative Adversarial Network (EIGAN) and Distributed EIGAN (D-EIGAN).
result EIGAN and D-EIGAN outperform state-of-the-art methods in accuracy and scalability.
New games model strategic interactions in incomplete information settings.
problem Modeling strategic interactions in incomplete information settings.
method Introduced new games that map input to private player types, aggregate strategies, and converge to near-Nash equilibria.
result Games can recover meaningful strategic interactions from real data.
Federated Learning prioritizes client data contributions for better model quality.
problem Privacy concerns and reluctance to share private data in machine learning.
method Prioritizes client data contributions in Federated Learning by assigning scores based on defined criteria.
result The proposed approach yields a higher quality global model compared to standard Federated Learning.
Develops privacy-preserving methods for longitudinal linear regression.
problem Protecting individual information in longitudinal data with privacy-preserving statistics.
method Proposes a user-level private regression estimator and a privatized covariance estimator for longitudinal linear regression under user-level differential privacy.
result Establishes theoretical guarantees for practical user-level differential privacy estimation and inference in longitudinal linear regression.
Paper addresses DP-SCO on heavy-tailed data, providing methods and results.
problem Designing DP algorithms for SCO on heavy-tailed data.
method Sample-and-aggregate framework, gradient smoothing and trimming.
result Achieved DP guarantees for various loss functions with different excess population risks.
Secure aggregation for buffered asynchronous federated learning without TEEs.
problem Privacy and convergence in buffered asynchronous federated learning.
method Developed a new protocol (BASecAgg) that ensures privacy without TEEs by carefully designing masks.
result BASecAgg achieves similar convergence guarantees as FedBuff without TEEs.
Privacy-preserving inference for clinical trials using differential privacy.
problem Balancing knowledge sharing and privacy in healthcare data.
method Differential privacy (DP) applied to log-linear belief updates in distributed settings.
result Differentially private, distributed inference methods outperform existing techniques.
New algorithms achieve stable and private predictions with reduced sample complexity.
problem Achieving stable and private predictions in binary classification.
method Developed new algorithms for stable and private prediction, reducing sample complexity.
result Achieved stable and private predictions with reduced sample complexity for VC dimension d.