Differentially private weighted sampling improves privacy while maintaining utility.
problem Ensuring privacy in datasets with key-value pairs while preserving analytical utility.
method Private Weighted Sampling (PWS) that ensures element-level differential privacy.
result Significant performance gains in key reporting and estimation accuracy compared to prior methods.
AriaNN enables private deep learning with minimal interaction and reduced key sizes.
problem Private deep learning with minimal interaction and reduced key sizes.
method Semi-honest 2-party computation protocol with function secret sharing, optimized primitives for neural network operations.
result Efficient private comparison for ReLU operations with reduced key size and improved performance.
Private algorithms adapt from public to private domains with minimal labeled data.
problem Adapting from a public source domain to a private target domain with few labeled data.
method Differentially private discrepancy minimization algorithms based on Frank-Wolfe and Mirror-Descent methods.
result Effective adaptation with strong generalization and privacy guarantees.
A new model protects deep learning models from GAN attacks.
problem Vulnerability of collaborative learning to GAN attacks.
method Introduces a key-based classification model and a training scheme using private keys.
result Resilient against GAN attacks without increasing model complexity.
Dynamic model considers private asset markets' complexities.
problem Understanding and optimizing private asset allocation.
method State-of-the-art dynamic model with machine learning.
result Optimal investment policies quantified over fund life.
Differentially private hyperparameter tuning improves privacy in machine learning.
problem Hyperparameter tuning leaks private information through selected configurations.
method Local Bayesian optimization using Gaussian Process surrogate for private gradient approximation.
result DP-GIBO converges to locally optimal hyperparameters with polynomial dimensional dependence.
DiPriMe forests use private medians to create balanced tree splits for privacy-protected data.
problem Privacy concerns in training random forests due to multiple data queries.
method Proposes DiPriMe forests, which use a private median to generate balanced splits, ensuring differential privacy.
result DiPriMe forests achieve high utility while maintaining differential privacy, as shown both theoretically and empirically.
New algorithm learns Gaussian mixtures privately with optimal sample complexity.
problem Learning parameters of Gaussian mixtures under differential privacy constraints.
method Differentially private algorithm based on Achlioptas and McSherry's approach.
result Sample complexity matches non-private algorithm up to lower order terms.
Private learning can perform well in high dimensions, contrary to known results.
problem When does differentially private learning not suffer in high dimensions?
method Introduced a condition called restricted Lipschitz continuity to derive improved bounds for excess empirical and population risks.
result Gradients in private fine-tuning of large models are mostly controlled by a few principal components, similar to conditions for convex settings.
Gradient clipping helps private SGD converge despite potential bias.
problem Gradient clipping in private SGD can bias convergence.
method Theoretical analysis and empirical evaluation of gradient clipping effects.
result Gradient clipping can prevent convergence to stationary points and introduces bias.
Optimizes differentially private kernel learning with random projection.
problem Privacy-preserving learning algorithms with optimal performance.
method Differentially private kernel ERM algorithm based on random projection in reproducing kernel Hilbert space.
result Achieves minimax-optimal excess risk rates for various loss functions.
This work makes federated Bayesian learning differentially private.
problem Privacy concerns in federated learning with diverse data and computational constraints.
method Modified Partitioned Variational Inference (PVI) to ensure differential privacy.
result Moderately private logistic regression models can be learned in the federated setting with similar performance to non-privately trained models.
Polynomial-time algorithm estimates mean with bounded covariance using differential privacy.
problem Estimating mean of a d-variate distribution with differential privacy constraints.
method Sum of Squares (SoS) exponential mechanism for polynomial-time differentially private estimation.
result First polynomial-time algorithm with O(d) samples for mean estimation under pure differential privacy. A key factor in developing high performing machine learning models is the availability of sufficiently large datasets. This work is motivated by applications arising in Software as a Service (SaaS) companies where there exist numerous similar yet disjoint datasets from multiple client companies. To overcome the challen…
Private estimation of many quantiles using differential privacy.
problem Estimating quantiles of a distribution privately.
method Two approaches: 1) Private estimation of empirical quantiles, 2) Uniform density estimation.
result There is a tradeoff between estimating quantiles at specific points and uniformly estimating the quantile function.
New algorithms learn graph structures privately, matching best results.
problem Private learning of graph structures with multiple blocks.
method Sum-of-squares relaxation and exponential mechanism for score function.
result Matches statistical utility of previous best non-private methods.
In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations are key components of many processing pipelines. In the distributed setting, diff…
Locally private algorithm improves online federated learning with correlated noise.
problem Privacy-preserving online federated learning with non-IID data.
method Locally differentially private algorithm using temporally correlated noise.
result Established dynamic regret bound for nonconvex loss functions.
A framework for private prediction sets using conformal prediction and differential privacy.
problem Jointly addressing reliability and privacy in machine learning predictions.
method Split conformal prediction with privatized quantile subroutine.
result Private prediction sets can be generated from privately-trained models.
Paper proposes a privacy-preserving method to control false discoveries.
problem Protecting individual information in hypothesis tests while controlling false discoveries.
method Differentially private adaptive FDR control method with privacy guarantee.
result The method controls the FDR metric exactly at a user-specified level with privacy.
Private equity deals predict public market returns with up to 70% accuracy.
problem Predicting public market behavior from private equity transactions.
method Logit model using detailed analysis of private equity diligence process.
result Model predicts public market returns with up to 70% accuracy in specific sectors.
AdaDPSyn generates synthetic examples to protect private data in ICL.
problem Protecting private data in in-context learning with large language models.
method Data-adaptive differentially private algorithm that dynamically adjusts noise level based on data properties.
result AdaDPSyn outperforms existing methods in preserving high ICL accuracy while maintaining differential privacy.
Google Trends data improves economic forecasts of private consumption.
problem Improving economic forecasts of private consumption.
method Machine learning techniques applied to categorized Google search data.
result Google data can identify patterns to generate a leading indicator in real time.
A new framework for private Bayesian tests maintains interpretability and computational efficiency.
problem Lack of interpretability and inability to quantify evidence in confidential data.
method Differentially private Bayesian tests based on test statistics.
result Established results on Bayes factor consistency under the proposed framework.
Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for practical problems. As machine learning becomes commonplace, Bayesian optimization bec…
First private Bayesian optimization algorithm with provable performance.
problem Privacy-preserving Bayesian optimization in outsourced settings.
method Random projection-based transformation to preserve privacy and distances.
result Regret bound similar to non-private GP-UCB established for PO-GP-UCB.
Novel privatization framework for high-dimensional variable selection with differential privacy.
problem High-dimensional controlled variable selection with rigorous FDR control under differential privacy constraints.
method Gaussian Johnson-Lindenstrauss Transformation for privatizing the knockoff matrix.
result The proposed private variable selection procedure maintains statistical power even under strict privacy budgets.
Users of a personalised recommendation system face a dilemma: recommendations can be improved by learning from data, but only if the other users are willing to share their private information. Good personalised predictions are vitally important in precision medicine, but genomic information on which the predictions are…
DP-PCA improves privacy in PCA computations with optimal statistical error.
problem Differentially private principal component analysis with sub-linear sample complexity.
method Private minibatch gradient ascent with private mean estimation.
result Achieves optimal statistical error rates for sub-Gaussian data with n=ildeO(d) samples. InstaHide encrypts images for privacy in distributed learning.
problem Private training of deep neural networks on distributed data.
method Encryption of training images with one-time secret keys and pixel-wise masks.
result Preserves privacy with minor accuracy loss, secure against known attacks.
Paper explores how non-neural simulators can enhance DP synthetic data generation.
problem Generating differentially private synthetic data without access to foundation models.
method Private Evolution (PE) framework using inference APIs and simulators.
result Sim-PE framework improves downstream classification accuracy and FID scores.
D2P-Fed improves privacy and communication in federated learning.
problem Achieving both differential privacy and communication efficiency in federated learning.
method Applying discrete Gaussian noise to private data transmission.
result D2P-Fed outperforms state-of-the-art by 4.7% to 13.0% in model accuracy with one-third less communication cost.
New algorithm for differential private kernel bandits with improved regret bounds.
problem Contextual bandits with differential privacy constraints.
method Proposes a private kernel-ridge regression estimator using random projections.
result Achieves state-of-the-art cumulative regret bounds in both joint and local models of differential privacy.
A new method for private query release using Johnson-Lindenstrauss projection.
problem Private release of query answers with minimal privacy loss.
method Random projection of query answers to a lower dimension, followed by noise addition.
result Optimal worst-case sample complexity for answering a workload of k queries.
We present a framework to learn privacy-preserving encodings of images that inhibit inference of chosen private attributes, while allowing recovery of other desirable information. Rather than simply inhibiting a given fixed pre-trained estimator, our goal is that an estimator be unable to learn to accurately predict th…
This paper operationalizes the Exponential Mechanism using Normalizing Flows for private optimization.
problem Improving privacy in machine learning while maintaining accuracy and efficiency.
method Using Normalizing Flows to approximate sampling from the Exponential Mechanism for private optimization.
result ExpM+NF provides more privacy than non-private SGD but not as much as DPSGD.
Privacy concern has been increasingly important in many machine learning (ML) problems. We study empirical risk minimization (ERM) problems under secure multi-party computation (MPC) frameworks. Main technical tools for MPC have been developed based on cryptography. One of limitations in current cryptographically priva…
We develop a privacy-preserving method to summarize distributed datasets under covariate shift.
problem Constructing a training dataset from multiple private sources that matches a target task without privacy leakage.
method Introduced a novel protocol using hash functions and differential privacy mechanisms to minimize private information access.
result Achieved strong differential privacy guarantees while closely matching the performance of non-private greedy algorithms.
Differentially private log-location-scale regression models improve privacy in statistical analysis.
problem Ensuring privacy in statistical regression models while maintaining accuracy.
method Integrates differential privacy into LLS regression using the functional mechanism.
result Proposed DP-LLS models satisfy ε-differential privacy and perform well under various conditions.
CryptoNAS improves PI accuracy by 3.4% with 2.4x less latency.
problem Private inference on machine learning models with limited latency.
method Developed CryptoNAS, a novel NAS method for finding models that maximize accuracy within a ReLU budget.
result Improves accuracy by 3.4% and latency by 2.4x over state-of-the-art methods.
A new mechanism for differentially private Fréchet mean on SPD matrices.
problem Privacy-preserving statistical summaries for SPD matrices.
method Tangent Gaussian mechanism for log-Euclidean metric.
result Significantly better utility and computational efficiency.
AdOBEst-LDP improves privacy-preserving frequency estimation for categorical data.
problem Estimating categorical distributions online while preserving privacy.
method AdOBEst-LDP uses adaptive randomized response mechanism to enhance future data utility.
result AdOBEst-LDP selects optimal subset for LDP mechanism with high probability.
Polynomial-time algorithm estimates edge density of random graphs with privacy and robustness.
problem Estimating edge density of random graphs while maintaining privacy and robustness.
method Sum-of-squares algorithm for robust edge density estimation and reduction from privacy to robustness.
result Optimal error rate up to logarithmic factors, matching theoretical lower bounds.
AdaPrivate-TS: A differentially private Thompson Sampling algorithm for contextual bandits
problem Private Thompson Sampling for Contextual Bandits
method Combining Thompson Sampling with batched zCDP composition
result Achieves 93-99% of non-private performance at ε ∈ [0.5, 5] with logarithmic privacy cost
Proposes a differentially private bandit algorithm reducing noise over time.
problem Privacy concerns in interactive recommendation systems.
method Tree-based mechanism to add Laplace or Gaussian noise to model parameters, focusing on dynamic global sensitivity.
result Demonstrates (ε,δ)-differential privacy with reduced noise and improved regret. Enhances privacy in federated learning with Laplacian smoothing.
problem Protecting data privacy in federated learning while maintaining model accuracy.
method Laplacian smoothing for differentially private federated learning (DP-Fed-LS).
result Improves model accuracy with differential privacy guarantee and membership privacy.
Pruning neural networks adds differential privacy noise, preserving data utility.
problem Achieving differential privacy in neural networks without sacrificing data utility.
method Proving equivalence between pruning and adding differential privacy noise to hidden-layer activations.
result Pruning can be a more effective alternative to adding differential privacy noise for neural networks.
Improved method for private quantile estimation in datasets with atoms.
problem Private estimation of quantiles in datasets with atoms.
method Application of Inverse Sensitivity mechanism and Heuristically Smoothed JointExp.
result Improved performance on datasets with atoms compared to existing methods.