Paper proposes a privacy-preserving knockoff inference method.
problem Ensuring privacy in model-X knockoff inference.
method Differential privacy framework for knockoff inference.
result Guaranteed FDR control with privacy protection.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Privacy for Free”
FEDMD-NFDP improves federated learning privacy without sacrificing performance.
problem Privacy leakage in federated learning when sharing predictions.
method Noise-Free Differential Privacy (NFDP) applied to federated model distillation.
result FEDMD-NFDP achieves comparable utility and privacy guarantees.
Noisy Max and Sparse Vector are selection algorithms for differential privacy and serve as building blocks for more complex algorithms. In this paper we show that both algorithms can release additional information for free (i.e., at no additional privacy cost). Noisy Max is used to return the approximate maximizer amon…
Geometric Renyi Differential Privacy: Ricci Curvature Characterized by Heat Diffusion Mechanismsstat.ML
Paper develops novel privacy mechanism for Riemannian manifold data using geometric analysis and heat diffusion.
problem Privacy-preserving estimation of generalized Frechet mean on Riemannian manifolds.
method Characterizes Renyi divergence via Harnack inequalities, introduces mechanisms based on heat diffusion and Langevin process.
result Proposes mechanisms for nonnegative and general Riemannian manifolds with detailed utility analyses.
Paper develops methods for fair insurance pricing without direct access to sensitive attributes.
problem Fairness in insurance pricing with restricted access to sensitive attributes.
method Develops statistical methods for estimating discrimination-free premiums using privatized sensitive attributes.
result The proposed methods enable fair insurance pricing while respecting privacy and regulatory constraints.
We consider the problem of Bayesian learning on sensitive datasets and present two simple but somewhat surprising results that connect Bayesian learning to "differential privacy:, a cryptographic approach to protect individual-level privacy while permiting database-level utility. Specifically, we show that that under s…
This work optimizes mean estimation under varying user privacy demands.
problem Mean estimation with heterogeneous privacy levels.
method Proposes an algorithm that is minimax optimal and has near-linear run-time.
result Privacy requirements of the most stringent users dictate overall error rates.
This work optimizes mean estimation under varying privacy constraints.
problem Mean estimation with heterogeneous privacy constraints.
method Proposes an algorithm for mean estimation under different privacy levels for users.
result Shows a saturation phenomenon in performance as privacy levels are relaxed.
New method for privacy amplification without sampling for matrix factorization.
problem Privacy amplification for differentially private model training with matrix factorization.
method Sampling-free bounds based on Rényi divergence and conditional composition.
result Stronger privacy guarantees for small ε, applicable to various matrices.
New algorithm for personalized healthcare with privacy guarantees.
problem Online exploration in reinforcement learning with differential privacy constraints.
method ε-JDP algorithm with privately released exploration bonuses and visitation statistics.
result Regret bound of matching information-theoretic lower bound.
Communication and privacy are two critical concerns in distributed learning. Many existing works treat these concerns separately. In this work, we argue that a natural connection exists between methods for communication reduction and privacy preservation in the context of distributed machine learning. In particular, we…
Privacy can be achieved without cost in overparameterized models.
problem Understanding the performance cost of differentially private gradient descent in overparameterized settings.
method Random features model with quadratic loss.
result Privacy can be obtained for free in the overparameterized regime, not dependent on privacy parameter ε.
Bayesian inference has great promise for the privacy-preserving analysis of sensitive data, as posterior sampling automatically preserves differential privacy, an algorithmic notion of data privacy, under certain conditions (Dimitrakakis et al., 2014; Wang et al., 2015). While this one posterior sample (OPS) approach e…
GRAFFL learns Bayesian models without gradients for federated learning.
problem Privacy protection in federated learning during gradient updates.
method Gradient-free approach using summary statistics from SuffiAE.
result Feasibility and usefulness demonstrated in Gaussian mixture model.
Popular approaches to differential privacy, such as the Laplace and exponential mechanisms, calibrate randomised smoothing through global sensitivity of the target non-private function. Bounding such sensitivity is often a prohibitively complex analytic calculation. As an alternative, we propose a straightforward sampl…
This paper sharpens privacy guarantees for high-dimensional PCA under differential privacy.
problem Understanding the exact privacy loss in high-dimensional PCA with differential privacy.
method Analyzes the exponential mechanism in a model-free setting for high-dimensional PCA.
result Sharp utility and privacy characterizations in high dimensions show the difficulty of detecting a target individual's presence.
Framework reuses pre-trained models for data-free transfer learning.
problem Challenges in retrieving source data for model training.
method Model Recycling Framework for parameter-efficient training.
result Makes multi-source data-free supervised transfer learning possible.
DPpack offers R tools for private data analysis and machine learning.
problem Ensuring privacy in statistical analysis and machine learning.
method Differential privacy mechanisms (Laplace, Gaussian, exponential).
result User-friendly implementation of privacy-preserving models.
A new method to protect enterprise data privacy in AI models.
problem Enterprise data leakage risks in AI models.
method ABack, a training-free mechanism using Hidden State Model.
result Improves privacy utility by up to 15% over strong baselines.
We consider the problem of minimizing a convex risk with stochastic subgradients guaranteeing -locally differentially private (-LDP). While it has been shown that stochastic optimization is possible with -LDP via the standard SGD (Song et al., 2013), its convergence rate largely depends on the learning rate, w…
New method improves FL efficiency by shuffling data, balancing privacy and accuracy.
problem Balancing privacy, communication, and accuracy in federated learning.
method Developed communication-efficient schemes for private mean estimation, combining privacy amplification and shuffled data.
result Achieved same privacy, optimization performance with lower communication cost.
LoRA and privacy: Random projections help but not always.
problem Ensuring differential privacy in LoRA fine-tuning.
method Wishart projection mechanism and noisy variants.
result LoRA is not inherently private, but low-rank fine-tuning can be more private.
Paper improves privacy-utility trade-off in federated learning.
problem Repeated parameter sharing in federated learning leaks private data.
method Proposes a new representation federated learning objective with differential privacy guarantees.
result Algorithm \DPFEDREP\ converges to a global optimal solution with a linear rate and privacy budget-dependent radius.
Strongly universally consistent nonparametric regression and classification with privatised datamath.ST
Paper develops a privacy-preserving nonparametric regression method.
problem Nonparametric regression with local differential privacy constraints.
method Privatised discretisation and Laplace noise applied to feature vectors and responses.
result Strongly universally consistent estimator for regression and classification.
A Sieve-Accelerated Quadrature Method for Exact Privacy Accounting in the 2020 U.S. Decennial Censuscs.CR
Efficiently calculates privacy guarantees for 2020 Census data.
problem Evaluate privacy guarantees for 2020 U.S. Census data releases.
method Sieve-accelerated quadrature method to evaluate tail probabilities of high-dimensional convolutions.
result Achieves 1,824-fold speedup over prior methods while maintaining error tolerances.
New federated conformal prediction method addresses label shift for uncertainty quantification.
problem Label shift in federated learning and its impact on uncertainty quantification.
method Quantile regression-based federated conformal prediction method with privacy constraints.
result Method provides valid coverage of prediction sets and differential privacy guarantees.
The study introduces a holdout-based framework to assess synthetic data fidelity and privacy.
problem Evaluating the quality and privacy of synthetic data solutions for mixed-type tabular data.
method Holdout-based empirical assessment framework measuring fidelity and privacy risk.
result Synthetic data samples are as close to the training as to the holdout data, indicating generalization and independence from individual records.
Privacy-preserving synthetic data from EHRs for learning and inference.
problem Sharing sensitive EHR data while maintaining patient privacy.
method Differentially private normalizing flows for density estimation and variational inference.
result Privacy-preserving synthetic data can yield good utility at a reasonable privacy cost.
Locally private online quantile regression method addresses privacy constraints.
problem Estimating and inferring quantile regression under local differential privacy constraints.
method Developed a finite-alphabet channel where users compute local contributions, apply randomized response, and send reports. A public decoder corrects distortion and reconstructs inputs for averaging.
result Established local privacy, decoder unbiasedness, consistency, asymptotic normality, and inference for scalar contrasts.
Accelerated optimization methods improve robustness and privacy in estimation.
problem Improving robustness and privacy in estimation methods.
method Accelerated gradient methods based on Frank-Wolfe and projected gradient descent, with tailored learning rates and Nesterov's momentum.
result Reduction in iteration complexity, leading to stronger statistical guarantees.
Mixing Times and Privacy Analysis for the Projected Langevin Algorithm under a Modulus of Continuitystat.ML
New bounds for mixing time and privacy in projected Langevin algorithm and noisy SGD.
problem Analyzing mixing times and privacy in projected Langevin algorithm and noisy SGD.
method New bounds derived using PABI framework and optimization problems.
result New bounds for mixing time and privacy in projected Langevin algorithm and noisy SGD, showing dependency on gradient regularity.
We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal regret bounds. In the full-information setting, our results demonstrate that -differential privacy may be ensured for free -- in particular, the reg…
This work develops sampling methods for differential privacy using SHK geometry.
problem Approximating sampling for the exponential mechanism in differential privacy.
method Develops perturbation theory for SHK gradient flows and applies to differential privacy.
result Derives time-dependent Pure-DP guarantees and Approximate-DP certificates.
New method optimizes multiple objectives in A/B testing for AI and clinical trials.
problem Minimizing cumulative regret, maximizing CATE, and ensuring differential privacy in large-scale experiments.
method ConSE and DP-ConSE algorithms for sequential segmentation and elimination, achieving Pareto-optimal frontier.
result Privacy comes 'for free' in our framework, with only asymptotically negligible costs to regret and accuracy.
Paper tackles LDP bandits learning with improved results and sub-linear regret.
problem Contextual bandits learning with LDP privacy constraints.
method Simple black-box reduction frameworks for context-free bandits, extended to GLB.
result First result for BCO with multi-point feedback under LDP, sub-linear regret for GLB.
Optimizes differentially private kernel learning with random projection.
problem Privacy-preserving learning algorithms with optimal performance.
method Differentially private kernel ERM algorithm based on random projection in reproducing kernel Hilbert space.
result Achieves minimax-optimal excess risk rates for various loss functions.
Efficient PI for neural networks without distributional assumptions.
problem No distributional assumptions for efficient predictive inference.
method Differential privacy and linear approximation for leave-one-out models.
result Rigorous coverage guarantees with reduced computation.
New algorithm reduces regret in private online learning with optimal gap-dependent rate.
problem Optimal gap-dependent regret rate for private stochastic decision-theoretic online learning.
method Horizon-free pure-DP algorithm with exponential block partitioning and softmax selection.
result Explicit regret bound of .
Optimal DP model training with public data improves privacy and accuracy.
problem Ensuring privacy while training models with public data.
method Proves optimal error rates for DP model training with public data, develops novel algorithms.
result Optimal error rates can be achieved by using public data or optimal DP algorithms.
TASFAR adapts regression models without labeled source data.
problem Lack of labeled source data for domain adaptation.
method Uses prediction confidence to estimate target label distribution and calibrate source model.
result Substantially reduces errors in various regression tasks.
Proposes a transfer learning framework for sparse SIMs without raw source data.
problem Lack of direct access to raw source data and known link functions in transfer learning.
method Source-data-free framework based on SIM, using summary statistics and a multilayer perceptron.
result Consistent improvements over existing approaches in synthetic and real-world data.
Improves privacy amplification by shuffling for differential privacy.
problem Enhancing privacy guarantees in systems with anonymous data contributions.
method Theoretical and numerical analysis of Rényi differential privacy parameters and privacy amplification by shuffling.
result First asymptotically optimal analysis of Rényi differential privacy parameters for shuffled outputs.
Proposes a privacy-preserving recommendation system using matrix factorization and differential privacy.
problem Privacy leakage in recommendation systems when anonymizing user data is not sufficient.
method Uses matrix factorization and differential privacy via the Gaussian mechanism.
result Demonstrates excellent utility for privacy-preserving recommendation systems.
Improves privacy guarantees by analyzing randomness in privacy-preserving mechanisms.
problem Balancing user privacy and business constraints in privacy-preserving mechanisms.
method Analyzes explicit and implicit randomness in privacy mechanisms and proposes a probabilistic calibration method.
result Proposes privacy at risk, providing stronger privacy guarantees with quantifiable risks.
The paper analyzes and proposes methods for privately sharing individual privacy losses using per-instance differential privacy.
problem The standard differential privacy framework provides a worst-case bound that may not accurately reflect individual privacy losses.
method The paper analyzes per-instance differential privacy and proposes methods to privately and accurately publish per-instance privacy losses.
result The methods privately and accurately publish per-instance differential privacy losses with minimal additional privacy cost.
A new privacy accountant for Gaussian differential privacy measures individual privacy losses.
problem Bounding differential privacy loss for each participant in data analysis.
method Developed a privacy accountant for adaptive compositions of randomised mechanisms using Gaussian differential privacy.
result Provided optimal bounds for the Gaussian mechanism and constructed an approximative individual privacy accountant.
Paper simplifies DP composition for adaptive privacy budgets, enabling better privacy and accuracy in deep learning.
problem Tension between efficiency and flexibility in DP composition theorems.
method Rényi Differential Privacy (RDP) for adaptive privacy budgets, proving simpler composition theorem with smaller constants.
result Practical DP composition for adaptive privacy budgets, enabling better privacy and accuracy in deep learning.
This paper bounds min-entropy leakage for Blowfish privacy using graph symmetries.
problem Bounding min-entropy leakage for Blowfish privacy mechanisms.
method Organizing analysis over symmetrical partitions corresponding to orbits of graph automorphism groups.
result Demonstrates a construction meeting the bound with asymptotic equality, showing tightness.