Iterated Amplification uses subproblem solutions to build training signals for complex tasks.
problem Learning complex tasks when humans can't directly evaluate performance.
method Progressively builds training signal by combining solutions to easier subproblems.
result Efficiently learns complex behaviors in algorithmic environments.
Privacy amplification improved through contraction coefficients and Eγ-divergence.
problem Improving privacy guarantees in iterative algorithms.
method Using contraction coefficients derived from Eγ-divergence to determine differential privacy parameters. result Tighter bounds on differential privacy parameters of iterative algorithms.
New sampling scheme improves privacy in DP-SGD without sacrificing utility.
problem Suboptimal privacy amplification due to participation variance in Poisson subsampling.
method Balanced Iteration Subsampling (BIS) with structured randomness.
result BIS achieves stronger privacy amplification than Poisson subsampling and is optimal at both extremes of noise spectrum.
Enhances privacy in machine learning through Rényi Pufferfish mechanisms.
problem Designing general and efficient Pufferfish mechanisms that maintain privacy and utility.
method Introduces a Rényi divergence-based variant of Pufferfish, generalizes the Wasserstein mechanism, and proves privacy amplification results.
result Extends the applicability of Pufferfish framework and provides stronger privacy guarantees.
Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step and then reasoning about the cumulative privacy cost of the algorithm. This is …
New method amplifies privacy in decentralized learning without centralized communication.
problem Privacy amplification in decentralized federated learning.
method Random check-in protocol for DP-SGD in FL.
result Privacy/accuracy trade-offs similar to subsampling/shuffling, but without server-initiated communication.
The paper explores how mixing and diffusion mechanisms can enhance privacy in data processing.
problem Enhancing privacy guarantees of data mechanisms through post-processing.
method The study uses Markov operators and coupling arguments to analyze privacy amplification.
result The introduction of a new family of diffusion-based mechanisms that are closed under post-processing.
Unified framework for subsampling mechanisms with tighter privacy guarantees.
problem Improving privacy in machine learning models through subsampling.
method Conditional optimal transport for deriving mechanism-specific subsampling guarantees.
result Tighter privacy bounds for subsampled mechanisms compared to traditional methods.
Paper proves privacy guarantees for shuffled and online PNSGD, reducing noise over time.
problem Privacy amplification in shuffled and online PNSGD settings.
method Iterative analysis of PNSGD with hidden updates, proving privacy guarantees for shuffled and online settings.
result Privacy guarantees for shuffled and online PNSGD with reduced noise over time.
Behavior cloning training instabilities amplified by SGD noise over long horizons.
problem Training instabilities in behavior cloning with deep neural networks.
method Empirical dissection of minibatch SGD updates and their effects on long-horizon rewards.
result Exponential moving average (EMA) of iterates effectively mitigates gradient variance amplification (GVA).
New analysis shows SGD with noise doesn't leak more privacy with more iterations.
problem Privacy loss in noisy SGD with more iterations.
method Privacy Amplification by Iteration and Sampled Gaussian Mechanism.
result Privacy loss remains constant after a burn-in period, not increasing with more iterations.
Sharp pseudospectral bounds prevent transient amplification in coupled gradient descent.
problem Transient amplification in coupled gradient descent systems.
method Developed a sharp pseudospectral theory for block-triangular Jacobians, proving Kreiss constant bounds and matching minimax lower bounds.
result Obtained a finite-horizon iteration-complexity bound of O(K(J)2log(1/δ)) for stochastic coupled descent. Quantum method speeds up risk estimation for insurance tail risks.
problem Sample-sparsity in classical Monte Carlo methods for tail risk pricing.
method Quantum Amplitude Estimation (QAE) with Grover amplification.
result Quantum method achieves convergence approaching order reciprocal N, enabling high-resolution tail estimation within practical budgets.
New method amplifies hidden structure in complex networks.
problem Difficulty in uncovering hidden structure in complex networks.
method Iterative weakening of dominant structure through randomization.
result Theoretical support for the effectiveness of structure amplification.
New feature selection methods reduce bias amplification in models.
problem Bias amplification in machine learning models.
method Analysis and development of feature selection algorithms.
result Feature-wise bias amplification can be mitigated through targeted feature selection.
We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate posterior distributions, yet each iteration increases the amount of noise that must be …
Improves privacy amplification by shuffling for differential privacy.
problem Enhancing privacy guarantees in systems with anonymous data contributions.
method Theoretical and numerical analysis of Rényi differential privacy parameters and privacy amplification by shuffling.
result First asymptotically optimal analysis of Rényi differential privacy parameters for shuffled outputs.
Advantage amplification helps RL in slow-evolving latent-state environments.
problem Challenges in reinforcement learning for long-horizon latent-state environments.
method Temporal abstraction and aggregation methods to overcome belief state error and small action advantage.
result Proven advantage amplification in settings with slowly evolving latent states.
Mitigates gender bias amplification in model predictions.
problem Gender bias amplification in model predictions.
method Posterior regularization to mitigate bias.
result Almost removes gender bias amplification in model predictions.
Gradient amplification boosts deep learning model performance without increasing training time.
problem Vanishing gradients in deep neural networks.
method Gradient amplification approach to prevent vanishing gradients and training strategy to enable/disable across epochs.
result Improves performance of deep learning models with reduced training time.
Privacy is enhanced by synthetic data release even with unlimited data.
problem Improving privacy guarantees for synthetic data release.
method Analyzing a bounded-parameter assumption to show privacy amplification persists with unlimited synthetic records.
result Privacy amplification is possible even with an unbounded number of synthetic records.
New method shows hidden state can significantly improve differential privacy in SGD.
problem Differential privacy in SGD with hidden state.
method Proves converging privacy bounds for hidden state SGD, using privacy amplification techniques.
result Privacy bound converges exponentially fast and is smaller than composition bounds.
New method improves FL efficiency by shuffling data, balancing privacy and accuracy.
problem Balancing privacy, communication, and accuracy in federated learning.
method Developed communication-efficient schemes for private mean estimation, combining privacy amplification and shuffled data.
result Achieved same privacy, optimization performance with lower communication cost.
Paper improves differential privacy analysis for machine learning.
problem Quantifying privacy leakage in noisy gradient descent.
method Shifted interpolation in f-differential privacy. result First exact privacy analysis for strongly convex optimization.
Quantum algorithm reduces CVA risk-neutral expectation estimation costs.
problem Reducing Monte Carlo sampling cost for CVA on real quantum hardware.
method Noise-aware quantum workflow combining market calibration, discretisation, and oracle construction.
result CABIQAE achieves lower classical post-processing runtime and more effective error exploitation.
Structured subsampling improves privacy in deep time series forecasting.
problem Incompatible privacy guarantees with time series forecasting.
method Structured subsampling of sequential data for privacy amplification.
result Structured subsampling enables training with strong privacy guarantees.
Theoretical study shows AI models can recover from contaminated training data.
problem Data contamination in AI training can degrade model performance.
method Theoretical analysis and experiments on various data types.
result Models converge to true distribution under mild conditions, with rate dependent on real data fraction.
New method for privacy amplification without sampling for matrix factorization.
problem Privacy amplification for differentially private model training with matrix factorization.
method Sampling-free bounds based on Rényi divergence and conditional composition.
result Stronger privacy guarantees for small ε, applicable to various matrices.
The paper develops a theory explaining how machine learning models can amplify biases.
problem Understanding and mitigating bias in machine learning models.
method Analytical theory of ridge regression with and without random projections.
result Observations and predictions align with empirical data on machine learning bias.
GRPO optimizes LLMs with verifiable rewards, amplifying policy success.
problem Improving LLMs' reasoning under verifiable binary rewards.
method Introduces GRPO, analyzes variants of reward normalization and regularization.
result GRPO amplifies policy success, converging to a fixed point exceeding the reference.
Differential privacy comes equipped with multiple analytical tools for the design of private data analyses. One important tool is the so-called "privacy amplification by subsampling" principle, which ensures that a differentially private mechanism run on a random subsample of a population provides higher privacy guaran…
New method estimates graph compatibility from sparse labels.
problem Estimating graph compatibility from sparse labeled data.
method Factorized graph representations and algebraic amplification.
result End-to-end classification accuracy comparable to gold standard.
The paper shows how to amplify small datasets to look like they came from a known distribution.
problem How to increase dataset size when learning from an unknown distribution is impossible.
method Develops amplification procedures to output larger sets of samples that mimic the original distribution.
result Valid amplification procedures exist even when the input dataset is significantly smaller than needed for learning.
We mathematically compare four competing definitions of group-level nondiscrimination: demographic parity, equalized odds, predictive parity, and calibration. Using the theoretical framework of Friedler et al., we study the properties of each definition under various worldviews, which are assumptions about how, if at a…
FLAME improves privacy in federated learning without trusted parties.
problem Ensuring privacy in federated learning without trusted parties.
method FLAME uses the shuffle model of differential privacy to achieve better accuracy and privacy.
result FLAME protocols improve testing accuracy by 60.7% compared to local model FL.
This study quantifies systemic importance in global banks using a continuous framework that amplifies localized shocks.
problem Analyzing financial contagion and systemic risk in global banks.
method Developed a continuous framework incorporating geographic proximity and interbank network linkages, using a master equation and Feynman-Kac representation.
result The amplification factor correctly identifies systemically important institutions and predicts crisis outcomes.
Missing data enhances privacy in differential privacy.
problem Privacy preservation in datasets with missing values.
method Formalized missing data as a privacy amplification mechanism within differential privacy.
result Incomplete data can yield privacy amplification for differentially private algorithms.
The study explains how market-makers' hedging affects stock volatility during gamma-squeeze events.
problem Endogenous volatility amplification in option markets during gamma-squeeze events.
method Developed a theoretical framework linking hedging behavior and market turbulence, incorporating beta-normalized volatility.
result Low-beta stocks amplify volatility more during gamma-squeeze events.
Unified approach amplifies data for distribution property estimation.
problem Estimating properties of discrete distributions efficiently.
method Unified, linear-time, competitive estimator using just 2n samples.
result Achieves performance of empirical estimator with n√log n samples using only 2n samples.
Most of the econometric and econophysics models have been borrowed from the statistical physics, and as a cosequence, a new interdisciplinary science called econophysics has emerged. In this paper we planned to extend the analogy between different economic processes or phenomena and processes and phenomena from differe…
Synthetic data can amplify privacy in linear regression models.
problem Understanding how synthetic data can enhance privacy in linear regression models.
method Investigated through the linear regression framework, analyzing synthetic data generated from random inputs and controlled inputs.
result Releasing a limited number of synthetic data points amplifies privacy beyond the model's inherent guarantees when inputs are random, but not when inputs are controlled by an adversary.
Paper analyzes tech adoption in financial networks, finding key leadership and diffusion dynamics.
problem Understanding technology adoption and network effects in financial systems.
method Developed a spatial-network framework with a master equation and Feynman-Kac representation.
result Found strong support for two-regime adoption dynamics and significant leadership in network central banks.
This work improves privacy in the shuffle model for summing real numbers.
problem Improving privacy in the shuffle model for data aggregation.
method Developed optimal single message protocol and new lower and upper bounds for privacy amplification.
result Improved accuracy and communication in summing real numbers protocol.
The paper analyzes and improves privacy in machine learning through importance sampling.
problem Ensuring privacy in machine learning while maintaining utility and efficiency.
method Individualized privacy analysis of importance sampling, proposing two approaches for constructing sampling distributions.
result Proposed approaches optimize privacy-efficiency trade-off and outperform uniform sampling.
AdaPrivate-TS: A differentially private Thompson Sampling algorithm for contextual bandits
problem Private Thompson Sampling for Contextual Bandits
method Combining Thompson Sampling with batched zCDP composition
result Achieves 93-99% of non-private performance at ε ∈ [0.5, 5] with logarithmic privacy cost
Quantum algorithm solves best arm identification problem faster.
problem Identifying the best option in a set of choices.
method Quantum amplitude amplification algorithm.
result Quadratically faster than classical methods.
Momentum SGD fails to track nonstationary optima due to drift amplification.
problem Tracking nonstationary optima in stochastic optimization.
method Theoretical analysis of SGD and momentum variants under strong convexity and smoothness.
result Momentum incurs a drift-amplification penalty that diverges as the momentum parameter approaches 1, leading to systematic lag.
Many applications of Bayesian data analysis involve sensitive information, motivating methods which ensure that privacy is protected. We introduce a general privacy-preserving framework for Variational Bayes (VB), a widely used optimization-based Bayesian inference method. Our framework respects differential privacy, t…