Algorithm creates synthetic experiences to enhance Deep Reinforcement Learning.
problem Lack of synthetic experiences in classic Experience Replay.
method Bootstraps synthetic experiences to augment the replay memory.
result Synthetic experiences can improve learning speed and performance.
Synthetic experiments are crucial for assessing causal machine learning methods.
problem Current empirical evaluations of causal machine learning methods are insufficient and unreliable.
method Propose principles for conducting rigorous empirical analyses with synthetic data.
result Rigorous synthetic experiments are essential for building trust in causal machine learning methods.
New method minimizes experiment cost while maintaining accuracy.
problem Minimizing cost in experiments with interference or other concerns.
method Synthetically Controlled Thompson Sampling (SCTS).
result Minimizes regret and maintains inferential ability.
Paper develops an efficient algorithm for experiment design using synthetic controls.
problem Designing optimal experiments for treatment effect estimation.
method Solves a phase synchronization problem via a normalized generalized power method.
result First global optimality guarantee for experiment design with pre-treatment data.
A new method combines synthetic data analysis and DP generation to produce accurate uncertainty estimates.
problem Invalid inferences from DP synthetic data analysis.
method Combining synthetic data analysis techniques from MI and NA Bayesian modeling with a novel noise-aware synthetic data generation algorithm.
result Accurate confidence intervals from DP synthetic data are produced, wider with tighter privacy.
Study compares different covariance estimation methods for portfolio allocation.
problem Comparing methods for estimating covariance and precision matrices in portfolio allocation.
method Gaussian Graphical Model (GGM), Shrinkage, Thresholding, Random Matrix Theory (RMT) methods.
result GGM methods outperform other methods in predictive ability for portfolio allocation.
SynthER uses generative models to augment limited RL experience.
problem Limited data for reinforcement learning agents.
method SynthER leverages diffusion models to generate synthetic experience data.
result SynthER significantly improves sample efficiency and training of RL agents.
SynthBH uses synthetic data to control FDR in multiple testing.
problem Controlling false discovery rate in multiple hypothesis testing.
method SynthBH, a synthetic-powered multiple testing procedure.
result SynthBH guarantees FDR control with synthetic data.
Synthetic learning improves neonatal brain MRI segmentation robustness.
problem Challenges in neonatal brain MRI segmentation due to image contrast and anatomical variations.
method Synthetic learning model trained on few T2-weighted volumes, then enhanced with motion artifacts and over-segmentation.
result Synthetic learning robust to image contrast and improves segmentation of both T1- and T2-weighted images.
Online data augmentation improves forecasting performance in deep learning.
problem Insufficient training data for forecasting tasks.
method An online data augmentation framework that generates synthetic samples during training.
result Online data augmentation leads to better forecasting performance.
Recent theoretical work has identified random projection as a promising dimensionality reduction technique for learning mixtures of Gausians. Here we summarize these results and illustrate them by a wide variety of experiments on synthetic and real data.
Synthetic datasets help study bias in ML, overcoming data scarcity.
problem Lack of relevant datasets for bias research in ML.
method Presented a family of synthetic datasets with adjustable bias levels.
result Demonstrated an experiment using synthetic data to study bias.
SMOTE-DP enhances synthetic data privacy without sacrificing utility.
problem Balancing privacy and utility in synthetic data generation.
method Integrating SMOTE with differential privacy mechanisms.
result SMOTE-DP produces synthetic data that is both private and useful.
Framework uses synthetic data from pretrained models to improve predictive modeling.
problem Limited effectiveness of synthetic data from generative models for improving predictive performance.
method Proposes an end-to-end framework that generates and filters synthetic data through domain-specific statistical methods.
result Consistent improvements in predictive performance across various settings.
Data augmentation is rapidly gaining attention in machine learning. Synthetic data can be generated by simple transformations or through the data distribution. In the latter case, the main challenge is to estimate the label associated to new synthetic patterns. This paper studies the effect of generating synthetic data…
SPI uses synthetic data to improve predictive inference efficiency.
problem Inefficient predictive inference with scarce calibration data.
method Integrates synthetic data to align nonconformity scores and improve coverage guarantees.
result SPI yields substantially tighter and more informative prediction sets.
Bayesian approach for learning from synthetic data, improving model accuracy.
problem Lack of statistical properties and robust methods for learning from synthetic data.
method Bayesian paradigm to update model parameters considering synthetic data generating process and learning task.
result Novel approach outperforms standard methods in supervised learning and inference problems.
Study finds real-world datasets contain natural experiments that can improve model performance.
problem Detecting natural experiments in real-world datasets for causal inference.
method Synthetic graph simulation and feature selection based on causal links.
result Real-world datasets contain natural experiments that can be exploited for improved model performance.
Paper establishes utility theory for synthetic data generation.
problem Lack of theoretical understanding in synthetic data utility.
method Statistical learning framework with two utility metrics: generalization and model ranking.
result Theoretical bounds for synthetic data utility metrics ensure comparable generalization and consistent model comparison.
This work shows synthetic gradients can outperform backpropagation in sample efficiency.
problem The efficiency of backpropagation in training neural networks.
method Unified vectorized feedback framework for loss-based and reward-based learning, introducing synthetic gradients.
result Synthetic gradients can achieve lower gradient-estimation mean squared error than backpropagation under certain conditions.
PRRO generates synthetic tabular data that improves SL performance and class distribution.
problem Low SL utility of synthetic data due to class imbalance and overlooked data relationships.
method Data pruning and column reordering to optimize SL utility.
result Synthetic data generated with PRRO enhances predictive performance and class distribution.
Paper proposes synthetic data generator to study and mitigate bias in machine learning.
problem Bias in machine learning data can lead to unfair outcomes.
method Developed a synthetic data generator to introduce and analyze various types of bias.
result Demonstrated how synthetic data can be used to study and mitigate bias in machine learning models.
New method generates synthetic survival data by conditioning on event times and censoring indicators.
problem Generating accurate synthetic survival data with censored event times.
method Conditioning covariates on event times and censoring indicators using existing tabular data generation models.
result Our method consistently outperforms baselines and improves survival model performance.
The paper develops methods to create private synthetic spatial point patterns.
problem Generating private synthetic spatial point patterns.
method Developed differentially private Poisson and Cox point synthesizers.
result The synthesizers effectively maintain privacy and utility of synthetic data.
New method constructs synthetic treatment groups without mean exchangeability assumption.
problem Violations of mean exchangeability assumption in randomized controlled trials.
method Weighted mixture of treatment groups from source populations, minimizing conditional maximum mean discrepancy.
result Asymptotic normality of synthetic treatment group estimator established.
Proposes efficient calibration for indoor localization models.
problem Calibration data scarcity in wireless indoor localization.
method Uses synthetic labels and prediction sets to fine-tune a predictor and estimate bias.
result Yields rigorous coverage guarantees for prediction sets.
TRADES generates realistic market simulations for financial modeling.
problem Generating realistic and responsive market simulations for financial tasks.
method TRADES uses a transformer-based denoising diffusion probabilistic engine to generate time series order flows conditioned on market state.
result TRADES improves market simulation metrics by 3.27-3.48 over state-of-the-art (SoTA) methods.
This paper uses LLMs to generate synthetic data to improve classification accuracy in imbalanced datasets.
problem Imbalanced classification and spurious correlation in data science.
method Develops novel theoretical foundations and uses transformer models to generate synthetic data.
result Transformer models can generate high-quality synthetic data to improve classification accuracy.
Syntax designs adaptive trials for subpopulations with potential benefits.
problem Identifying subpopulations with positive treatment effects in diverse patient populations.
method Adaptive patient recruitment and synthetic control estimation.
result Syntax outperforms conventional trial designs in identifying beneficial subpopulations.
Paper tackles model collapse in synthetic data retraining.
problem Iterative retraining of generative models on synthetic data can lead to performance deterioration.
method Integrates an external synthetic data verifier to prevent model collapse.
result Synthetic retraining with a verifier can improve model performance initially but may lead to convergence to the verifier's knowledge center.
The paper analyzes SMOTE for imbalanced classification, providing theoretical bounds and guidelines.
problem The challenge of imbalanced classification problems, especially with minority classes.
method Theoretical analysis of SMOTE and related oversampling techniques for minority classes.
result Derives concentration and excess risk bounds for SMOTE and kernel-based classifiers.
SPLICE simulates incurred losses and their revisions.
problem Simulating incurred losses and their revisions in insurance.
method Continuous time simulation of individual claims with revisions over their lifetime.
result Incorporates dependencies and properties of incurred losses.
New measure shows how LSTM models compose hierarchical representations.
problem Understanding how LSTM models capture compositional structure in language.
method Novel measure of interdependence between word meanings in LSTM internal gates.
result High interdependence can hurt generalization and reveals hierarchical structure learning.
Method preserves correlations in synthetic data.
problem Preserving dependence structure of original data.
method Orthogonal Procrustes problem for restoring Pearson correlation.
result Restores Pearson correlation structure while preserving feature distributions and downstream tasks performance.
TAMIS improves MIA on synthetic data, reducing cost and requiring less knowledge.
problem Empirical assessment of privacy in machine learning algorithms.
method Improves MAMA-MIA by recovering graphical model from synthetic data and introducing a more accurate attack score.
result TAMIS achieves better or similar performance to MAMA-MIA on synthetic data challenges.
DECAF generates fair synthetic data by embedding causal relationships.
problem Generating fair synthetic data from biased training data.
method DECAF uses a GAN with a structural causal model to embed causal relationships and debias synthetic data.
result DECAF successfully removes bias and generates high-quality synthetic data.
We propose a data-driven framework for optimizing privacy-preserving data release mechanisms to attain the information-theoretically optimal tradeoff between minimizing distortion of useful data and concealing specific sensitive information. Our approach employs adversarially-trained neural networks to implement random…
Generative synthetic data can preserve predictive accuracy but distort causal inference.
problem Distortion of average treatment effect estimates in synthetic data.
method Hybrid synthetic-data framework that generates covariates while modeling treatment and outcome mechanisms separately.
result Hybrid synthesis improves causal fidelity compared to fully generative baselines.
AdaDPSyn generates synthetic examples to protect private data in ICL.
problem Protecting private data in in-context learning with large language models.
method Data-adaptive differentially private algorithm that dynamically adjusts noise level based on data properties.
result AdaDPSyn outperforms existing methods in preserving high ICL accuracy while maintaining differential privacy.
TSC improves causal effect estimation in panel data.
problem Estimating causal effects in panel data with a single treated unit.
method Targeted synthetic control method that refines initial weights through a one-dimensional targeted update.
result TSC consistently improves estimation accuracy over state-of-the-art SCM baselines.
Synthetic reference strings are as effective as real ones for training citation parsing models.
problem Lack of training data for citation parsing, especially with deep neural networks.
method Trained Grobid with human-labelled and synthetically created reference strings, and evaluated retraining and out-of-sample data impact.
result Synthetic and real reference strings are equally effective for training Grobid, with retraining improving performance.
A model learns causal representations from high-dimensional data.
problem Challenges in learning causal representations from high-dimensional data.
method Formulated a latent variable decoder model, Decoder BCD, for Bayesian causal discovery.
result Shows that using known intervention targets as labels helps in unsupervised Bayesian inference over structure and parameters.
Study evaluates synthetic data augmentation for small datasets, highlighting inconsistencies in traditional metrics.
problem Inconsistent validation of synthetic data generated for small sample sizes.
method Proposes a normalized Bottleneck distance metric to evaluate synthetic tabular data.
result Common metrics like propensity scoring and MMD fail for small datasets, showing instability and high variability.
Synthetic Petri Dish predicts neural architecture performance faster.
problem Expensive NAS evaluation process with ground-truth data.
method Instantiates motifs in small networks, evaluates with few synthetic samples.
result Significantly higher accuracy in predicting motif performance.
Study recovers investor preferences from portfolio data using synthetic data and robust optimization.
problem Recovering latent investor preferences from observed portfolio allocations under uncertainty.
method Inverse portfolio optimization framework integrating robust optimization and regret-based inference.
result Accurate recovery of transaction cost parameters and partial identifiability of ESG penalties under preference misspecification and market shocks.
Synthetic telematics dataset created from insurance claims data.
problem Creating a reliable synthetic dataset for usage-based insurance models.
method Three-stage process using machine learning: binary classification, regression, and synthetic oversampling.
result Synthetic dataset remarkably similar to real data in risk assessment models.
PrAda-GAN improves synthetic data generation under differential privacy.
problem Generating synthetic data under differential privacy with marginal-based methods.
method Sequential generator architecture integrating GAN and marginal-based approaches, with adaptive regularization of Bayes network structure.
result PrAda-GAN outperforms existing methods in privacy-utility trade-off on synthetic and real-world datasets.
We consider accurately answering smooth queries while preserving differential privacy. A query is said to be K-smooth if it is specified by a function defined on [−1,1]d whose partial derivatives up to order K are all bounded. We develop an ε-differentially private mechanism for the class of K-smooth queries…