New strategy debiases synthetic data generated by DGMs for improved statistical inference.
problem Bias and imprecision in synthetic data generated by DGMs impede statistical convergence and inference.
method Debiasing strategy based on debiased and targeted machine learning.
result Enhanced convergence rates and accurate estimators with easily approximated variances.
New synthetic data analysis reveals high type 1 error rates.
problem Analyzing synthetic data for inference raises significant methodological challenges.
method Developed statistical inference tools and conducted a simulation study.
result Type 1 error rates are unacceptably high in synthetic data analysis.
Improves synthetic-to-real generalization without real data.
problem Synthetic models struggle with real data generalization.
method Encourages similar ImageNet representations and automates learning rates.
result Significant improvement in synthetic-to-real generalization.
SynthBH uses synthetic data to control FDR in multiple testing.
problem Controlling false discovery rate in multiple hypothesis testing.
method SynthBH, a synthetic-powered multiple testing procedure.
result SynthBH guarantees FDR control with synthetic data.
Novel approach integrates Multivariate Square-root Lasso into Synthetic Control for high-dimensional data.
problem Challenges in practical implementation and computational efficiency of Synthetic Control method for high-dimensional disaggregated data.
method Integrates Multivariate Square-root Lasso into Synthetic Control framework.
result Demonstrates superior computational efficiency without compromising estimation accuracy.
Enhances FDR control in variable selection using neural networks.
problem Balancing rigorous error control with statistical power in high-dimensional variable selection.
method Learning-augmented T-Rex Selector framework with a neural network trained on synthetic datasets.
result Achieves superior detection of true variables compared to existing approaches.
New method generates private synthetic data with optimal utility for smooth queries.
problem Achieving strong utility guarantees for meaningful downstream analysis of sensitive datasets.
method Proposes a polynomial-time algorithm for generating ( ε , δ ) (\varepsilon,δ) ( ε , δ ) -differentially private synthetic data with minimax optimal error rates for smooth queries. result Achieves a minimax error rate of O k , d ( n − min { 1 , k d } ) O_{k,d}(n^{-\min \{1, \frac{k}{d}\}}) O k , d ( n − m i n { 1 , d k } ) for k k k -smooth queries, up to a log ( n ) \log(n) log ( n ) factor. The rapid digital transformation without security considerations has resulted in the rise of global-scale cyberattacks. The first line of defense against these attacks are Network Intrusion Detection Systems (NIDS). Once deployed, however, these systems work as blackboxes with a high rate of false positives with no mea…
Enhances statistical inference using synthetic data.
problem Limited labeled data for statistical inference.
method GESPI framework that combines synthetic and real data.
result Error rate remains below a user-specified bound and decreases with synthetic data quality.
Paper proposes a sparse synthetic control method to select important predictors.
problem Choosing and weighting predictors affects synthetic control estimator performance.
method Sparse synthetic control procedure that penalizes predictors, derived in a linear factor model.
result Sparse synthetic control achieves lower bias and better post-treatment performance.
The aim of this paper is to introduce a synthetic ALM model that catches the main specificity of life insurance contracts. First, it keeps track of both market and book values to apply the regulatory profit sharing rule. Second, it introduces a determination of the crediting rate to policyholders that is close to the p…
Hybrid model improves synthetic equity data generation.
problem Generating realistic synthetic financial time series.
method Discretized excess growth rates into states with Poisson jumps, estimating parameters directly.
result Framework achieved high pass rates for distributional and volatility clustering tests.
Synthetic augmentation helps but not always in imbalanced learning.
problem Imbalanced learning causes poor performance on rare classes.
method Developed a statistical framework for synthetic augmentation in imbalanced learning.
result Synthetic augmentation is not always beneficial and depends on the imbalance regime.
Fixed-parameter tractability of private synthetic data generation
problem Generating synthetic data under differential privacy
method Linear programming and subsampled private multiplicative weights method
result Optimal error rates across all regimes
Synthetic data enhances analytics but requires careful volume management.
problem Accuracy of statistical methods on synthetic data vs. raw data.
method Synthetic Data Generation for Analytics framework using tabular diffusion models.
result Error rate decreases with more synthetic data but may stabilize or increase.
This paper revisits the problem of analyzing multiple ratings given by different judges. Different from previous work that focuses on distilling the true labels from noisy crowdsourcing ratings, we emphasize gaining diagnostic insights into our in-house well-trained judges. We generalize the well-known DawidSkene model…
The paper corrects bias in synthetic data for imbalanced learning.
problem Challenges in balancing false positive and negative rates in imbalanced data.
method Proposes a bias correction procedure to generate synthetic data for minority groups.
result Enhances prediction accuracy while avoiding overfitting.
Paper proposes a method to estimate total variation distance for synthetic data fidelity.
problem Assessing the fidelity of synthetic data generated by AI.
method Discriminative approach to estimate total variation distance between two distributions.
result Estimation of total variation distance reduces to quantifying Bayes risk in classification.
Estimates treatment effects in panel data with general intervention patterns.
problem Estimating average treatment effects in panel data with heterogeneous treatment effects.
method Extends synthetic control framework to allow rate-optimal recovery of average treatment effects for general intervention patterns.
result First rate-optimal guarantees for general intervention patterns in estimating average treatment effects.
Model collapse occurs quickly for synthetic data generated by previous models.
problem Model quality degrades over recursive training on synthetic data.
method Theoretical and experimental evaluations of discrete and Gaussian distributions under near ML estimation.
result Model collapse for discrete distributions is approximately linearly dependent on the number of times a word occurs in the original corpus, and for Gaussian models, the standard deviation reduces to zero roughly at n iterations.
The paper provides theoretical guarantees for neural network-based anomaly detection.
problem Theoretical guarantees for unsupervised neural network-based anomaly detection.
method Casting anomaly detection as a binary classification problem, establishing non-asymptotic upper bounds and convergence rates.
result The convergence rate on the excess risk matches the minimax optimal rate.
New methods for inferring, predicting, and estimating continuous-time, discrete-event processes.
problem Inferring, predicting, and estimating entropy rate of continuous-time, discrete-event processes.
method Bayesian structural inference extended with neural networks.
result Methods are competitive for prediction and entropy-rate estimation with state-of-the-art.
CardiacGen generates realistic ECG signals for training deep learning models.
problem Creating realistic synthetic ECG signals for training deep learning models.
method Hierarchical deep generative model with multi-objective loss functions.
result Synthetic ECG signals from CardiacGen can be used for data augmentation and improve classifier performance.
The study proposes algorithms to minimize rating discordance in missing data.
problem Missing ratings in combined rating lists.
method Optimization models and algorithms that minimize total rating discordance.
result The proposed methods outperform state-of-the-art imputation methods in accuracy.
This study analyzes communication constraints in MoE architectures using information theory.
problem Communication constraints in Mixture-of-Experts (MoE) architectures.
method Developed a rate-distortion characterization of finite-rate gating in MoE architectures using information theory.
result Yielded capacity-aware limits for communication-constrained MoE systems.
A novel approach models rating transitions using Lie groups and Deep Learning.
problem Modeling rating transitions with geometric properties and stochastic processes.
method Introducing Itô-SDEs on Lie groups, using TimeGAN for calibration, and examining rating matrix properties.
result The geometric approach using Lie groups and Deep Learning generates a good fit for rating transitions.
PrAda-GAN improves synthetic data generation under differential privacy.
problem Generating synthetic data under differential privacy with marginal-based methods.
method Sequential generator architecture integrating GAN and marginal-based approaches, with adaptive regularization of Bayes network structure.
result PrAda-GAN outperforms existing methods in privacy-utility trade-off on synthetic and real-world datasets.
Synthetic data augmentation can improve imbalanced classification metrics.
problem Improving imbalanced classification metrics
method Developing a framework for analyzing the effects of synthetic data augmentation on score-based classification
result Augmentation can improve AUROC, AUPRC, balanced accuracy, and F1 score
New method minimizes experiment cost while maintaining accuracy.
problem Minimizing cost in experiments with interference or other concerns.
method Synthetically Controlled Thompson Sampling (SCTS).
result Minimizes regret and maintains inferential ability.
This paper reviews methods for constructing confidence intervals for error rates in 1:1 matching tasks.
problem Challenges in assessing uncertainty of error rates in matching algorithms, especially when data are dependent and error rates are low.
method Derives and examines statistical properties of methods for constructing confidence intervals for error rates in 1:1 matching tasks.
result Coverage and interval width vary with sample size, error rates, and data dependence.
In general, homeowners refinance in response to a decrease in interest rates, as their borrowing costs are lowered. However, it is worth investigating the effects of refinancing after taking the underlying costs into consideration. Here we develop a synthetic mortgage calculator that sufficiently accounts for such cost…
We present a unified framework for low-rank matrix estimation with nonconvex penalties. We first prove that the proposed estimator attains a faster statistical rate than the traditional low-rank matrix estimator with nuclear norm penalty. Moreover, we rigorously show that under a certain condition on the magnitude of t…
AKO improves stability and power of Knockoff inference.
problem Instability of Knockoff-based inference.
method Aggregation of Multiple Knockoffs (AKO) method.
result AKO maintains FDR control while improving stability and power.
New method for estimating heterogeneous treatment effects in panel data.
problem Estimating heterogeneous treatment effects in non-stationary, temporally dependent panel data.
method Proposes H1SL and H2SL, synthetic learners for panel data, based on existing non-panel data estimators.
result Established convergence rates for proposed estimators and demonstrated superior performance.
Latent Noise Injection improves synthetic data generation for privacy and statistical alignment.
problem Slow convergence of generative models in high-dimensional settings.
method Latent Noise Injection using Masked Autoregressive Flows (MAF).
result Synthetic data closely reflects the underlying distribution, especially in high-dimensional settings.
Exploiting low-rank structure of the user-item rating matrix has been the crux of many recommendation engines. However, existing recommendation engines force raters with heterogeneous behavior profiles to map their intrinsic rating scales to a common rating scale (e.g. 1-5). This non-linear transformation of the rating…
We prove that, under low noise assumptions, the support vector machine with N ≪ m N\ll m N ≪ m random features (RFSVM) can achieve the learning rate faster than O ( 1 / m ) O(1/\sqrt{m}) O ( 1/ m ) on a training set with m m m samples when an optimized feature map is used. Our work extends the previous fast rate analysis of random features method from…
Gen-LRA attacks synthetic data leakage without model knowledge.
problem Auditing synthetic data privacy leakage.
method Generative Likelihood Ratio Attack (Gen-LRA).
result Gen-LRA outperforms other attacks across metrics.
Rate-In dynamically adjusts dropout rates during inference to improve uncertainty estimation in neural networks.
problem Static dropout rates lead to suboptimal uncertainty estimates in neural networks.
method Rate-In dynamically adjusts dropout rates using information-theoretic principles.
result Rate-In improves calibration and sharpens uncertainty estimates compared to fixed or heuristic dropout rates.
New framework estimates treatment effects in extreme data.
problem Hindered by unavailability of counterfactual outcomes and rarity of extreme data.
method Proposes a new framework based on extreme value theory.
result Quantifies treatment effects using tail decay rates of potential outcomes.
Method discovers nonlinear relations from time series data.
problem Identifying directional relations from nonlinear interactions in time series.
method Minimum predictive information regularization method for deep learning.
result Substantially outperforms other methods for learning nonlinear relations.
New methods control false discoveries near the boundary in conformal novelty detection.
problem Over-optimistic assessments near the rejection threshold in conformal novelty detection.
method Support line (SL) correction and alternative procedures to control boundary false discovery rate (bFDR).
result New procedures control the boundary false discovery rate (bFDR) in the conformal setting.
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
This paper provides a method for noise-calibrated inference from DP synthetic data.
problem Inference from DP synthetic data is often miscalibrated and lacks principled uncertainty quantification.
method Release DP sufficient statistics, perform noise-calibrated likelihood-based inference, and optional synthetic data generation.
result Asymptotic normality and valid confidence intervals for the plug-in DP MLE.
Most of the existing recommender systems use the ratings provided by users on individual items. An additional source of preference information is to use the ratings that users provide on sets of items. The advantages of using preferences on sets are two-fold. First, a rating provided on a set conveys some preference in…
The study analyzes convergence rates for sparse pivotal estimators in high-dimensional regression.
problem Sparse pivotal estimation in high-dimensional regression problems.
method Theoretical analysis and comparison of non-smooth + non-smooth optimization problems, including smoothing techniques.
result Minimax sup-norm convergence rates for square-root Lasso-type estimators are derived.
We provide non-asymptotic bounds for the well-known temporal difference learning algorithm TD(0) with linear function approximators. These include high-probability bounds as well as bounds in expectation. Our analysis suggests that a step-size inversely proportional to the number of iterations cannot guarantee optimal …
Proposes DenoiseBid to correct uncertain CTR and CVR estimates for autobidding.
problem Uncertainty in CTR and CVR estimates affects autobidding algorithm performance.
method Bayesian approach to correct noisy estimates with recovered distributions.
result Proposed DenoiseBid method improves efficiency of autobidding in auctions.