Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

4238461,2691,692 · Jun 202019922001200920182026
48 results for realistic data generation

Pseudo rehearsal uses non-photo-realistic images to save resources without sacrificing performance.

problem Catastrophic forgetting in neural networks when learning new tasks.
method Synthetically generate non-photo-realistic images to rehearse previous tasks.
result Non-photo-realistic images can be used for rehearsal without sacrificing performance and significantly reduce resource consumption.

CardiacGen generates realistic ECG signals for training deep learning models.

problem Creating realistic synthetic ECG signals for training deep learning models.
method Hierarchical deep generative model with multi-objective loss functions.
result Synthetic ECG signals from CardiacGen can be used for data augmentation and improve classifier performance.

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We propose a framework for generating realistic text via adversarial training. We emp…

2017-06-12abs ↗pdf ↗

Proposes a method to generate realistic counterfactuals by learning relationships.

problem Counterfactual explanations often ignore intrinsic relationships between data attributes.
method Uses a variational auto-encoder to learn relationships and perturb the latent space.
result The model preserves relationships and generates realistic counterfactuals.

MC-pix2pix generates high-quality synthetic sonar data for ATR systems.

problem Generating realistic synthetic sonar data for ATR systems.
method Markov Conditional pix2pix (MC-pix2pix) method.
result MC-pix2pix-generated data is almost indistinguishable from real sonar data.

This paper proposes a method to generate realistic test cases for image classifiers.

problem Ensuring neural networks for image classification are correct with adequate realistic test data.
method Captures patterns in a large input data space using a manifold, then generates fault-revealing test cases.
result Generates thousands of realistic yet fault-revealing test cases efficiently for well-trained models.

RealCause provides a realistic benchmark for causal inference.

problem Lack of a reliable benchmark for comparing causal effect estimators.
method Flexible generative models to create a benchmark that is both ground-truth and realistic.
result Evaluation of over 1500 causal estimators provides evidence for choosing hyperparameters using predictive metrics.

CausalTime generates realistic time-series for TSCD evaluation.

problem Lack of realistic synthetic datasets for TSCD performance evaluation.
method Harnessing deep neural networks and normalizing flow for dynamics, extracting causal graphs, and deriving ground truth causal graphs.
result Generated datasets accurately reflect real data and ground truth causal graphs.

Paper proposes using synthetic data to improve face recognition accuracy.

problem Improving face recognition accuracy using real data alone.
method Proposes a GAN that disentangles identity attributes and generates photo-realistic synthetic images.
result Synthetic images generated by the model are photo-realistic and can increase face recognition accuracy.

TRADES generates realistic market simulations for financial modeling.

problem Generating realistic and responsive market simulations for financial tasks.
method TRADES uses a transformer-based denoising diffusion probabilistic engine to generate time series order flows conditioned on market state.
result TRADES improves market simulation metrics by 3.27-3.48 over state-of-the-art (SoTA) methods.

The paper discusses quantifying realism in generated images.

problem Designing functions to reliably distinguish realistic data from unrealistic data.
method Drawing on insights from algorithmic information theory, the paper introduces the notion of a universal critic.
result A good generative model alone is insufficient to solve the problem of realism quantification.

GANs can generate realistic data without minimizing a divergence, contrary to current theory.

problem Current theory suggests GANs minimize a divergence to generate realistic data.
method Discussed various loss functions for G, showing they are not divergences and do not have the same equilibrium.
result GANs can use a wide range of loss functions, not just divergences, to generate realistic data.

Researchers infer firm-level supply chain networks from sector-level data to assess systemic risk.

problem Estimating systemic risk in economic systems using firm-level data.
method Maximum-entropy algorithms applied to input-output tables and firm-level aggregate output data.
result The most realistic systemic risk content is retrieved by models incorporating disaggregated firm-specific inputs by sector.

Generative Adversarial Network (GAN) simulates realistic multi-asset scenarios for tail risk.

problem Simulating realistic joint dynamics of multi-asset portfolios for tail risk estimation.
method Designing a GAN that preserves Value-at-Risk (VaR) and Expected Shortfall (ES) tail risk features.
result Correctly captures tail risk for a broad class of trading strategies and demonstrates strong generalization.

MCCE generates realistic counterfactual explanations for tabular data.

problem Creating valid and actionable counterfactual explanations for complex tabular data.
method MCCE models the joint distribution of features and decision using an autoregressive generative model with decision trees. It samples counterfactuals and removes invalid ones.
result MCCE outperforms state-of-the-art methods on various performance metrics and is faster.

A new method generates synthetic data with realistic marginal distributions.

problem Generating synthetic data with bimodal and skewed marginal distributions.
method Pre-transformation variational autoencoders (PTVAEs) with separate parameter optimization for each variable.
result PTVAEs outperform other methods in generating synthetic data with bimodal and skewed distributions.

Federated learning studies separate client data and distribution gaps.

problem Understanding performance differences in federated learning across different datasets.
method Proposed a framework to disentangle out-of-sample and participation gaps.
result Dataset synthesis strategy is crucial for realistic simulations of federated learning generalization.

Generative Adversarial Networks generate realistic network traffic data.

problem Generating realistic flow-based network traffic for evaluation of NIDS.
method Generative Adversarial Networks (GANs) with preprocessing for categorical attributes.
result Two of three preprocessing methods generate high quality flow-based network traffic.

Generates synthetic laparoscopic images for training deep neural networks.

problem Lack of large labeled data sets for laparoscopic image processing.
method Unpaired image-to-image translation to generate realistic synthetic images.
result Synthetic data set improves liver segmentation performance without manual labeling.

A novel model learns from limited data using physics constraints and GPVAE to generate realistic samples.

problem Limited data for effective generative AI training.
method Physics-informed Gaussian Process Variational Autoencoder (PIGPVAE) incorporating physical models and discrepancy terms.
result Achieves state-of-the-art performance on indoor temperature data.

CorGAN generates synthetic healthcare records while preserving privacy.

problem Generating realistic synthetic healthcare records while maintaining privacy.
method Combining Convolutional Generative Adversarial Networks and Convolutional Autoencoders to capture correlations between medical features.
result CorGAN generates synthetic data with performance similar to real data in various ML settings.