Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2855698541,138 · Jun 202019922001200920172026
48 results for realistic data

Pseudo rehearsal uses non-photo-realistic images to save resources without sacrificing performance.

problem Catastrophic forgetting in neural networks when learning new tasks.
method Synthetically generate non-photo-realistic images to rehearse previous tasks.
result Non-photo-realistic images can be used for rehearsal without sacrificing performance and significantly reduce resource consumption.

CardiacGen generates realistic ECG signals for training deep learning models.

problem Creating realistic synthetic ECG signals for training deep learning models.
method Hierarchical deep generative model with multi-objective loss functions.
result Synthetic ECG signals from CardiacGen can be used for data augmentation and improve classifier performance.

Proposes a method to generate realistic counterfactuals by learning relationships.

problem Counterfactual explanations often ignore intrinsic relationships between data attributes.
method Uses a variational auto-encoder to learn relationships and perturb the latent space.
result The model preserves relationships and generates realistic counterfactuals.

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We propose a framework for generating realistic text via adversarial training. We emp…

2017-06-12abs ↗pdf ↗

Researchers infer firm-level supply chain networks from sector-level data to assess systemic risk.

problem Estimating systemic risk in economic systems using firm-level data.
method Maximum-entropy algorithms applied to input-output tables and firm-level aggregate output data.
result The most realistic systemic risk content is retrieved by models incorporating disaggregated firm-specific inputs by sector.

RealCause provides a realistic benchmark for causal inference.

problem Lack of a reliable benchmark for comparing causal effect estimators.
method Flexible generative models to create a benchmark that is both ground-truth and realistic.
result Evaluation of over 1500 causal estimators provides evidence for choosing hyperparameters using predictive metrics.

This paper proposes a method to generate realistic test cases for image classifiers.

problem Ensuring neural networks for image classification are correct with adequate realistic test data.
method Captures patterns in a large input data space using a manifold, then generates fault-revealing test cases.
result Generates thousands of realistic yet fault-revealing test cases efficiently for well-trained models.

SKADA-bench evaluates unsupervised DA methods across diverse modalities.

problem Evaluating unsupervised DA methods on diverse modalities with realistic validation.
method Nested cross-validation and unsupervised model selection scores.
result Highlights the importance of realistic validation and provides practical guidance.

CausalTime generates realistic time-series for TSCD evaluation.

problem Lack of realistic synthetic datasets for TSCD performance evaluation.
method Harnessing deep neural networks and normalizing flow for dynamics, extracting causal graphs, and deriving ground truth causal graphs.
result Generated datasets accurately reflect real data and ground truth causal graphs.

The paper discusses quantifying realism in generated images.

problem Designing functions to reliably distinguish realistic data from unrealistic data.
method Drawing on insights from algorithmic information theory, the paper introduces the notion of a universal critic.
result A good generative model alone is insufficient to solve the problem of realism quantification.

Simulates realistic execution and costs in limit order books.

problem Realistic simulation of limit order books for large-tick assets.
method Tractable representation of spread and volume imbalance; calibrated event timing; feedback mechanism for market impact.
result Simulator yields realistic behavior and sensitivity to execution parameters.

Coupling the high-fidelity generation capabilities of label-conditional image synthesis methods with the flexibility of unconditional generative models, we propose a semantic bottleneck GAN model for unconditional synthesis of complex scenes. We assume pixel-wise segmentation labels are available during training and us…

2019-11-26abs ↗pdf ↗

TRADES generates realistic market simulations for financial modeling.

problem Generating realistic and responsive market simulations for financial tasks.
method TRADES uses a transformer-based denoising diffusion probabilistic engine to generate time series order flows conditioned on market state.
result TRADES improves market simulation metrics by 3.27-3.48 over state-of-the-art (SoTA) methods.

Generative Adversarial Network (GAN) simulates realistic multi-asset scenarios for tail risk.

problem Simulating realistic joint dynamics of multi-asset portfolios for tail risk estimation.
method Designing a GAN that preserves Value-at-Risk (VaR) and Expected Shortfall (ES) tail risk features.
result Correctly captures tail risk for a broad class of trading strategies and demonstrates strong generalization.

MCCE generates realistic counterfactual explanations for tabular data.

problem Creating valid and actionable counterfactual explanations for complex tabular data.
method MCCE models the joint distribution of features and decision using an autoregressive generative model with decision trees. It samples counterfactuals and removes invalid ones.
result MCCE outperforms state-of-the-art methods on various performance metrics and is faster.

Evaluates transfer learning methods in dynamic data availability scenarios.

problem Real-world data availability varies over time, leading to unrealistic TL method evaluations.
method Proposes a data manipulation framework to simulate varying data availability and domain transformations.
result Demonstrates the usefulness of the framework on proprietary and publicly available datasets.

This paper presents a novel CNN-based approach for synthesizing high-resolution LiDAR point cloud data. Our approach generates semantically and perceptually realistic results with guidance from specialized loss-functions. First, we utilize a modified per-point loss that addresses missing LiDAR point measurements. Secon…

2019-06-28abs ↗pdf ↗

Federated learning studies separate client data and distribution gaps.

problem Understanding performance differences in federated learning across different datasets.
method Proposed a framework to disentangle out-of-sample and participation gaps.
result Dataset synthesis strategy is crucial for realistic simulations of federated learning generalization.

A new method generates synthetic data with realistic marginal distributions.

problem Generating synthetic data with bimodal and skewed marginal distributions.
method Pre-transformation variational autoencoders (PTVAEs) with separate parameter optimization for each variable.
result PTVAEs outperform other methods in generating synthetic data with bimodal and skewed distributions.

Study evaluates financial misstatement detection methods, highlighting evaluation process impact.

problem Detecting financial reports with high misstatement risk.
method Proposes a new, realistic evaluation framework focusing on misstatement rarity, time dimension, and detection latency.
result Evaluation process significantly impacts system performance, revealing model and feature type effectiveness.

Enhances queue-reactive model for realistic limit order book simulation.

problem Realistic simulation of limit order books for market research and strategy development.
method Extends Queue-Reactive model with neural network for complex dependencies and varying market conditions.
result Captures key market properties like square-root law of market impact and order size patterns.

SBSS uses similarity to split data for better classifier training.

problem Training better classifiers with realistic performance estimation.
method SBSS uses both input and output space information to split data using similarity functions.
result SBSS outperformed ordinary stratified 10-fold cross-validation in 75% of scenarios.

Unsupervised learning representations generalize better than supervised learning under distribution shifts.

problem Robustness of unsupervised representations to distribution shift.
method Extensive evaluation on synthetic and realistic datasets, including controllable domain generalization datasets.
result Unsupervised representations learned from SSL and AE generalize better than supervised learning under various distribution shifts.

Proposes a unified normalization method for multi-domain medical images.

problem Inadequate joint information across multiple datasets hinders image segmentation performance.
method Adversarial and task-driven normalization approach to learn a common normalizing function across multiple datasets.
result Jointly normalized images improve segmentation accuracy by up to 57.5%.

New model detects hidden group structures in criminal networks.

problem Challenges in identifying group structures in criminal networks with noisy data.
method Developed an extended stochastic block model (ESBM) to infer group structures.
result Unveiled complex block structures in an Italian mafia network.

Paper shows data poisoning and Byzantine attacks are equivalent, impacting federated learning security.

problem Resilience of federated learning systems to adversarial attacks.
method Proved equivalence between data poisoning and Byzantine gradient attacks.
result Equivalence between data poisoning and Byzantine attacks in federated learning.