Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2935868791,172 · Jun 202019922001200920172026
48 results for synthetic tabular data

New algorithms for clustering and synthetic data generation of heterogeneous tabular datasets.

problem Clustering and generating synthetic data from heterogeneous tabular datasets with hidden cluster structure.
method Developed MMM and MMMsynth algorithms for clustering and synthetic data generation.
result MMMsynth algorithm outperforms other literature tabular-data generators and approaches real data performance.

A framework evaluates synthetic tabular data quality objectively.

problem Lack of an objective interpretation of tabular data metrics.
method Proposes a single mathematical objective for synthetic tabular data distribution, structurally decomposes it, and unifies existing metrics.
result Synthesizers that represent tabular structure outperform other methods, especially on smaller datasets.

Synthetic tabular data improves privacy while maintaining model performance.

problem Protecting privacy in synthetic data generation for machine learning.
method Deep generative models for tabular data, emphasizing privacy and model performance.
result Deep generative models enhance synthetic data generation for tabular datasets.

AI techniques explain synthetic tabular data weaknesses.

problem Challenges in evaluating synthetic tabular data quality.
method Apply explainable AI to a binary detection classifier.
result Reveals inconsistencies, unrealistic dependencies, or missing patterns in synthetic data.

AutoDiff combines auto-encoder and diffusion model for realistic tabular data synthesis.

problem Generating realistic synthetic tabular data with heterogeneous features.
method Employing auto-encoder architecture to handle tabular data's complexity.
result Synthetic tables from AutoDiff show good statistical fidelity and perform well in machine learning tasks.

DP-FedTabDiff generates private synthetic tabular data using diffusion models and differential privacy.

problem Privacy-preserving synthetic data generation for tabular data in regulated domains.
method Combines Differential Privacy, Federated Learning, and Denoising Diffusion Probabilistic Models.
result Achieves significant privacy improvements without compromising data quality.

Efficient synthetic data generation improves model performance on tabular data.

problem Improving model robustness and performance with scarce or low-quality data.
method Hardness characterization to identify high-value training points, generating synthetic data only from these points.
result Synthetic data generated from hardest points outperforms non-targeted methods on tabular datasets.

PRRO generates synthetic tabular data that improves SL performance and class distribution.

problem Low SL utility of synthetic data due to class imbalance and overlooked data relationships.
method Data pruning and column reordering to optimize SL utility.
result Synthetic data generated with PRRO enhances predictive performance and class distribution.

FinDiff generates synthetic financial data for regulatory tasks.

problem Sharing microdata for research due to privacy regulations.
method Diffusion model using embedding encodings for mixed modality financial data.
result FinDiff excels in generating high-fidelity, privacy-preserving synthetic financial data.

A minimalist approach generates synthetic tabular data with sparse PCA and XGBoost.

problem Generating robust synthetic tabular data for model testing.
method Minimalistic unsupervised SparsePCA encoder with XGBoost decoder.
result The method provides an alternative to raw and quantile perturbation for model robustness testing.

SHAP Distance assesses semantic fidelity of synthetic tabular data.

problem Semantic fidelity of synthetic tabular data is not well evaluated.
method SHAP Distance, defined as cosine distance between global SHAP attribution vectors.
result SHAP Distance detects semantic discrepancies overlooked by standard measures.

CardiCat generates synthetic data for high-cardinality tabular datasets.

problem Learning complexities of high-cardinality categorical features in tabular data.
method Substitutes one-hot encoding with regularized dual encoder-decoder embedding layers.
result Generates high-quality synthetic data with a smaller parameter space.

TabDPT combines ICL and self-supervised learning to train tabular models on real data.

problem Slow generalization of tabular foundation models to unseen datasets.
method In-Context Learning (ICL) combined with self-supervised learning, using real data for pre-training.
result TabDPT achieves strong performance on regression and classification benchmarks.

Synthetic tabular data synthesis models balance utility and risk.

problem Generating synthetic tabular data for regulated domains.
method Latent flow models with various learning targets, paths, and sampling methods.
result Velocity and posterior matching objectives yield higher utility, while score and noise matching achieve lower risk.

Transformers fine-tuned on synthetic data boost tabular data classification performance.

problem Improving tabular data classification accuracy.
method Fine-tuning ICL-transformers on synthetic datasets with complex decision boundaries.
result Fine-tuned ICL-transformers outperform regular neural networks on real-world datasets.

New method generates synthetic survival data by conditioning on event times and censoring indicators.

problem Generating accurate synthetic survival data with censored event times.
method Conditioning covariates on event times and censoring indicators using existing tabular data generation models.
result Our method consistently outperforms baselines and improves survival model performance.

GAMformer bridges tabular models and interpretability, offering a single-pass approach.

problem Lack of interpretability in tabular foundation models like TabPFN.
method In-context learning for GAM shape functions, training on synthetic data.
result GAMformer performs comparably to other leading GAMs across various classification benchmarks.

Generative synthetic data can preserve predictive accuracy but distort causal inference.

problem Distortion of average treatment effect estimates in synthetic data.
method Hybrid synthetic-data framework that generates covariates while modeling treatment and outcome mechanisms separately.
result Hybrid synthesis improves causal fidelity compared to fully generative baselines.

GACTGAN synthesizes tabular data better with less computational overhead.

problem Synthesizing mixed tabular data while balancing risk and utility.
method Integrates Bayesian posterior approximation with Stochastic Weight Averaging-Gaussian (SWAG) in CTGAN.
result GACTGAN produces better synthetic data with reduced privacy risk.

ReTabSyn synthesizes realistic tabular data efficiently by focusing on conditional distribution.

problem Synthesizing realistic tabular data in low-data, imbalanced settings.
method ReTabSyn uses reinforcement learning to prioritize feature correlation preservation during training.
result ReTabSyn consistently outperforms state-of-the-art baselines across various benchmarks.

CTGAN synthesizes population data for travel behavior simulation.

problem Synthesizing population data for agent-based transportation modeling.
method Composite Travel Generative Adversarial Network (CTGAN).
result Consistent and accurate generation of synthetic populations with tabular and sequential mobility data.

KaCGM models provide transparent causal inference from tabular data.

problem Limited auditability in deep causal models for tabular data.
method KaCGM uses Kolmogorov-Arnold Networks to parameterize structural equations, enabling direct inspection and visualization of causal mechanisms.
result KaCGM achieves competitive performance and interpretable causal effects in real-world applications.

Generative adversarial networks (GANs) implicitly learn the probability distribution of a dataset and can draw samples from the distribution. This paper presents, Tabular GAN (TGAN), a generative adversarial network which can generate tabular data like medical or educational records. Using the power of deep neural netw…

2018-11-27abs ↗pdf ↗

DECAF generates fair synthetic data by embedding causal relationships.

problem Generating fair synthetic data from biased training data.
method DECAF uses a GAN with a structural causal model to embed causal relationships and debias synthetic data.
result DECAF successfully removes bias and generates high-quality synthetic data.

Study evaluates synthetic data augmentation for small datasets, highlighting inconsistencies in traditional metrics.

problem Inconsistent validation of synthetic data generated for small sample sizes.
method Proposes a normalized Bottleneck distance metric to evaluate synthetic tabular data.
result Common metrics like propensity scoring and MMD fail for small datasets, showing instability and high variability.

Foundation models leak sensitive data in synthetic tabular data generation, especially LLaMA 3.3 70B.

problem Privacy leakage in synthetic tabular data generation using foundation models.
method Benchmarked three foundation models (GPT-4o-mini, LLaMA 3.3 70B, TabPFN v2) against four baselines on 35 real-world tables.
result Foundation models, especially LLaMA 3.3 70B, have the highest privacy risk in synthetic tabular data generation.

Orion-Bix combines biaxial attention and meta-learning for tabular few-shot learning.

problem Scaling and generalizing tabular models with mixed numeric and categorical fields, weak feature structure, and limited labeled data.
method Orion-Bix uses biaxial attention and meta-learned in-context reasoning to efficiently capture local and global dependencies.
result Orion-Bix outperforms gradient-boosting baselines and state-of-the-art tabular models on public benchmarks.

This paper introduces DPI, a new metric to assess data-copying risk in tabular data.

problem Measuring privacy risk of data-copying in tabular generative models.
method Proposes Data Plagiarism Index (DPI) for evaluating data-copying risk.
result DPI identifies data-copying threats to tabular data models, highlighting privacy and fairness issues.

New protocol evaluates synthetic data for temporal consistency.

problem Synthetic data generators can produce invalid timestamps and trajectories.
method Characterize datasets by four properties, then measure timestamp validity and dynamics.
result Temporal fidelity must be measured, not inferred from static data.

Modeling the probability distribution of rows in tabular data and generating realistic synthetic data is a non-trivial task. Tabular data usually contains a mix of discrete and continuous columns. Continuous columns may have multiple modes whereas discrete columns are sometimes imbalanced making the modeling difficult.…

2019-07-01abs ↗pdf ↗

Imputation-free method learns tabular data with missing values using transformer.

problem Machine learning on tabular data with missing values often leads to unreliable outcomes due to synthetic imputation.
method Incremental attention learning (IFIAL) using transformer with attention masks.
result IFIAL outperforms state-of-the-art methods in 17 diverse tabular data sets.

This research examines how model explanations change under distribution shifts in tabular data.

problem Detecting distribution shifts in tabular data affecting model performance and explanations.
method Investigates the relationship between model performance and explanation characteristics under distribution shifts.
result Explanation shifts are a better indicator for detecting predictive performance changes than traditional distribution shift techniques.

EmDT generates synthetic fraud data to improve detection accuracy.

problem Imbalanced datasets in fraud detection lead to poor performance on rare fraudulent transactions.
method EmDT uses UMAP clustering to identify fraudulent patterns and a Transformer denoising network to generate synthetic data.
result EmDT significantly improves classification performance compared to existing methods.

GTDL methods fail to accurately model feature interactions in tabular data.

problem Accurate modeling of feature interactions in tabular data.
method Graph-based tabular deep learning methods using attention mechanisms and message-passing schemes.
result Current GTDL methods fail to recover meaningful feature interactions due to poor edge recovery.