Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

132265397529 · Jun 202019922001200920172026
48 results for synthetic features

AI techniques explain synthetic tabular data weaknesses.

problem Challenges in evaluating synthetic tabular data quality.
method Apply explainable AI to a binary detection classifier.
result Reveals inconsistencies, unrealistic dependencies, or missing patterns in synthetic data.

Proposes DP-MERF for privacy-preserving synthetic data generation.

problem Privacy-preserving data generation for synthetic datasets.
method Differentially private mean embeddings with random features.
result Achieves better privacy-utility trade-offs than existing methods.

SHAP Distance assesses semantic fidelity of synthetic tabular data.

problem Semantic fidelity of synthetic tabular data is not well evaluated.
method SHAP Distance, defined as cosine distance between global SHAP attribution vectors.
result SHAP Distance detects semantic discrepancies overlooked by standard measures.

Paper proposes a method to generate synthetic anomalies for robust anomaly detection.

problem Anomaly detection struggles with unbalanced data and rare anomalies.
method Two-level hierarchical latent space representation for feature distillation and synthesis.
result The method creates robust synthetic anomalies for training robust binary classifiers.

We explore several oversampling techniques for an imbalanced multi-label classification problem, a setting often encountered when developing models for Computer-Aided Diagnosis (CADx) systems. While most CADx systems aim to optimize classifiers for overall accuracy without considering the relative distribution of each …

2018-07-07abs ↗pdf ↗

AutoDiff combines auto-encoder and diffusion model for realistic tabular data synthesis.

problem Generating realistic synthetic tabular data with heterogeneous features.
method Employing auto-encoder architecture to handle tabular data's complexity.
result Synthetic tables from AutoDiff show good statistical fidelity and perform well in machine learning tasks.

New method generates geolocated synthetic populations from real data.

problem Generating synthetic populations with explicit geographic coordinates.
method Mapping coordinates into a latent space using Normalizing Flows (NF), then combining with other features in a Variational Autoencoder (VAE).
result NF+VAE architecture outperforms existing methods in generating geolocated synthetic populations.

FlowSelect uses normalizing flows to control FDR in feature selection.

problem Controlled feature selection with knockoffs often fails to control false discovery rate (FDR).
method FlowSelect uses normalizing flows for accurate feature modeling and a novel MCMC-based p-value calculation to enforce knockoff properties.
result FlowSelect consistently controls FDR and demonstrates greater power compared to competing methods.

CardiCat generates synthetic data for high-cardinality tabular datasets.

problem Learning complexities of high-cardinality categorical features in tabular data.
method Substitutes one-hot encoding with regularized dual encoder-decoder embedding layers.
result Generates high-quality synthetic data with a smaller parameter space.

This paper shows feature importance remains valid even in low-performing models.

problem Feature importance validity in low-performing machine learning models for biomedical data.
method Experiments with synthetic and real biomedical datasets to compare feature rank stability under different data reductions.
result Feature importance can be maintained even at low performance levels if data size is adequate.

Class imbalance is a challenging issue in practical classification problems for deep learning models as well as traditional models. Traditionally successful countermeasures such as synthetic over-sampling have had limited success with complex, structured data handled by deep learning models. In this paper, we propose D…

2017-04-25abs ↗pdf ↗

Enhanced Extended Isolation Forest (EIF+) improves anomaly detection and provides interpretable explanations.

problem Detecting anomalies in complex datasets and explaining model predictions.
method Extended Isolation Forest (EIF) and Extended Isolation Forest Feature Importance (ExIFFI) methods.
result EIF+ outperforms EIF in detecting unseen anomalies and provides better generalization.

A novel model-selection method for dynamic networks using synthetic data.

problem Classifying and understanding the growth mechanisms of dynamic networks.
method Training a classifier on synthetic network data generated by nine random graph models, using dynamic features that count new links.
result Achieves near-perfect classification of synthetic networks, outperforming state-of-the-art methods.

EmDT generates synthetic fraud data to improve detection accuracy.

problem Imbalanced datasets in fraud detection lead to poor performance on rare fraudulent transactions.
method EmDT uses UMAP clustering to identify fraudulent patterns and a Transformer denoising network to generate synthetic data.
result EmDT significantly improves classification performance compared to existing methods.

We propose a single neural probabilistic model based on variational autoencoder that can be conditioned on an arbitrary subset of observed features and then sample the remaining features in "one shot". The features may be both real-valued and categorical. Training of the model is performed by stochastic variational Bay…

2018-06-06abs ↗pdf ↗

We prove that, under low noise assumptions, the support vector machine with NmN\ll m random features (RFSVM) can achieve the learning rate faster than O(1/m)O(1/\sqrt{m}) on a training set with mm samples when an optimized feature map is used. Our work extends the previous fast rate analysis of random features method from…

2018-09-12abs ↗pdf ↗

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We propose a framework for generating realistic text via adversarial training. We emp…

2017-06-12abs ↗pdf ↗

Proposes φφ-table for statistical SHAP explanations in regression models.

problem Lack of clear directional summaries, uncertainty, and fidelity in SHAP feature importance.
method SHAP importance selection, fitting a standardized linear surrogate, reporting coefficients, uncertainty, fidelity, and stability.
result Extends SHAP into a statistical global explanation with direction, uncertainty, fidelity, and stability.

Contrastive ICA identifies features in experimental groups relative to controls.

problem Jointly analyzing experimental and control datasets to identify salient features.
method Developed contrastive ICA (cICA) using tensor decomposition.
result cICA identifies patterns and visualizes data effectively, outperforming existing methods.

We propose a principled method for kernel learning, which relies on a Fourier-analytic characterization of translation-invariant or rotation-invariant kernels. Our method produces a sequence of feature maps, iteratively refining the SVM margin. We provide rigorous guarantees for optimality and generalization, interpret…

2017-10-27abs ↗pdf ↗

Paper establishes utility theory for synthetic data generation.

problem Lack of theoretical understanding in synthetic data utility.
method Statistical learning framework with two utility metrics: generalization and model ranking.
result Theoretical bounds for synthetic data utility metrics ensure comparable generalization and consistent model comparison.

A new method combines generative and feature-based approaches for unsupervised anomaly detection.

problem Identifying subtle anomalies in test samples compared to a normative distribution.
method A generative cold-diffusion pipeline trained to restore synthetically-corrupted images, combined with a novel synthetic anomaly generation procedure and ensembling restorations.
result Surpasses prior state-of-the-art for unsupervised anomaly detection in three Brain MRI datasets.

Solves multi-class imbalanced data problem with geometry-based sampling and synthetic data.

problem Handling imbalanced multi-class data in classification problems.
method Two novel methods: undersampling and oversampling.
result Efficacy demonstrated through comparison with state-of-the-art methods.

Markov boundary improves tabular prediction but not as expected.

problem Improving tabular prediction using the Markov boundary.
method Evaluation on a synthetic SCM benchmark with feature counts from 40 to 1000.
result Restricting a regressor to the Markov boundary often improves prediction, but existing discovery and training pipelines do not fully exploit this.

Synthetic learning improves neonatal brain MRI segmentation robustness.

problem Challenges in neonatal brain MRI segmentation due to image contrast and anatomical variations.
method Synthetic learning model trained on few T2-weighted volumes, then enhanced with motion artifacts and over-segmentation.
result Synthetic learning robust to image contrast and improves segmentation of both T1- and T2-weighted images.

Machine learning models perform better with location coordinates alone, not Moran Eigenvectors.

problem Improving machine learning models for spatial data.
method Examined Moran Eigenvectors as additional spatial features in machine learning models using synthetic datasets.
result Machine learning models using only location coordinates achieve better accuracies than eigenvector-based approaches.

Consider a data set collected by (individuals-features) pairs in different times. It can be represented as a tensor of three dimensions (Individuals, features and times). The tensor biclustering problem computes a subset of individuals and a subset of features whose signal trajectories over time lie in a low-dimensiona…

2019-03-10abs ↗pdf ↗

Enhanced framework selects features for unbiased causal inference.

problem Unbiased estimation of causal quantities in causal inference.
method Three-stage computational framework balancing treatment and non-treatment variables.
result Significantly reduces bias and variance in estimating causal quantities.

We propose a method for feature selection that employs kernel-based measures of independence to find a subset of covariates that is maximally predictive of the response. Building on past work in kernel dimension reduction, we show how to perform feature selection via a constrained optimization problem involving the tra…

2017-07-04abs ↗pdf ↗

CorGAN generates synthetic healthcare records while preserving privacy.

problem Generating realistic synthetic healthcare records while maintaining privacy.
method Combining Convolutional Generative Adversarial Networks and Convolutional Autoencoders to capture correlations between medical features.
result CorGAN generates synthetic data with performance similar to real data in various ML settings.