Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

216433649865 · Jun 202019922001200920172026
48 results for multiple synthetic datasets

The study improves theoretical understanding of using multiple synthetic datasets for better model accuracy.

problem Lack of theoretical understanding of using multiple synthetic datasets for supervised learning.
method Derive bias-variance decompositions for multiple synthetic datasets settings.
result A simple rule of thumb to select the appropriate number of synthetic datasets.

Dataset distillation is a method for reducing dataset sizes by learning a small number of synthetic samples containing all the information of a large dataset. This has several benefits like speeding up model training, reducing energy consumption, and reducing required storage space. Currently, each synthetic sample is …

2019-10-06abs ↗pdf ↗

Paper proposes HCDC to improve hyperparameter search efficiency.

problem Poor generalizability of dataset condensation across different hyperparameters.
method HCDC algorithm that matches hyperparameter gradients for synthetic validation dataset.
result HCDC effectively maintains validation-performance rankings of models.

DIGEN benchmark provides synthetic datasets for ML algorithm evaluation.

problem Understanding and comparing machine learning algorithms' performance.
method Synthetic datasets generated using 40 mathematical functions to evaluate machine learning algorithms.
result DIGEN resource facilitates understanding why algorithms perform poorly and provides ideas for improvement.

Adaptive methods learn from multiple datasets, leveraging similarities and robust to outliers.

problem Simultaneously analyze multiple datasets with possible similarities and differences.
method Adaptive multi-task learning methods that automatically utilize similarities and handle differences.
result Sharp statistical guarantees and robustness against outlier tasks demonstrated.

Improves accuracy and fairness in prediction systems with multiple domain experts.

problem Designing unbiased and accurate deferral systems with multiple experts.
method Proposes a framework for learning a classifier and deferral system that chooses to defer to multiple human experts.
result Significantly improves accuracy and fairness of final predictions compared to baselines.

SYNC generates synthetic data from aggregated sources using Gaussian copulas.

problem Creating synthetic datasets from aggregated sources.
method SYNC uses Gaussian copula models to infer high-resolution data from low-resolution sources.
result SYNC successfully merges sampled subsets into a single synthetic dataset.

Study shows current image classification models lack robustness to real-world dataset shifts.

problem Robustness of current image classification models to natural distribution shifts in real datasets.
method Evaluation of 204 ImageNet models in 213 different test conditions.
result Little to no transfer of robustness from synthetic to natural distribution shifts.

Detect hidden confounding in observational data using multiple environments.

problem Detect hidden confounding in observational data.
method Theoretical framework and simulation studies to test for hidden confounding.
result The proposed procedure correctly predicts hidden confounding, especially when bias is large.

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

problem Finding linear relationships across multiple datasets with sparse loading vectors.
method Formulated as generalized eigenvalue problems, used a thresholded gradient descent algorithm.
result Proposed algorithm yields tight estimation error bounds and demonstrates effectiveness on synthetic datasets.

AutoSimulate efficiently optimizes synthetic data generation.

problem Optimizing synthetic data generation for machine learning.
method Differentiable approximation of the objective function for efficient optimization.
result Significantly faster (up to 50x) and more efficient (up to 30x) synthetic data generation.

New method constructs synthetic treatment groups without mean exchangeability assumption.

problem Violations of mean exchangeability assumption in randomized controlled trials.
method Weighted mixture of treatment groups from source populations, minimizing conditional maximum mean discrepancy.
result Asymptotic normality of synthetic treatment group estimator established.

Properties of data are frequently seen to vary depending on the sampled situations, which usually changes along a time evolution or owing to environmental effects. One way to analyze such data is to find invariances, or representative features kept constant over changes. The aim of this paper is to identify one such fe…

2012-03-01abs ↗pdf ↗

Integrates MRF into multimodal VAE for better complex intermodal interactions.

problem Lack of effective modeling of complex intermodal interactions in multimodal VAEs.
method Incorporates Markov Random Field into prior and posterior distributions of multimodal VAE.
result Demonstrates superior performance in managing complex intermodal dependencies.

The rising interest in pattern recognition and data analytics has spurred the development of innovative machine learning algorithms and tools. However, as each algorithm has its strengths and limitations, one is motivated to judiciously fuse multiple algorithms in order to find the "best" performing one, for a given da…

2017-12-08abs ↗pdf ↗

In this paper, we propose a novel method for generating a synthetic dataset obeying Gaussian distribution. Compared to the commonly used benchmark datasets with unknown distribution, the synthetic dataset has an explicit distribution, i.e., Gaussian distribution. Meanwhile, it has the same characteristics as the benchm…

2019-06-01abs ↗pdf ↗

Multiple clustering aims at discovering diverse ways of organizing data into clusters. Despite the progress made, it's still a challenge for users to analyze and understand the distinctive structure of each output clustering. To ease this process, we consider diverse clusterings embedded in different subspaces, and ana…

2019-05-10abs ↗pdf ↗

Interactive learning is a process in which a machine learning algorithm is provided with meaningful, well-chosen examples as opposed to randomly chosen examples typical in standard supervised learning. In this paper, we propose a new method for interactive learning from multiple noisy labels where we exploit the disagr…

2016-07-24abs ↗pdf ↗

CardiCat generates synthetic data for high-cardinality tabular datasets.

problem Learning complexities of high-cardinality categorical features in tabular data.
method Substitutes one-hot encoding with regularized dual encoder-decoder embedding layers.
result Generates high-quality synthetic data with a smaller parameter space.

DP-CDA generates synthetic data to enhance privacy in high-dimensional datasets.

problem Privacy concerns in anonymized datasets, especially in high-dimensional data.
method Randomized mixing of privacy-sensitive data in a class-specific manner with carefully tuned randomness.
result DP-CDA provides stronger privacy guarantees compared to existing methods, maintaining utility.

Enhanced synthetic dataset improves asset allocation analysis.

problem Lack of realistic synthetic data for fixed income portfolio construction.
method Improved CorrGAN model for synthetic correlation matrices and Encoder-Decoder model for additional data conditioning.
result Synthetic dataset enhances portfolio construction and asset allocation analysis.

DP-FedTabDiff generates private synthetic tabular data using diffusion models and differential privacy.

problem Privacy-preserving synthetic data generation for tabular data in regulated domains.
method Combines Differential Privacy, Federated Learning, and Denoising Diffusion Probabilistic Models.
result Achieves significant privacy improvements without compromising data quality.