Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

62125187249 · Jun 202019922001200920172026
48 results for paired-sample testing

A new framework for paired-sample testing in high-dimensional data.

problem Challenges in standard paired-sample testing for high-dimensional data.
method Develops a two-step testing procedure using scoring functions and Wilcoxon signed-rank test.
result Substantial performance gains in testing accuracy compared to traditional methods.

New sampling methods improve Shapley values for explaining machine learning predictions.

problem Computational limitations in calculating Shapley values for complex models.
method Asymptotic normality results and paired-sampling approximations (KernelSHAP and PermutationSHAP).
result Paired-sampling PermutationSHAP provides exact results for interactions of maximal order two and has the additive recovery property.

Obtaining common representations from different modalities is important in that they are interchangeable with each other in a classification problem. For example, we can train a classifier on image features in the common representations and apply it to the testing of the text features in the representations. Existing m…

2016-12-23abs ↗pdf ↗

A new estimator, OddSHAP, simplifies Shapley value computation by focusing on odd components.

problem Efficient computation of Shapley values in machine learning.
method Proved Shapley value depends on odd components, proposed OddSHAP for polynomial regression on odd subspace.
result OddSHAP achieves state-of-the-art estimation accuracy with reduced sampling.

Estimating mutual information is an important statistics and machine learning problem. To estimate the mutual information from data, a common practice is preparing a set of paired samples {(xi,yi)}i=1ni.i.d.p(x,y)\{(\mathbf{x}_i,\mathbf{y}_i)\}_{i=1}^n \stackrel{\mathrm{i.i.d.}}{\sim} p(\mathbf{x},\mathbf{y}). However, in many situations, it…

2019-09-05abs ↗pdf ↗

Domain adaptation aims to assist the modeling tasks of the target domain with knowledge of the source domain. The two domains often lie in different feature spaces due to diverse data collection methods, which leads to the more challenging task of heterogeneous domain adaptation (HDA). A core issue of HDA is how to pre…

2019-05-22abs ↗pdf ↗

L-Cool improves image and language translation by cooling low-density samples.

problem Improving translation performance on fringe samples in unsupervised domain translation.
method Performing Langevin dynamics to move low-density samples towards high-density areas.
result L-Cool enhances state-of-the-art methods in image and language translation tasks.

Paper presents a method to align unpaired samples across different modalities.

problem Challenges in collecting paired samples for multimodal representation learning.
method Uses propensity score alignment based on Rubin's framework to estimate a common space for unpaired samples.
result Optimal transport matching significantly improves alignment in real-world data.

We extend multi-way, multivariate ANOVA-type analysis to cases where one covariate is the view, with features of each view coming from different, high-dimensional domains. The different views are assumed to be connected by having paired samples; this is a common setup in recent bioinformatics experiments, of which we a…

2009-12-16abs ↗pdf ↗

Data augmentation is a widely used technique in many machine learning tasks, such as image classification, to virtually enlarge the training dataset size and avoid overfitting. Traditional data augmentation techniques for image classification tasks create new samples from the original training data by, for example, fli…

2018-01-09abs ↗pdf ↗

Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a classifier to distinguish between pairs of parameter-observation samples generated using…

2020-02-10abs ↗pdf ↗

Weak supervision enables learning causal representations from unstructured data.

problem Learning high-level causal representations from unstructured data like images.
method Weakly supervised setting with paired samples before and after interventions. Implicit latent causal models using variational autoencoders.
result Models can reliably identify causal structure and disentangle causal variables.

A Triangle Generative Adversarial Network (ΔΔ-GAN) is developed for semi-supervised cross-domain joint distribution matching, where the training data consists of samples from each domain, and supervision of domain correspondence is provided by only a few paired samples. ΔΔ-GAN consists of four neural networks, two ge…

2017-09-19abs ↗pdf ↗

Paper tackles missing data in irregularly-sampled time series.

problem Modeling irregularly-sampled time series data.
method Encoder-decoder framework based on variational autoencoders and generative adversarial networks.
result Models achieve competitive or better classification results on irregularly-sampled multivariate time series.

A model for hit song prediction can be used in the pop music industry to identify emerging trends and potential artists or songs before they are marketed to the public. While most previous work formulates hit song prediction as a regression or classification problem, we present in this paper a convolutional neural netw…

2017-10-30abs ↗pdf ↗

Filtering data with a pre-trained model improves multimodal contrastive learning performance.

problem Improving the quality of internet-scale multimodal datasets.
method Characterized the performance of filtered contrastive learning under a bimodal data generation model.
result Data filtering using a pre-trained model reduces contrastive learning error by a factor of η\sqrt{η} in the large ηη regime.

LSDM uses unpaired data to match latent space distributions for generative modeling.

problem Generating high-quality images with limited paired data.
method Two-stage approach: latent space learning from paired and unpaired data, followed by joint distribution matching.
result LSDM enhances geometric fidelity in generated outputs and provides theoretical insights into LDMs.

SPLICE method disentangles shared and private latent variables from multi-view data.

problem Lack of methods to characterize nonlinear relationships and preserve geometric information in multi-view data.
method Neural network-based approach to infer disentangled, interpretable representations of shared and private latent variables.
result SPLICE yields more interpretable representations by preserving geometry and is more robust to incorrect latent dimensionality.

Develops a framework for multi-objective learning in diffusion models with limited labeled data.

problem Achieving good trade-offs in multi-objective learning with diffusion models requires a generalist model class with larger capacity than individual tasks.
method Proposes a two-stage training procedure: first fitting specialist models from limited paired data, then distilling them into a generalist model.
result Establishes generalization bounds showing the number of paired samples depends only on specialist model complexity.

This paper speeds up uncertainty quantification in inverse problems using conditional normalizing flows.

problem Uncertainty quantification in inverse problems with partial observations.
method Two-step scheme using normalizing flows and joint data to train conditional and inverse generators.
result Significant training speedup when reusing pretrained networks for new data.

A family of maximum mean discrepancy (MMD) kernel two-sample tests is introduced. Members of the test family are called Block-tests or B-tests, since the test statistic is an average over MMDs computed on subsets of the samples. The choice of block size allows control over the tradeoff between test power and computatio…

2013-07-08abs ↗pdf ↗

USP test improves on Pearson's chi-squared and GG-test for independence.

problem Deficiencies in Pearson's chi-squared and GG-test for independence.
method USP test based on UU-statistic estimator of population dependence measure.
result USP test controls size, handles small cell counts, and detects minimal violations of independence.

This paper provides a comprehensive survey of Machine Learning Testing (ML testing) research. It covers 144 papers on testing properties (e.g., correctness, robustness, and fairness), testing components (e.g., the data, learning program, and framework), testing workflow (e.g., test generation and test evaluation), and …

2019-06-19abs ↗pdf ↗

Robust test for distributions under Hellinger distance, simpler than optimal tests.

problem Testing and estimating distributions robustly under Hellinger distance.
method Simple robust hypothesis test with optimal sample complexity, robust to Hellinger distance perturbations.
result Empirically demonstrated robustness and power of the test on canonical distributions.

Simple methods combine statistical tests for out-of-distribution detection.

problem Detecting data points not following the training distribution.
method Combining classical parametric tests (Rao's score test) and a typicality test.
result Combining Fisher's method of test statistics improves out-of-distribution detection accuracy.

Unified score and distance-based GoF tests for model adequacy.

problem Difficulty in extending score-based GoF tests to nonparametric alternatives.
method Introducing semiparametric kernelized Stein discrepancy (SKSD) test.
result SKSD test is computationally efficient and universally consistent.

New methods for CI testing under model misspecification.

problem Challenges in CI testing with misspecified models.
method Proposes new approximations and upper bounds for testing errors of regression-based CI tests.
result Introduces the Rao-Blackwellized Predictor Test (RBPT) robust against misspecified inductive biases.

Discusses MultiFIT for multivariate dependence, comparing it to HSIC tests.

problem Comparing Multiscale Fisher's Independence Test (MultiFIT) to HSIC tests for multivariate dependence.
method Compares MultiFIT to HSIC tests, highlighting exact level control and performance limitations.
result Observes performance limitations of MultiFIT in terms of test power.

The repeated community-wide reuse of test sets in popular benchmark problems raises doubts about the credibility of reported test-error rates. Verifying whether a learned model is overfitted to a test set is challenging as independent test sets drawn from the same data distribution are usually unavailable, while other …

2019-03-06abs ↗pdf ↗

Develops hypothesis tests for conditional distributions using learning-theoretic bounds.

problem Testing differences in conditional distributions and functionals.
method Transforming learning-theoretic bounds into hypothesis tests for conditional expectations.
result Establishes comprehensive foundation for conditional testing, including theoretical guarantees and practical implementations.

Paper proposes a new method for more accurate group testing of infected patients.

problem Identifying infected patients efficiently with reduced tests and corrected errors.
method Adaptive design of pools based on Bayesian posterior prediction using belief propagation algorithm.
result The proposed method results in more accurate identification of infected patients.

Improved MMD test for two-sample testing with random Fourier features.

problem Quadratic-time complexity of MMD test for large-scale analysis.
method Approximated MMD test using random Fourier features, investigating time-power trade-off.
result Sub-quadratic time complexity with same minimax separation rates as MMD test.