Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

2825648451,127 · Jun 202019922001200920172026
48 results for Sample Sets

The two-sample hypothesis testing problem is studied for the challenging scenario of high dimensional data sets with small sample sizes. We show that the two-sample hypothesis testing problem can be posed as a one-class set classification problem. In the set classification problem the goal is to classify a set of data …

2017-06-18abs ↗pdf ↗

The paper sets sample complexity bounds for identifying LTI systems from a finite set.

problem Identifying an LTI system from a finite set of possible systems using trajectory data.
method Maximum likelihood estimator and information theory tools.
result Upper and lower bounds for sample complexity are derived, independent of stability assumption.

An algorithm solves optimization problems with large sample sets, improving worst-case complexity.

problem Continuous nonlinear-equality-constrained optimization problems with large numbers of terms.
method Progressively sampled finite sets to solve related problems with growing sample sizes.
result Better worst-case sample complexity compared to solving with full sets of samples.

Novel approach for SEM in small samples with p>np>n.

problem Small sample size and p>np>n issues in factor-based SEM.
method Reformulates covariance structure into self-covariance and cross-covariance, defines a feasible set with relative error constraint.
result Improved stability and directional information in small-sample settings.

An axiomatic approach to signal reconstruction is formulated, involving a sample consistent set and a guiding set, describing desired reconstructions. New frame-less reconstruction methods are proposed, based on a novel concept of a reconstruction set, defined as a shortest pathway between the sample consistent set and…

2017-02-02abs ↗pdf ↗

The paper examines how sampling data affects the performance of submodular maximization.

problem Performance loss due to probability sampling in submodular maximization.
method Examines a simple probability sampling method where each data point is selected with probability at least r.
result The sampling gap is both upper and lower bounded by 1/r for policywise submodular utility functions.

Big data sets must be carefully partitioned into statistically similar data subsets that can be used as representative samples for big data analysis tasks. In this paper, we propose the random sample partition (RSP) data model to represent a big data set as a set of non-overlapping data subsets, called RSP data blocks,…

2017-12-12abs ↗pdf ↗

A new method to understand neural networks by sampling the 'inverse set' of a neuron.

problem Understanding the internal representation of neurons in neural networks.
method Optimization-based sampling approach to characterize the input space that excites a neuron.
result Inspection of samples reveals regularities that help understand the neuron's representation.

A new algorithm improves credit scoring accuracy for imbalanced data.

problem Poor classification of minority class in credit scoring data sets.
method Weighted-Hybrid-Sampling-Boost (WHSBoost) algorithm with balanced data sampling.
result WHSBoost outperforms other methods in credit scoring accuracy.

The paper introduces a sampling theory for graphons with a Poincaré inequality and proves consistency.

problem Sampling on large graphs is challenging due to their non-Euclidean nature.
method The paper introduces a signal sampling theory for graphons, proving a Poincaré inequality and showing consistency.
result Unique sampling sets for graphon signals are consistent across graph sequences.

Sampling is a fundamental topic in graph signal processing, having found applications in estimation, clustering, and video compression. In contrast to traditional signal processing, the irregularity of the signal domain makes selecting a sampling set non-trivial and hard to analyze. Indeed, though conditions for graph …

2017-04-05abs ↗pdf ↗

The paper identifies a 'small' set of functions containing Gaussian process samples.

problem Identifying a small set of functions containing Gaussian process samples.
method Using scaled RKHSs and Karhunen-Loève theorem, the paper defines the sample support set.
result The sample support set consists of functions with bounded squared basis coefficients.

Efficient algorithm for estimating target mean under known sampling distribution.

problem Statistical estimation under known sampling distribution without distributional assumptions.
method Worst-case analysis of weighted combination of sample values.
result Worst-case expected error is at most a π/2 factor worse than optimal.

Boosting with unlabeled data achieves optimal sample complexity in agnostic settings.

problem Boosting's sample inefficiency in agnostic learning.
method Designing an agnostic boosting algorithm with unlabeled data to match ERM's sample complexity.
result The total sample complexity is optimal, with a vanishing fraction needing to be labeled.

This paper proposes a method to use deep neural networks as end-to-end open-set classifiers. It is based on intra-class data splitting. In open-set recognition, only samples from a limited number of known classes are available for training. During inference, an open-set classifier must reject samples from unknown class…

2019-03-12abs ↗pdf ↗

Improved bounds for function approximation in nonlinear sets.

problem Achieving high probability error with limited samples in nonlinear function approximation.
method Restricting model class to a neighbourhood of the best approximation and estimating sample complexity using tangent and normal spaces' complexities and curvature.
result Improved worst-case bounds for sample complexity in more general sets like tensor networks and neural networks.

Develops a new method for sampling from Bayesian credible sets using deep generative quantile learning.

problem Sampling from posterior distributions in high-dimensional spaces with intractable likelihoods.
method Uses deep neural networks to implicitly sample from Bayesian credible sets via a push-forward mapping and Monge-Kantorovich depth.
result Demonstrates improved performance and theoretical consistency of the quantile learning framework.

New method for identifying best designs in vector optimization with uncertain feedback.

problem Optimizing vector-valued outcomes with uncertain preferences.
method Stochastic bandit feedback, polyhedral ordering cone, (ε,δε,δ)-PAC Pareto set identification.
result Sample complexity characterized and matched by the naïve elimination algorithm.

New method reduces ensemble size for linear bandits, achieving near optimal regret.

problem Achieving near optimal regret in linear bandits with limited ensemble size.
method Ensemble sampling with a size of order dlogTd \log T for a dd-dimensional stochastic linear bandit.
result Regret is at most (dlogT)5/2T(d \log T)^{5/2} \sqrt{T}, improving over linear scaling with TT.

Efficiently estimate Boolean product distribution parameters from truncated samples.

problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.

Higher bootstrap rates than 1.0 improve random forest performance.

problem Improving random forest performance with bootstrap sampling rates greater than 1.0.
method Evaluated 36 diverse datasets with bootstrap rates ranging from 1.2 to 5.0.
result Higher bootstrap rates (BR > 1.0) statistically improve classification accuracy in random forests.

Enhanced Sampling Scheme improves masked generative modeling.

problem Limitations of existing sampling schemes in masked non-autoregressive generative modeling.
method ESS consists of three stages: Naive Iterative Decoding, Critical Reverse Sampling, and Critical Resampling.
result ESS achieves significant performance gains in unconditional and class-conditional sampling.

This paper proposes asal, a new GAN based active learning method that generates high entropy samples. Instead of directly annotating the synthetic samples, ASAL searches similar samples from the pool and includes them for training. Hence, the quality of new samples is high and annotations are reliable. To the best of o…

2018-08-20abs ↗pdf ↗

Develops asymptotic analysis for RandNLA sampling estimators in least-squares problems.

problem Lack of distributional information for RandNLA estimators in statistical inference.
method Asymptotic analysis of sampling estimators for least-squares problems in two settings.
result Sampling estimators are asymptotically normally distributed under mild conditions.

Neural networks compress and sample WDN contamination dynamics efficiently.

problem Infrastructure monitoring of complex, networked systems like water distribution networks is expensive and challenging.
method Developed Graph Fourier Transform (GFT) operators and neural networks (NN) for efficient data collection and inference.
result High accuracy reconstruction of contamination dynamics using only 5-10% of the sample set.

We consider the problem of estimating the mean of a symmetric log-concave distribution under the constraint that only a single bit per sample from this distribution is available to the estimator. We study the mean squared error as a function of the sample size (and hence the number of bits). We consider three settings:…

2019-01-10abs ↗pdf ↗

The level sets of neural networks represent fundamental properties such as decision boundaries of classifiers and are used to model non-linear manifold data such as curves and surfaces. Thus, methods for controlling the neural level sets could find many applications in machine learning. In this paper we present a simpl…

2019-05-28abs ↗pdf ↗

Efficiently samples conformal boundaries in high dimensions using flows.

problem Difficulty in interpreting and using prediction sets in high-dimensional or structured output spaces.
method Flow-based approach using differentiable nonconformity scores to induce deterministic flows on the output space.
result Sampling conformal boundaries in arbitrary dimensions becomes computationally efficient and training-free.

Curriculum Labeling improves semi-supervised learning with pseudo-labeling, achieving high accuracy with minimal labeled data.

problem Improving semi-supervised learning with limited labeled data.
method Applying curriculum learning principles and restarting model parameters before each self-training cycle.
result 94.91% accuracy on CIFAR-10 with only 4,000 labeled samples.

The paper tackles sampling biases by ensuring minority groups are adequately represented in training data.

problem Sampling biases in training data lead to algorithmic biases in machine learning systems.
method The paper presents adaptive sampling methods to determine if it's possible to assemble a representative dataset from given data sources.
result The methods presented can determine with high confidence if a representative dataset can be assembled from given data sources.

Optimization algorithms and Monte Carlo sampling algorithms have provided the computational foundations for the rapid growth in applications of statistical machine learning in recent years. There is, however, limited theoretical understanding of the relationships between these two kinds of methodology, and limited unde…

2018-11-20abs ↗pdf ↗

Study improves treatment effect estimation using unlabeled covariates.

problem Estimating treatment effects with limited labeled data.
method Developed efficiency bounds and estimators for semi-supervised setting.
result Estimators using unlabeled covariates have lower asymptotic variance.

The study examines property testing and estimation under non-identically distributed samples, finding necessary and sufficient sample complexities.

problem Property testing and estimation under non-identically distributed samples.
method Analysis of distributional property testing and estimation in settings with heterogeneous entities.
result Necessary and sufficient sample complexities for property testing and estimation under non-identically distributed samples.

We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset SRdS \subseteq \R^d. This core problem in truncated statistics has long history going back to Galton, Lee, Pearson and Fisher. Recent work by Daskalakis et al. (FOCS'18), provide…

2019-08-02abs ↗pdf ↗