Unified Bayesian model for multi-modal, small sample size biomedical data classification.
problem Classifying high-dimensional, multi-modal biomedical data with small sample sizes.
method Combines multi-modal data views into a latent space, prunes irrelevant features, and uses dual kernels for small sample size scenarios.
result Outperforms state-of-the-art models and identifies features aligned with existing markers.
Study evaluates synthetic data augmentation for small datasets, highlighting inconsistencies in traditional metrics.
problem Inconsistent validation of synthetic data generated for small sample sizes.
method Proposes a normalized Bottleneck distance metric to evaluate synthetic tabular data.
result Common metrics like propensity scoring and MMD fail for small datasets, showing instability and high variability.
Study examines mean estimation in high dimensions with small data.
problem Efficiently estimating mean in high-dimensional data with limited data size.
method Extensive experimentation of various mean estimation techniques.
result Developed robust methods for mean estimation with low data size.
Simple private estimators for mean and covariance outperform existing methods.
problem Private estimation of mean and covariance at small sample sizes.
method Differentially private estimators for multivariate sub-Gaussian data.
result Asymptotic error rates match theoretical bounds and outperform previous methods.
We propose a novel method to train deep convolutional neural networks which learn from multiple data sets of varying input sizes through weight sharing. This is an advantage in chemometrics where individual measurements represent exact chemical compounds and thus signals cannot be translated or resized without disturbi…
Regularized EM algorithm improves clustering performance with small sample sizes.
problem Performance reduction in EM algorithm due to small sample size and poorly conditioned covariance matrices.
method Regularized EM algorithm that uses prior knowledge to ensure positive definiteness of covariance matrices.
result The regularized EM algorithm outperforms standard EM in clustering tasks with small sample sizes.
Proposes a new signal model for high-dimensional, small-sample-size data.
problem Signal detection in high-dimensional, small-sample-size datasets.
method Intrinsic signal model based on dynamical system assumption.
result Taguchi method effectively detects signals in the proposed model.
SPREV simplifies visualization of complex labeled datasets.
problem Challenges of reducing dimensions and visualizing labeled datasets with small class size, high dimensionality, and low sample size.
method SPREV uses a novel dimensionality reduction technique integrating geometric principles.
result SPREV effectively visualizes hidden patterns in complex labeled datasets.
The paper investigates why GNNs struggle to generalize from small to large graphs.
problem Challenges in graph neural networks' ability to generalize across different graph sizes.
method Identified and studied the effect of local structure on size generalization; proposed a novel SSL task.
result GNNs can converge to non-generalizing solutions when there is a discrepancy in local structure.
We present a novel Metropolis-Hastings method for large datasets that uses small expected-size minibatches of data. Previous work on reducing the cost of Metropolis-Hastings tests yield variable data consumed per sample, with only constant factor reductions versus using the full dataset for each sample. Here we present…
Fewer obstructions for small graphs in knotless embedding.
problem Finite obstructions for knotless embedding of small graphs.
method Analysis of graph minor obstructions and knotless embedding.
result There are only three obstructions for size 23 graphs, significantly fewer than previously known.
We demonstrate that the lowest possible price change (tick-size) has a large impact on the structure of financial return distributions. It induces a microstructure as well as it can alter the tail behavior. On small return intervals, the tick-size can distort the calculation of correlations. This especially occurs on s…
Proposes a VAE for HDLSS data augmentation.
problem Data augmentation in HDLSS settings with small sample sizes.
method Geometry-based variational autoencoder with latent space modeling.
result Significant improvement in classification metrics (e.g., balanced accuracy from 66.3% to 74.3%).
Deep networks and forests perform differently with small samples.
problem Comparing deep networks and decision forests for small sample sizes.
method Unified view of both methods as partition and vote schemes, empirical comparison on various datasets.
result Forests excel with small tabular and structured data, deep nets better with larger samples.
Adversarial training can hurt robust accuracy in small sample size scenarios.
problem Adversarial training improves test accuracy but may degrade robustness in limited data settings.
method Analyzes high-dimensional linear classification with noiseless observations, and observes perceptible attacks on image datasets.
result Adversarial training can negatively impact robust generalization in small sample size regimes.
New method selects better graphs for GGM inference in small sample sizes.
problem Inference of conditional correlations in high-dimensional data with limited samples.
method Composite procedure combining nodewise edge selection and penalised likelihood maximisation.
result Our method produces graphs closer to the true distribution with better KL divergence.
SFCNeXt estimates brain age from small MRI datasets.
problem Efficiently estimating brain age from limited MRI data.
method Simple fully convolutional network (SFCNeXt) with SPEC and HRL.
result SFCNeXt outperforms complex models in small sample size scenarios.
Scalable methods integrate multiview data for clinical outcomes.
problem Jointly associate and predict outcomes from multiple data sources.
method Randomized Fourier bases for nonlinear mappings, view-independent low-dimensional representations.
result Identified molecular signatures for COVID-19 status and severity.
Estimates mass of static vacuum metrics with small Bartnik data.
problem Estimating mass of static vacuum metrics with small perturbations.
method Second-order mass estimation using Bartnik data.
result New upper bound on Bartnik mass to fifth order.
Paper proposes a method to evaluate SME credit risk using meta paths.
problem Evaluate credit risk of small and medium-sized enterprises with limited data.
method Exploits the representative power of information networks and meta paths to infer SME financial status.
result Meta path feature effectively identifies SMEs with credit risks.
Binary classification improves with a small fraction of corrupted labels.
problem Binary classification with corrupted labels.
method Established corruption as a form of regularization and computed upper bounds on estimation error.
result Corruption is beneficial only up to a small fraction of the total sample, scaling with the square root of the sample size.
VAE improves semi-supervised learning in small data.
problem Limited data in biological samples.
method Applied VAE to capture features in a lower-dimension.
result Improved performance in semi-supervised learning.
The paper explores how smaller data sets can lead to better model selection decisions.
problem Model selection in small data regimes.
method Empirical study of generalization performance with varying training set sizes.
result Training on smaller subsets of data can lead to more reliable model selection decisions.
A robust approach compensates for small-data tasks in mixed linear regression.
problem Learning from small batches of data in tasks with many similar but insufficiently labeled examples.
method Spectral approach combining outlier-robust PCA and sum-of-squares algorithms.
result The approach achieves a graceful statistical trade-off, allowing smaller tasks than previously required.
A new method improves AI fairness assessment by estimating performance across intersectional subgroups.
problem Limited evaluation of AI systems across intersectional subgroups due to small sample sizes.
method Structured regression approach to disaggregated evaluation.
result Our method yields more accurate performance estimates, especially for small subgroups.
Study identifies key metrics for small and large tick assets in LOBs.
problem Understanding microstructural properties of LOBs across different tick sizes.
method Hawkes Process model to fit LOBs of large and small tick assets.
result Model can transition stylized facts from large to small tick assets.
A new bootstrapping method reduces key sizes and runtime in FHE.
problem Large plaintext evaluation in FHE increases bootstrapping complexity.
method New polynomial vector representation and monic monomial permutation matrices.
result Polynomial factor improvement in key size and constant factor in runtime.
We make policy optimization algorithms batch size-invariant by decoupling proximal and behavior policies.
problem Some policy optimization algorithms do not have batch size-invariance, leading to inefficiencies.
method We decouple the proximal policy from the behavior policy to achieve batch size-invariance.
result Our approach makes policy optimization algorithms more efficient and allows them to use stale data more effectively.
Dirichlet process mixture (DPM) models tend to produce many small clusters regardless of whether they are needed to accurately characterize the data - this is particularly true for large data sets. However, interpretability, parsimony, data storage and communication costs all are hampered by having overly many clusters…
Bayesian methods reduce variance in subspace identification for small data sets.
problem High variance in traditional subspace identification methods for large models or small sample sizes.
method Investigation of Bayesian estimation solutions (regularized and shrinkage estimators) for subspace identification.
result Bayesian estimators reduce estimation risk by up to 40% compared to traditional methods.
Novel method converts time series data into functional data for high dimensional classification.
problem Small sample size problem in high dimensional time series data.
method Classwise Functional Principal Component Analysis (PCA) followed by Bayesian linear classifier.
result Demonstrated efficacy on synthetic and real data sets.
State-of-the-art implementations of boosting, such as XGBoost and LightGBM, can process large training sets extremely fast. However, this performance requires that the memory size is sufficient to hold a 2-3 multiple of the training set size. This paper presents an alternative approach to implementing the boosted trees…
A new method for averaging model predictions using minimum divergence.
problem Improving model averaging methods, especially in small samples.
method Minimum divergence framework for model weight calculation.
result Empirically outperforms standard model averaging methods.
New kernel model scales to large datasets.
problem Challenges in scaling kernel machines to large datasets.
method Introduced EigenPro 3.0, an algorithm based on projected dual preconditioned SGD.
result Ability to scale model and data sizes independently.
Datasets containing large samples of time-to-event data arising from several small heterogeneous groups are commonly encountered in statistics. This presents problems as they cannot be pooled directly due to their heterogeneity or analyzed individually because of their small sample size. Bayesian nonparametric modellin…
New SDP algorithm recovers large clusters in SBM with small clusters of any size.
problem Graph clustering in SBM with large and small clusters.
method Semidefinite programming (SDP) with novel techniques to handle small clusters.
result Proves exact recovery of large clusters regardless of small cluster sizes.
EASIER-net uses sparse networks to improve prediction accuracy for high-dimensional data.
problem Limited use of neural networks in high-dimensional data with small samples.
method Ensemble by Averaging Sparse-Input Hierarchical networks (EASIER-net) with small modifications to neural network architecture and training procedure.
result EASIER-net achieves higher prediction accuracy than off-the-shelf methods on average.
This paper studies the inference problem in quantile regression (QR) for a large sample size n but under a limited memory constraint, where the memory can only store a small batch of data of size m. A natural method is the naïve divide-and-conquer approach, which splits data into batches of size m, computes the l…
SLdisco uses supervised learning to discover causal models from observational data.
problem Estimating causal effects from observational data with limited samples and sparse models.
method Supervised machine learning to map observational data to causal equivalence classes.
result SLdisco is more conservative, less sensitive to sample size, and provides better model inference.
A desirable property of interpretable models is small size, so that they are easily understandable by humans. This leads to the following challenges: (a) small sizes typically imply diminished accuracy, and (b) bespoke levers provided by model families to restrict size, e.g., L1 regularization, might be insufficient to…
New statistical guarantee improves conformal predictors for small datasets.
problem Uncertainty quantification for small datasets in surrogate models.
method Proposed a new statistical guarantee for conformal predictors, converging to standard CP for large datasets.
result The new guarantee offers relevant information about coverage for small data sizes, improving applicability.
A new algorithm for robust causal discovery in small sample sizes.
problem Limited data leads to weak conditional independence tests in causal discovery.
method Proposes a k-PC algorithm that bounds conditioning set size for robust causal discovery. result The k-PC algorithm enables more robust causal discovery in small sample sizes. Study compares deep feature methods for anomaly detection in limited data scenarios.
problem Handling limited data in industrial inspection applications.
method Three approaches (KNN, Mahalanobis, PaDiM) using pre-trained deep features with data augmentation.
result Data augmentation significantly improves performance in small data regimes.
We study large-scale classification problems in changing environments where a small part of the dataset is modified, and the effect of the data modification must be quickly incorporated into the classifier. When the entire dataset is large, even if the amount of the data modification is fairly small, the computational …
One significant challenge to scaling entity resolution algorithms to massive datasets is understanding how performance changes after moving beyond the realm of small, manually labeled reference datasets. Unlike traditional machine learning tasks, when an entity resolution algorithm performs well on small hold-out datas…
In this paper, we study the problem of sparse multiple kernel learning (MKL), where the goal is to efficiently learn a combination of a fixed small number of kernels from a large pool that could lead to a kernel classifier with a small prediction error. We develop an efficient algorithm based on the greedy coordinate d…
Paper analyzes ensemble Kalman updates for effective dimension and localization.
problem Why small ensemble sizes work well in inverse problems and data assimilation.
method Non-asymptotic analysis of ensemble Kalman updates, focusing on effective dimension and localization.
result Rigorously explains why a small ensemble size is sufficient when prior covariance has moderate effective dimension.
Unified scaling laws reveal how model size and training time impact neural network performance.
problem Understanding how much performance improvement can be expected from scaling model size or data volume.
method Established scale-time equivalence and combined it with a linear model analysis of double descent.
result Unified theoretical scaling laws explain previously unexplained phenomena and offer a more accessible path to training large models.