This work improves trace norm regularization for multi-task learning with limited data.
problem Learning from few samples across multiple tasks.
method Trace norm regularization for a linear shared representation model.
result First estimation error bound for trace norm regularized estimator with scarce data.
Improved ranking method for scarce data with feature info.
problem Ranking items with limited comparisons and feature data.
method Modified RankCentrality using diffusion methods for feature info.
result Meaningful rankings even with scarce comparisons.
Paper tackles RUL prediction with scarce data using indirect supervision.
problem Predicting RUL with indirect supervision and scarce time series data.
method Unified framework called parameterized static regression, handling data scarcity without interpolation.
result Competitive performance in prediction accuracy with simulated data scarcity.
In medical risk modeling, typical data are "scarce": they have relatively small number of training instances (N), censoring, and high dimensionality (M). We show that the problem may be effectively simplified by reducing it to bipartite ranking, and introduce new bipartite ranking algorithm, Smooth Rank, for robust lea…
Proposes a method to improve treatment policies in data-scarce clinical settings.
problem Improving treatment policies in data-scarce clinical settings with unobserved confounding.
method Uses a causal mechanism to model the underlying generative process and augments counterfactual trajectories with source domain priors.
result Significantly improves treatment policy performance in a simulated sepsis treatment task.
Paper analyzes weak-to-strong generalization in CNNs, identifying data-scarce and data-abundant regimes.
problem Weak-to-strong generalization in CNNs trained on weak models.
method Formal analysis of gradient descent dynamics in data-scarce and data-abundant regimes.
result Identifies two regimes and distinct mechanisms of generalization in each.
Enhances MIL performance in scarce data scenarios using topological inductive biases.
problem Low performance of MIL in data-scarce scenarios.
method Incorporates topological inductive biases into MIL framework.
result Average performance improvements of 15.3% for synthetic datasets, 2.8% for benchmarks, and 5.5% for rare anemia classification.
New approach uses low-fidelity data to train ML models efficiently.
problem Training ML models with scarce high-fidelity data leads to high variance and poor generalization.
method Multifidelity linear regression using approximate control variates.
result Multifidelity training achieves similar accuracy with reduced high-fidelity data.
BAR reprograms black-box ML models for transfer learning with scarce data.
problem Transfer learning with limited data and resources.
method Zeroth-order optimization and multi-label mapping techniques to reprogram black-box models.
result BAR outperforms state-of-the-art methods and baseline transfer learning approaches.
Sparse random features improve accuracy in data-scarce settings.
problem Limited accuracy of random feature methods in data-scarce applications.
method Sparse random feature expansion using compressive sensing.
result Improved generalization bounds for sparse random features.
Deep learning improves low-fidelity dynamical models with scarce high-fidelity data.
problem Improving low-fidelity models with limited high-fidelity data.
method Transfer learning using a deep neural network to correct a low-fidelity model.
result An improved DNN model with high accuracy to underlying dynamics.
Paper tackles robust prediction of nuclear reactor materials under scarce data.
problem Challenges of data scarcity and uncertainty in nuclear reactor design.
method Meta-learning approach informed by uncertainty and prior knowledge.
result Achieves superior performance in rupture life prediction.
Generative algorithms learn high-dimensional data efficiently and generate new samples.
problem Learning from scarce high-dimensional data.
method Lipschitz-regularized gradient flows and particle-based algorithms.
result Correctly transports gene expression data points with high dimensionality.
Reconstructing observed images from fMRI brain recordings is challenging. Unfortunately, acquiring sufficient "labeled" pairs of {Image, fMRI} (i.e., images with their corresponding fMRI responses) to span the huge space of natural images is prohibitive for many reasons. We present a novel approach which, in addition t…
We describe a method to identify poor households in data-scarce countries by leveraging information contained in nationally representative household surveys. It employs standard statistical learning techniques---cross-validation and parameter regularization---which together reduce the extent to which the model is over-…
SPI uses synthetic data to improve predictive inference efficiency.
problem Inefficient predictive inference with scarce calibration data.
method Integrates synthetic data to align nonconformity scores and improve coverage guarantees.
result SPI yields substantially tighter and more informative prediction sets.
New AI error correctors improve classifier performance with provable guarantees.
problem Improving AI classifier performance with scarce training data.
method Weakly supervised AI error correctors with performance guarantees.
result Provable performance guarantees for AI error correction.
New framework improves fairness in small data settings.
problem Ensuring fairness in low-data environments.
method Combines posterior sampling exploration with fair classification.
result Framework maximizes accuracy while meeting fairness constraints.
Study shows low-complexity models can perform as well as state-of-the-art on small datasets.
problem Performance of deep learning models on small datasets.
method Wide variety of experiments with different deep learning architectures on small datasets.
result Low-complexity models can perform comparably well or better than state-of-the-art models on small datasets.
This work combines autoencoder transfer learning with MSCP for accurate aerodynamic predictions.
problem Data scarcity in aerodynamic modeling limits the use of high-fidelity simulations.
method Autoencoder-based transfer learning with MSCP for uncertainty-aware data fusion.
result The model achieves high accuracy with minimal high-fidelity training data and robust uncertainty bands.
This paper evaluates conformal prediction for aerial image classification in challenging environments.
problem Challenging aerial image classification in data-scarce, unconstrained environments.
method Conformal prediction applied to pretrained models (MobileNet, DenseNet, ResNet) with limited labeled data.
result Conformal prediction can provide valuable uncertainty estimates even with small labeled samples.
This work discovers governing equations from limited data using physics-informed deep learning.
problem Discovering governing equations from scarce and noisy data for complex systems.
method Physics-informed deep learning framework integrating neural networks, physics embedding, and sparse regression.
result The method effectively identifies governing equations from various spatiotemporal systems with different levels of data scarcity and noise.
Spectral regularization improves learning over combinatorial spaces with limited data.
problem Learning pseudo-Boolean functions with scarce labeled data.
method Regularizing the spectral representation of learned functions using the L_1 norm.
result Regularization allows for data-frugal learning and achieves statistically optimal generalization performance.
BLADE uses Bayesian methods to discover complex systems from scarce data.
problem Efficiently discovering governing equations of complex dynamical systems from limited data.
method Combines replica-exchange stochastic gradient Langevin Monte Carlo with active learning.
result Reduces measurement requirements by 60% for Lotka-Volterra and 40% for Burgers' equation.
New methods improve inference with scarce labels using regression.
problem Efficient inference with limited labeled data.
method Relates PPI++ to ordinary least squares regression and uses robust regressors.
result Improved variance in estimators for few-label scenarios.
New ASR system handles multiple languages without needing language-specific encoding.
problem Joint training of data-rich and data-scarce languages in a single model.
method Transforms all languages to a single writing system through transliteration, separating modeling and rendering.
result Language-agnostic multilingual ASR system reduces WER up to 10% over language-dependent models.
Many real-world time-series analysis problems are characterised by scarce data. Solutions typically rely on hand-crafted features extracted from the time or frequency domain allied with classification or regression engines which condition on this (often low-dimensional) feature vector. The huge advances enjoyed by many…
The effectiveness of machine learning algorithms depends on the quality and amount of data and the operationalization and interpretation by the human analyst. In humanitarian response, data is often lacking or overburdening, thus ambiguous, and the time-scarce, volatile, insecure environments of humanitarian activities…
Flood forecasts are crucial for effective individual and governmental protective action. The vast majority of flood-related casualties occur in developing countries, where providing spatially accurate forecasts is a challenge due to scarcity of data and lack of funding. This paper describes an operational system provid…
Neural networks (NNs) have become the state of the art in many machine learning applications, especially in image and sound processing [1]. The same, although to a lesser extent [2,3], could be said in natural language processing (NLP) tasks, such as named entity recognition. However, the success of NNs remains depende…
This work analyzes how to choose regularization norms for adversarial training in high dimensions.
problem Choosing the right regularization norm for adversarial training in high-dimensional settings.
method Derives asymptotic descriptions and uniform convergence bounds for robust, regularized empirical risk minimizers.
result Characterizes the relationship between perturbation size and optimal regularization choice.
In this document we are going to derive the equations needed to implement a Variational Bayes i-vector extractor. This can be used to extract longer i-vectors reducing the risk of overfittig or to adapt an i-vector extractor from a database to another with scarce development data. This work is based on Patrick Kenny's …
The paper evaluates index-based allocation policies using data from randomized control trials.
problem Evaluating index-based allocation policies in resource-scarce scenarios.
method Using data from randomized control trials, the paper introduces an efficient estimator and methods for computing asymptotically correct confidence intervals.
result Valid statistical conclusions can be drawn for index-based allocation policies.
We address challenges of active learning under scarce informational resources in non-stationary environments. In real-world settings, data labeled and integrated into a predictive model may become invalid over time. However, the data can become informative again with switches in context and such changes may indicate un…
AGGAN uses genetic algorithm with simulated annealing to generate minority class data.
problem Overcoming class imbalance in minority class data.
method AGGAN combines genetic algorithm and simulated annealing to train GANs on scarce minority class data.
result AGGAN effectively generates minority class data distributions from limited samples.
This work improves surrogate models using low-fidelity data to enhance accuracy and efficiency.
problem Limited training data makes high-fidelity models unreliable.
method Uses low-fidelity data to augment input space and condition high-fidelity models.
result Increased predictive accuracy and reduced computational cost compared to existing methods.
Radio emitter recognition in dense multi-user environments is an important tool for optimizing spectrum utilization, identifying and minimizing interference, and enforcing spectrum policy. Radio data is readily available and easy to obtain from an antenna, but labeled and curated data is often scarce making supervised …
Develops estimators for near-optimal linear regression under distribution shift.
problem Linear regression under distribution shift with scarce target domain data.
method Minimax linear risk estimators covering various transfer learning settings.
result Achieves near-optimal risk for linear regression problems under distribution shift.
User authentication and intrusion detection differ from standard classification problems in that while we have data generated from legitimate users, impostor or intrusion data is scarce or non-existent. We review existing techniques for dealing with this problem and propose a novel alternative based on a principled sta…
Estimates policy performance in small-data settings without sacrificing data.
problem Poor performance of cross-validation in small-data optimization.
method Uses sensitivity analysis to estimate gradient of optimal objective value.
result Explicit high-probability bounds on error of estimator for small-data, large-scale problems.
Paper compares semi-supervised training for differentiable particle filters.
problem Lack of labelled data in real-world applications.
method Compares two semi-supervised training objectives.
result Improved performance in environments with scarce labelled data.
Prognostics or Remaining Useful Life (RUL) Estimation from multi-sensor time series data is useful to enable condition-based maintenance and ensure high operational availability of equipment. We propose a novel deep learning based approach for Prognostics with Uncertainty Quantification that is useful in scenarios wher…
Parameter inference in ordinary differential equations is an important problem in many applied sciences and in engineering, especially in a data-scarce setting. In this work, we introduce a novel generative modeling approach based on constrained Gaussian processes and leverage it to build a computationally and data eff…
b-LOAD extends local causal discovery with prior knowledge, improving causal effect estimation.
problem Local causal discovery struggles in data-scarce settings due to uncertainty and incomplete neighborhoods.
method b-LOAD incorporates prior knowledge directly into local structure learning, using Meek's rules to refine discovery.
result b-LOAD refines the admissible equivalence class and enlarges identifiable causal queries, improving causal effect estimation.
Transformer model outperforms classical methods in childhood anemia prediction across diverse countries.
problem Generalizing childhood anemia prediction models across different countries and data scarcity.
method Transformer-based tabular foundation model compared to classical supervised methods using DHS data.
result Transformer model achieves lower Brier score and ECE in low-data settings, outperforming classical models.
DUPLE tackles cross-deployment recognition in fiber-optic perimeter security with meta-learning.
problem Cross-deployment recognition challenges in fiber-optic perimeter security due to label scarcity and distribution shifts.
method DUPLE employs statistically guided meta-learning to enhance recognition robustness across unseen deployments.
result DUPLE consistently outperforms traditional and meta-learning baselines in cross-deployment DFOS benchmarks.
Significant advances have been made in Natural Language Processing (NLP) modelling since the beginning of 2018. The new approaches allow for accurate results, even when there is little labelled data, because these NLP models can benefit from training on both task-agnostic and task-specific unlabelled data. However, the…
Additive models form a widely popular class of regression models which represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of these models is their interpretability: the transfer functions provide visual means…