GCNs help in diagnosing label scarcity and feature quality on graphs.
problem Understanding when GCNs improve node classification.
method Simulated label scarcity, feature ablation, and per-class analysis.
result GCNs provide largest gains under extreme label scarcity, matching original performance with noisy features, but hurt when homophily is low and features are strong.
Adaptive sampling detects local concept drift with limited labels.
problem Detecting local concept drift in dynamic environments with scarce labels.
method Combines residual-based exploration and exploitation with EWMA monitoring.
result Superior performance in label efficiency and drift detection accuracy.
Proposes a new VAE framework for anomaly detection in time series data.
problem Data scarcity leads to latent holes and discontinuous regions in latent space, causing non-robust reconstructions.
method Combines VAEs with self-supervised learning to address data scarcity and improve anomaly detection.
result Improves robustness of anomaly detection in time series data by addressing latent holes and discontinuities.
Paper explores VRM for PSMLC with partially labeled medical images.
problem Improving PSMLC with limited labeled data.
method Applies VRM to PSMLC for better model performance.
result VRM improves PSMLC performance with partial labels.
FedACS uses attention to select clients with similar data for federated learning.
problem Non-IID data and data scarcity in federated learning.
method FedACS integrates an attention mechanism to prioritize clients with similar data distributions.
result FedACS improves federated learning performance by addressing non-IID data and data scarcity.
RDLI integrates domain logic and context grounding to detect crypto anomalies under scarce labels.
problem Extreme label scarcity and evasion strategies in crypto networks.
method Relational Domain Logic Integration (RDLI) with Retrieval Grounded Context (RGC).
result RDLI outperforms GNN baselines by 28.9% in F1 score under 0.01% label scarcity.
DiffsFormer uses AI-generated samples to improve stock forecasting accuracy.
problem Data scarcity in stock forecasting, including low signal-to-noise ratio and data homogeneity.
method DiffsFormer employs a Diffusion Model with a Transformer architecture to generate augmented stock factors.
result DiffsFormer achieves significant improvements in stock forecasting accuracy (7.2% and 27.8% relative improvements for CSI300 and CSI800 datasets, respectively).
Synthetic datasets help study bias in ML, overcoming data scarcity.
problem Lack of relevant datasets for bias research in ML.
method Presented a family of synthetic datasets with adjustable bias levels.
result Demonstrated an experiment using synthetic data to study bias.
Model predicts political ideology using context vectors to mitigate bias and scarcity.
problem Scarcity and selection bias in political ideology prediction.
method Proposes a statistical model decomposing embeddings into context and position vectors, training an end-to-end model for deployment.
result Model can predict ideological labels even with minimal biased data, outperforming state-of-the-art methods.
Semi-pessimistic RL tackles distributional shift and data scarcity in offline RL.
problem Distributional shift and scarcity of labeled data in offline RL.
method Proposes a semi-pessimistic RL method that simplifies learning by seeking a lower bound of the reward function.
result Demonstrates clear competitiveness and improved policy learning with vast unlabeled data.
Paper tackles RUL prediction with scarce data using indirect supervision.
problem Predicting RUL with indirect supervision and scarce time series data.
method Unified framework called parameterized static regression, handling data scarcity without interpolation.
result Competitive performance in prediction accuracy with simulated data scarcity.
Enhances PHM solutions by augmenting scarce multivariate time series data.
problem Data scarcity in failure prognostics.
method Extends autoregressive models for data augmentation.
result Significantly improves PHM solution performance.
Unified approach combines prediction-powered inference and variance reduction for semi-supervised optimization.
problem Scarcity of labeled data in semi-supervised optimization.
method PPI-SVRG, combining PPI and SVRG methods.
result Unified convergence bound with improved performance under label scarcity.
Proposes a new method to estimate individual treatment effects using unlabeled data.
problem Difficult estimation of individual treatment effects due to high costs of intervention studies.
method Combines causal inference matching and semi-supervised learning label propagation.
result Demonstrates successful mitigation of data scarcity in ITE estimation.
New method detects money laundering in Bitcoin using minimal labels.
problem Detecting money laundering in Bitcoin transactions with scarce labels.
method Active learning approach to anomaly detection.
result 5% of labels are sufficient to match supervised baseline performance.
We investigate the geometry of word metrics on fundamental groups of manifolds associated with the generating sets consisting of elements represented by closed geodesics. We ask whether the diameter of such a metric is finite or infinite. The first answer we interpret as an abundance of closed geodesics, while the seco…
PINNs can learn trivial solutions; new approach improves performance.
problem PINNs fail to learn non-trivial solutions in data-scarce settings.
method Developed an alternative sampling approach and new penalty term.
result PINNs can be improved to learn non-trivial solutions with up to 80% fewer collocation points.
MarketGAN generates financial returns using GANs to match empirical stylized facts.
problem Generating financial returns under data scarcity and preserving stylized facts.
method Generative adversarial learning with a TCN backbone.
result MarketGAN outperforms conventional methods in portfolio applications.
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
Mathematical Reinforcement Learning faces a 'Two-Hump' problem due to sparse rewards and a scarcity of intermediate 'hard-but-solvable' instances.
problem Mathematical search problems in Reinforcement Learning
method Novel data generation techniques and algorithmic enhancements
result Substantial performance improvements over previous baselines
DKPS provides guarantees for synthetic data from Transformer models, improving downstream tasks.
problem Lack of labeled data for building performant AI models.
method Data Kernel Perspective Space (DKPS) for mathematical analysis of synthetic data quality.
result Concrete statistical guarantees for the quality of transformer model outputs.
Personalizes pre-trained models for nonparametric regression with limited data.
problem Improving data efficiency in nonparametric regression with few samples.
method Develops a theoretical framework and algorithms for few-shot personalization of black-box models.
result Achieves minimax optimal rate for personalization in nonparametric regression.
This work discovers governing equations from limited data using physics-informed deep learning.
problem Discovering governing equations from scarce and noisy data for complex systems.
method Physics-informed deep learning framework integrating neural networks, physics embedding, and sparse regression.
result The method effectively identifies governing equations from various spatiotemporal systems with different levels of data scarcity and noise.
Local Gaussian correlation struggles in tails but a new method improves it.
problem Local Gaussian correlation's limitations in tail dependence.
method A new adaptive bandwidth method for LGC, optimizing for local effective sample size.
result Adaptive bandwidths outperform global ones in moderate dependence, but not in strong or weak dependence.
Paper tackles robust prediction of nuclear reactor materials under scarce data.
problem Challenges of data scarcity and uncertainty in nuclear reactor design.
method Meta-learning approach informed by uncertainty and prior knowledge.
result Achieves superior performance in rupture life prediction.
Flood forecasts are crucial for effective individual and governmental protective action. The vast majority of flood-related casualties occur in developing countries, where providing spatially accurate forecasts is a challenge due to scarcity of data and lack of funding. This paper describes an operational system provid…
BLADE uses Bayesian methods to discover complex systems from scarce data.
problem Efficiently discovering governing equations of complex dynamical systems from limited data.
method Combines replica-exchange stochastic gradient Langevin Monte Carlo with active learning.
result Reduces measurement requirements by 60% for Lotka-Volterra and 40% for Burgers' equation.
Stablecoins promise to bridge fiat currencies with the world of cryptocurrencies. They provide a way for users to take advantage of the benefits of digital currencies, such as ability to transfer assets over the internet, provide assurance on minting schedules and scarcity, and enable new asset classes, while also part…
Method reweights auxiliary tasks to reduce data need for main task.
problem Limited labeled data for supervised learning.
method Formulates weighted likelihood function as surrogate prior, minimizing divergence to true prior.
result Effective use of limited labeled data with auxiliary tasks, improving performance.
Fused Encoder Networks improve momentum strategies on crypto data.
problem Deploying momentum strategies on crypto data with limited samples leads to over-fitted models.
method Hybrid transfer learning model combining source and target datasets.
result Fused Encoder Networks outperform classical momentum strategies and benchmarks.
Synthetic augmentation improves financial machine learning performance in variance-dominant regimes.
problem Data scarcity in financial machine learning.
method Formalized synthetic augmentation, introduced size-matched null augmentation, and developed a non-parametric block permutation test.
result Synthetic augmentation is beneficial only in variance-dominant regimes, such as persistent volatility forecasting.
Self-supervised learning improves RUL prediction with limited data in fatigue damage prognosis.
problem Limited labelled data for RUL prediction in fatigue damage prognosis.
method Pre-training deep learning models on unlabelled sensor data using self-supervised learning.
result Self-supervised pre-trained models significantly outperform non-pre-trained models in RUL prediction with scarce labelled data.
Continuous time models in the theory of real options give explicit formulas for optimal exercise strategies when options are simple and the price of an underlying asset follows a geometric Brownian motion. This paper suggests a general, computationally simple approach to real options in discrete time. Explicit formulas…
Deep learning improves low-fidelity dynamical models with scarce high-fidelity data.
problem Improving low-fidelity models with limited high-fidelity data.
method Transfer learning using a deep neural network to correct a low-fidelity model.
result An improved DNN model with high accuracy to underlying dynamics.
Improves functional linear regression with shape transfer learning.
problem Data scarcity in functional linear models.
method Shape-based transfer learning from auxiliary to target domains.
result Enhances robustness and generalizability of functional linear models.
Given a class of objects, a pattern theorem is a powerful result describing their structure. We show that alternating knots exhibit a pattern theorem, and use this result to prove a long-standing conjecture that alternating knots grow rare. This is currently the best possible analogue of a pair of theorems on alternati…
Generative Adversarial Networks create synthetic data for structural damage detection.
problem Data scarcity in structural damage detection.
method 1-D Wasserstein Deep Convolutional Generative Adversarial Networks (1-D WDCGAN-GP) for synthetic data generation.
result Generated synthetic data improves damage detection accuracy in 1-D Deep Convolutional Neural Networks.
The committor function is a central object of study in understanding transitions between metastable states in complex systems. However, computing the committor function for realistic systems at low temperatures is a challenging task, due to the curse of dimensionality and the scarcity of transition data. In this paper,…
New method tackles dynamic data labeling issues with limited labels.
problem Dynamic data labeling with scarce labeled instances.
method Instance exploitation technique for aggressive model adaptation.
result Aggressive model adaptation leads to better performance than standard methods.
Self-supervised learning improves ECG classification performance.
problem Label scarcity in clinical 12-lead ECG data.
method Adapted self-supervised methods to ECG domain, focusing on contrastive representations and latent forecasting.
result Contrastive predictive coding adaptation yields linear evaluation performance only 0.5% below supervised performance.
We have studied here the self-organising features of the dynamics of a model market, where the agents `trade' for a single commodity with their money. The model market consists of fixed numbers of economic agents, money supply and commodity. We demonstrate that the model, apart from showing a self-organising behaviour,…
New method uses small perturbations to improve representation learning from few labels.
problem Stability issues and label scarcity in representation learning.
method Introduces small-perturbation ideology on representation probability distribution models.
result Proposed models show better performance in clustering compared to baseline methods.
The goal of this paper is to deal with a data scarcity scenario where deep learning techniques use to fail. We compare the use of two well established techniques, Restricted Boltzmann Machines and Variational Auto-encoders, as generative models in order to increase the training set in a classification framework. Essent…
Transfer learning improves loan recovery rate forecasting under data scarcity.
problem Data scarcity in loan portfolios limits RR modeling accuracy.
method Introduces FT-MDN-Transformer, a mixture-density tabular Transformer architecture for TL.
result FT-MDN-Transformer outperforms baseline models in RR forecasting, especially under covariate and conditional shifts.
This work addresses fairness in ML models by training and evaluating attribute classifiers under uncertain and incomplete data.
problem Challenges in fairness metrics due to uncertain and incomplete data.
method Developed a theoretical and empirical analysis to understand and improve bias estimation in the data-scarce regime.
result The test accuracy of the attribute classifier is not always correlated with its effectiveness in bias estimation.
Proposes efficient calibration for indoor localization models.
problem Calibration data scarcity in wireless indoor localization.
method Uses synthetic labels and prediction sets to fine-tune a predictor and estimate bias.
result Yields rigorous coverage guarantees for prediction sets.
NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper shows that by extending the distant supervision to a more diverse set of noisy la…
Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might be difficult to obtain for the dataset on which the user wants to perform NER: la…