Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Dec 199219922001200920182026
48 results for data availability

Evaluates transfer learning methods in dynamic data availability scenarios.

problem Real-world data availability varies over time, leading to unrealistic TL method evaluations.
method Proposes a data manipulation framework to simulate varying data availability and domain transformations.
result Demonstrates the usefulness of the framework on proprietary and publicly available datasets.

Batch Reinforcement Learning (RL) algorithms attempt to choose a policy from a designer-provided class of policies given a fixed set of training data. Choosing the policy which maximizes an estimate of return often leads to over-fitting when only limited data is available, due to the size of the policy class in relatio…

2014-05-12abs ↗pdf ↗

Health care is one of the most exciting frontiers in data mining and machine learning. Successful adoption of electronic health records (EHRs) created an explosion in digital clinical data available for analysis, but progress in machine learning for healthcare research has been difficult to measure because of the absen…

2017-03-22abs ↗pdf ↗

This study predicts parking availability using multi-source data and a self-supervised learning enhanced transformer.

problem Accurate parking availability prediction to support urban planning and management.
method Proposes SST-iTransformer, a self-supervised learning enhanced spatio-temporal inverted transformer, integrating multi-source data.
result SST-iTransformer achieves state-of-the-art performance in parking availability prediction.

DKT transfers biomarker information between neurodegenerative diseases.

problem Estimating biomarker trajectories in rare neurodegenerative diseases with limited data.
method DKT is a joint-disease generative model that transfers biomarker progressions from common neurodegenerative diseases to rare ones.
result DKT estimates plausible multimodal biomarker trajectories in rare diseases like PCA using only unimodal data.

New attacks prevent both supervised and contrastive learning from private data.

problem Preventing unauthorized use of private data and commercial datasets.
method Contrastive-like data augmentations in supervised error minimization or maximization frameworks.
result Achieve state-of-the-art worst-case unlearnability across SL and CL algorithms.

Foundation models improve time series prediction reliability, especially with limited data.

problem Improving time series prediction reliability with limited data.
method Comparison of Time Series Foundation Models (TSFMs) with traditional methods in conformal prediction.
result TSFMs provide more reliable conformalized prediction intervals and more stable calibration with limited data.

Sourcerer uses deep learning to map land cover from limited labeled data.

problem Producing accurate land cover maps with scarce labeled data.
method Bayesian-inspired, deep learning approach with a novel regularizer.
result Sourcerer outperforms other methods, even with minimal labeled target data.

A new parallel clustering method improves speed and accuracy for single cell transcriptomic data.

problem Challenges in clustering single cell transcriptomic data, including poor quality, lack of prior knowledge, and slow computation.
method Parallel Split Merge Sampling on Dirichlet Process Mixture Model (Para-DPMM).
result The Para-DPMM model outperforms existing methods in clustering quality and computational speed.

Combining data from multiple speakers improves neural TTS quality, especially with imbalanced data.

problem Training high-quality TTS systems with imbalanced speaker data.
method Combine data from multiple speakers, train multi-speaker models, and use ensemble methods.
result Ensemble multi-speaker models improve synthetic speech quality for underrepresented speakers.

Method estimates causal effects from incremental data, overcoming missing data challenges.

problem Estimating causal effects from non-stationary, incrementally available observational data.
method Continual Causal Effect Representation Learning
result Method achieves continual causal effect estimation without compromising original data.

Study compares new audio representation methods for limited data music retrieval.

problem Improving machine learning for audio data with limited training data.
method Investigated mel-spectrogram and Mel scattering representations, and augmented target loss function.
result All proposed methods outperform standard mel-spectrogram when using limited data.

VICatMix clusters categorical biomedical data efficiently and selects relevant variables.

problem Efficient clustering of high-dimensional categorical biomedical data.
method Variational Bayesian finite mixture model with variational inference.
result Improves clustering accuracy and variable selection on noisy, high-dimensional data.

A new method uses vector embeddings to improve analytics model performance.

problem Challenges in selecting high-quality datasets for enhanced analytics performance.
method Transform datasets into vector embeddings using NumTabData2Vec, then use similarity search for model inference.
result The proposed method accurately predicts analytics outcomes and increases speedup.

Torchmeta simplifies meta-learning evaluation across multiple datasets.

problem Inconsistent evaluation of meta-learning algorithms across different datasets.
method Introduces a library that provides data-loaders for standard benchmarks and simplifies model compatibility.
result Seamless and consistent evaluation of meta-learning algorithms on multiple datasets.

MapLUR uses deep learning on map images to estimate NO2 pollution, outperforming traditional methods.

problem Limited availability of data for traditional LUR models makes them hard to adapt to new areas.
method Data-driven, open-source approach using convolutional neural networks trained on map data.
result MapLUR significantly outperforms traditional LUR models, including those with manually engineered features.

Federated learning algorithm improves with intermittent client availability.

problem Performance degradation in Federated Averaging due to client availability changes.
method Federated Latest Averaging (FedLaAvg) uses latest gradients from all clients, even when unavailable.
result FedLaAvg achieves sublinear speedup compared to classical Federated Averaging.

New algorithms discover and utilize 'voids' in data to improve machine learning models.

problem Improving machine learning models by considering the unknown aspects of data.
method Developed algorithms to discover and utilize 'voids' in data, creating ignorance-aware prototypes.
result Improved performance of nearest neighbor classifiers through ignorance-aware prototype selection.

Theoretical limits show experimental data can falsify but not validate causal estimates from observational studies.

problem Fundamental limits on validating causal estimates using experimental data in observational studies.
method Impossible inference framework, Gaussian Process based approach.
result Experimental data can falsify but not validate causal estimates from observational studies.

Study shows publicly available news impacts financial markets.

problem Impact of publicly available news on financial markets.
method Extracted news from Common Crawl, identified relevant companies, used sentiment analysis and information theory.
result Publicly available news has significant impact on financial markets.

We have developed a strategy for the analysis of newly available binary data to improve outcome predictions based on existing data (binary or non-binary). Our strategy involves two modeling approaches for the newly available data, one combining binary covariate selection via LASSO with logistic regression and one based…

2008-05-21abs ↗pdf ↗

The task of clustering a set of objects based on multiple sources of data arises in several modern applications. We propose an integrative statistical model that permits a separate clustering of the objects for each data source. These separate clusterings adhere loosely to an overall consensus clustering, and hence the…

2013-02-28abs ↗pdf ↗

Unified method for multi-defect microscopy image restoration with limited training data.

problem Challenges in applying deep learning methods due to limited training data for multi-defect microscopy images.
method Two-stage approach: data augmentation with GAN and conditional GAN training.
result Proposed method gives comparable or superior results to existing methods in image quality restoration.

In this paper we propose a framework for automated forecasting of energy-related time series using open access data from European Network of Transmission System Operators for Electricity (ENTSO-E). The framework provides forecasts for various European countries using publicly available historical data only. Our solutio…

2016-06-02abs ↗pdf ↗

Improved GAN performance with incomplete data using factorised discriminators.

problem Limited availability of labelled data for GAN training.
method Factorising data distribution into sub-distributions and training sub-discriminators.
result Improved performance in image generation, segmentation, and audio separation tasks.

Paper improves geographic location embeddings using Flickr tags and structured data.

problem Lack of integration between Flickr metadata and structured scientific data.
method Learning vector space embeddings of geographic locations.
result Improved predictions of ecological features using the new method.