Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

6.2%12.4%18.6%24.8% · Nov 201919922001200920172026
48 results for public datasets

Algorithm selects public datasets for private machine learning.

problem Choosing the most suitable public dataset for private machine learning.
method Measures gradient subspace distance between public and private datasets.
result Excess risk scales with the subspace distance between gradients.

Public benchmark for machine learning models in critical care.

problem Lack of public benchmarks for machine learning in critical care.
method Defined four tasks (mortality prediction, length of stay, phenotyping, decompensation risk) and compared clinical and deep learning models on eICU dataset.
result First public benchmark on multi-centre critical care dataset, comparing clinical models with predictive models.

Publicly pretraining models on Web data may undermine differential privacy.

problem The use of large Web-scraped datasets in differential privacy models.
method Critical review of leveraging pretrained models on public datasets for differential privacy.
result Publicizing pretrained models as 'private' could harm trust and generalize poorly.

Discond-VAE separates continuous and discrete factors in data.

problem Separating shared and class-specific variations in real-world data.
method Introduces private and public latent variables to represent continuous and discrete factors, respectively.
result Discond-VAE successfully disentangles class-dependent continuous factors from discrete factors.

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and none for the traditionally popular domain of scientific publications, which opens …

2017-06-13abs ↗pdf ↗

Paper addresses challenges in benchmarking stream learning algorithms with real-world data.

problem Lack of publicly available non-stationary real-world datasets for evaluating stream algorithms.
method Proposes a new public data repository for benchmarking stream algorithms with real-world data.
result Mitigates problems related to dataset choice in experimental evaluation of stream classifiers and drift detectors.

Autonomous driving is getting a lot of attention in the last decade and will be the hot topic at least until the first successful certification of a car with Level 5 autonomy. There are many public datasets in the academic community. However, they are far away from what a robust industrial production system needs. Ther…

2019-01-26abs ↗pdf ↗

Study analyzes global public sentiment on DeFi from 2012-2022.

problem Global public sentiment on DeFi is understudied.
method Sentiment analysis, spatial econometrics, clustering, topic modeling.
result Economic development significantly influences DeFi engagement, especially after 2015.

Cost-benefit analysis often assumes accurate estimates, but this study finds significant inaccuracies.

problem Inaccurate cost and benefit estimates in public investments.
method Largest dataset of public investments, statistical analysis of cost overruns and benefit shortfalls.
result Significant inaccuracies in cost and benefit estimates of public investments.

New privacy-preserving learning model for mixtures of private and public data.

problem Learning from datasets with both private and public data, where privacy concerns differ.
method Designing a differential privacy-preserving learning algorithm for a mixture of private and public sub-populations.
result Linear classifiers can be learned with sample complexity comparable to non-private PAC-learning, even when privacy status correlates with labels.

Study uses neural networks to predict travel times for public transportation.

problem Inaccurate travel time predictions due to road traffic irregularities.
method Developed two neural network models (MLP and LSTM) using OD travel time matrix.
result Both models can make near-accurate predictions, but LSTM is more susceptible to noise.

MetaSelector learns to choose the best model for each user.

problem Heterogeneous datasets and user-specific historical data make it hard to find the best model for each user.
method Meta-learning framework to train a model selector that chooses the best model for each user based on their historical data.
result MetaSelector outperforms single model and sample-level model selector in AUC and LogLoss.

The preponderance of connected devices provides unprecedented opportunities for fine-grained monitoring of the public infrastructure. However while classical models expect high quality application-specific data streams, the promise of the Internet of Things (IoT) is that of an abundance of disparate and noisy datasets …

2019-03-04abs ↗pdf ↗

Widely-used public benchmarks are of huge importance to computer vision and machine learning research, especially with the computational resources required to reproduce state of the art results quickly becoming untenable. In medical image computing, the wide variety of image modalities and problem formulations yields a…

2019-08-12abs ↗pdf ↗

Paper improves GLM estimation in NLDP model with public unlabeled data.

problem Estimating smooth GLMs in NLDP model with public unlabeled data.
method Presented (ϵ,δ)(\epsilon, \delta)-NLDP algorithms for GLMs using Stein's lemma and public/unlabeled data.
result Significant improvement in sample complexity for GLM estimation.

The paper explores learning with a mix of private and public data while maintaining privacy.

problem Learning with a mix of private and public data while ensuring differential privacy.
method Designing a learning algorithm that satisfies differential privacy only with respect to private examples.
result A hypothesis class of VC-dimension d can be agnostically learned up to an excess error of α using only (roughly) d/α public examples and d/α^2 private labeled examples.

In recent years, an active field of research has developed around automated machine learning (AutoML). Unfortunately, comparing different AutoML systems is hard and often done incorrectly. We introduce an open, ongoing, and extensible benchmark framework which follows best practices and avoids common mistakes. The fram…

2019-07-01abs ↗pdf ↗

MMformer improves forecasting of environmental time series data.

problem Accurately forecasting environmental change trends for policy-making.
method Meta-learning MTS model combining self-attention and adaptive transferable multi-head attention.
result MMformer outperforms other models in air quality and climate datasets, reducing prediction errors by 50% in MSE and 20% in MAE.

Study predicts high school dropout risk in Louisiana using imbalanced learning techniques.

problem Predicting high school dropout risk in Louisiana.
method Applied imbalanced learning techniques including resampling, case weighting, and cost-sensitive learning.
result Imbalanced learning techniques improve recall but decrease precision.