Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

152303455606 · Jun 202019922001200920172026
48 results for Public Datasets

Algorithm selects public datasets for private machine learning.

problem Choosing the most suitable public dataset for private machine learning.
method Measures gradient subspace distance between public and private datasets.
result Excess risk scales with the subspace distance between gradients.

Publicly pretraining models on Web data may undermine differential privacy.

problem The use of large Web-scraped datasets in differential privacy models.
method Critical review of leveraging pretrained models on public datasets for differential privacy.
result Publicizing pretrained models as 'private' could harm trust and generalize poorly.

Discond-VAE separates continuous and discrete factors in data.

problem Separating shared and class-specific variations in real-world data.
method Introduces private and public latent variables to represent continuous and discrete factors, respectively.
result Discond-VAE successfully disentangles class-dependent continuous factors from discrete factors.

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and none for the traditionally popular domain of scientific publications, which opens …

2017-06-13abs ↗pdf ↗

Paper addresses challenges in benchmarking stream learning algorithms with real-world data.

problem Lack of publicly available non-stationary real-world datasets for evaluating stream algorithms.
method Proposes a new public data repository for benchmarking stream algorithms with real-world data.
result Mitigates problems related to dataset choice in experimental evaluation of stream classifiers and drift detectors.

With the rapid growth in the number of scientific publications, year after year, it is becoming increasingly difficult to identify quality authoritative work on a single topic. Though there is an availability of scientometric measures which promise to offer a solution to this problem, these measures are mostly quantita…

2019-10-07abs ↗pdf ↗

Autonomous driving is getting a lot of attention in the last decade and will be the hot topic at least until the first successful certification of a car with Level 5 autonomy. There are many public datasets in the academic community. However, they are far away from what a robust industrial production system needs. Ther…

2019-01-26abs ↗pdf ↗

Study analyzes global public sentiment on DeFi from 2012-2022.

problem Global public sentiment on DeFi is understudied.
method Sentiment analysis, spatial econometrics, clustering, topic modeling.
result Economic development significantly influences DeFi engagement, especially after 2015.

Cost-benefit analysis often assumes accurate estimates, but this study finds significant inaccuracies.

problem Inaccurate cost and benefit estimates in public investments.
method Largest dataset of public investments, statistical analysis of cost overruns and benefit shortfalls.
result Significant inaccuracies in cost and benefit estimates of public investments.

New privacy-preserving learning model for mixtures of private and public data.

problem Learning from datasets with both private and public data, where privacy concerns differ.
method Designing a differential privacy-preserving learning algorithm for a mixture of private and public sub-populations.
result Linear classifiers can be learned with sample complexity comparable to non-private PAC-learning, even when privacy status correlates with labels.

Study uses neural networks to predict travel times for public transportation.

problem Inaccurate travel time predictions due to road traffic irregularities.
method Developed two neural network models (MLP and LSTM) using OD travel time matrix.
result Both models can make near-accurate predictions, but LSTM is more susceptible to noise.

We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of sampled neighbors for each input node, while the second (publicized in May 2021…

2019-09-26abs ↗pdf ↗

The preponderance of connected devices provides unprecedented opportunities for fine-grained monitoring of the public infrastructure. However while classical models expect high quality application-specific data streams, the promise of the Internet of Things (IoT) is that of an abundance of disparate and noisy datasets …

2019-03-04abs ↗pdf ↗

Widely-used public benchmarks are of huge importance to computer vision and machine learning research, especially with the computational resources required to reproduce state of the art results quickly becoming untenable. In medical image computing, the wide variety of image modalities and problem formulations yields a…

2019-08-12abs ↗pdf ↗

In recent years, an active field of research has developed around automated machine learning (AutoML). Unfortunately, comparing different AutoML systems is hard and often done incorrectly. We introduce an open, ongoing, and extensible benchmark framework which follows best practices and avoids common mistakes. The fram…

2019-07-01abs ↗pdf ↗

MMformer improves forecasting of environmental time series data.

problem Accurately forecasting environmental change trends for policy-making.
method Meta-learning MTS model combining self-attention and adaptive transferable multi-head attention.
result MMformer outperforms other models in air quality and climate datasets, reducing prediction errors by 50% in MSE and 20% in MAE.

We consider learning problems where the training set consists of two types of examples: private and public. The goal is to design a learning algorithm that satisfies differential privacy only with respect to the private examples. This setting interpolates between private learning (where all examples are private) and cl…

2019-10-25abs ↗pdf ↗

Study public-data assisted private stochastic optimization with labeled or unlabeled public data.

problem Limits and capability of public-data assisted differentially private (PA-DP) algorithms in stochastic convex optimization.
method Lower bounds for PA-DP mean estimation and novel methods for leveraging public data in private supervised learning.
result Achieved dimension independent rate for GLM with unlabeled public data, showing optimality.

The paper tackles robust classification trees for distribution shifts, improving accuracy in public health and social work.

problem Learning robust classification trees for high-stakes settings with distribution shifts.
method Mixed-integer robust optimization technology to reformulate as a two-stage linear robust optimization problem.
result Increase of up to 12.48% in worst-case accuracy and 4.85% in average-case accuracy.

With the recent trend of applying machine learning in every aspect of human life, it is important to incorporate fairness into the core of the predictive algorithms. We address the problem of predicting the quality of public speeches while being fair with respect to sensitive attributes of the speakers, e.g. gender and…

2019-11-25abs ↗pdf ↗