Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

1122 · May 202019922001200920172026
35 results for postprocessing

Study compares machine learning methods for improving wind gust forecasts.

problem Improving accuracy of wind gust forecasts from ensemble models.
method Comprehensive comparison of 8 statistical and machine learning methods.
result Locally adaptive neural networks significantly outperform other methods.

Neural networks learn from ensemble forecasts without considering their order.

problem Improving reliability of probabilistic weather forecasts.
method Permutation-invariant neural networks for postprocessing ensemble forecasts.
result Models achieve state-of-the-art prediction quality in surface temperature and wind gust forecasts.

A new method predicts precipitation distributions from ensemble forecasts.

problem Improving accuracy and calibration of precipitation forecasts.
method Distributional regression U-Nets for postprocessing ensemble precipitation forecasts.
result Competitive performance in continuous ranked probability score, especially for heavy precipitation.

New method improves probabilistic electricity price predictions.

problem Improving point forecasts to probabilistic distributions for better decision-making.
method Isotonic Distributional Regression combined with other postprocessing methods.
result Isotonic Distributional Regression outperforms other methods in combining probabilistic distributions.

Most approaches aiming to ensure a model's fairness with respect to a protected attribute (such as gender or race) assume to know the true value of the attribute for every data point. In this paper, we ask to what extent fairness interventions can be effective even when only imperfect information about the protected at…

2019-06-07abs ↗pdf ↗

Study improves distributional regression evaluation with CRPS, finding optimal rates of convergence.

problem Improving probabilistic forecasts in meteorology using distributional regression.
method Extends theoretical properties of CRPS evaluation to include covariates and finite sample sizes, analyzing convergence rates for different methods.
result Optimal minimax rate of convergence for distributional regression methods is achieved by k-nearest neighbor and kernel methods.

A new measure PC allows fair comparison of AIWP and NWP models.

problem Fair comparison of AIWP and NWP model outputs.
method Postprocessing deterministic model outputs with isotonic distributional regression (IDR) and calculating PC as mean CRPS of postprocessed forecasts.
result The GraphCast model outperforms the ECMWF HRES model in WeatherBench 2 data.

The issue of disagreements amongst human experts is a ubiquitous one in both machine learning and medicine. In medicine, this often corresponds to doctor disagreements on a patient diagnosis. In this work, we show that machine learning models can be trained to give uncertainty scores to data instances that might result…

2018-07-04abs ↗pdf ↗

Improved robust regression for heavy-tailed and contaminated data.

problem Linear regression with heavy-tailed and adversarially contaminated covariates and responses.
method Applying a filtering algorithm to covariates and then using Huber regression, least trimmed squares, or least absolute deviation estimators on the remaining data.
result Near-optimal error rates achieved for the Huber regression estimator.

Feature extraction for automatic classification of EEG signals typically relies on time frequency representations of the signal. Techniques such as cepstral-based filter banks or wavelets are popular analysis techniques in many signal processing applications including EEG classification. In this paper, we present a com…

2018-01-03abs ↗pdf ↗

Integrates differential privacy and demographic parity in multi-class classification.

problem Ensuring fairness and privacy in sensitive applications.
method Designs DP2DP algorithm that enforces both demographic parity and differential privacy.
result DP2DP converges towards demographic parity at nearly the same rate as non-private methods, achieving state-of-the-art trade-offs.

Task shift from classification to regression is possible in overparameterized linear models with limited additional data.

problem Transferability of latent knowledge from classification to regression in overparameterized linear models.
method Investigation of task shift in overparameterized linear regression, zero-shot and few-shot cases, with a focus on minimum-norm interpolation.
result Minimum-norm interpolators can transfer latent knowledge from classification to regression with limited additional data.

DeepTopPush improves accuracy at the top for complex classification tasks.

problem Minimizing irrelevant samples above a threshold in binary classification.
method Proposes a new method for end-to-end training of deep networks to minimize loss at the top.
result Demonstrates excellent performance on visual recognition and real-world applications.

iQRA improves probabilistic forecasts of electricity prices.

problem Lack of uncertainty estimates in machine learning forecasts for volatile markets.
method Isotonic Quantile Regression Averaging (iQRA) with stochastic order constraints.
result iQRA outperforms state-of-the-art methods in reliability and sharpness.

Neural-network emulators predict sea-level changes due to Antarctic ice melt.

problem High computational cost and time in projecting sea-level changes.
method Built neural-network emulators of sea-level change using GRD effects from future Antarctic Ice Sheet mass change.
result Neural-network emulators are as accurate as baseline machine learning emulators and offer substantial computational efficiency.

New algorithms improve blind source separation for linear-quadratic mixtures.

problem Blind source separation of linear-quadratic mixtures under separability assumptions.
method Proposed two algorithms: SNPALQ and BF. SNPALQ generalizes SNPA for LQ model, BF post-processes SNPALQ.
result Proven robustness and computational tractability of SNPALQ in separating sources even with noise.

FAE framework tackles fairness in machine learning by balancing data and adjusting decision boundaries.

problem Discrimination in automated decision-making based on machine learning algorithms.
method Combines pre- and post-processing fairness interventions to address group imbalance, class imbalance, and class overlap.
result Improves fairness in machine learning models by balancing data and adjusting decision boundaries.

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard DP and inherits all its desirable properties, e.g., composition, invariance to …

2017-07-24abs ↗pdf ↗

Manually authoring transition animations for a complete locomotion system can be a tedious and time-consuming task, especially for large games that allow complex and constrained locomotion movements, where the number of transitions grows exponentially with the number of states. In this paper, we present a novel approac…

2018-10-04abs ↗pdf ↗