Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

147294440587 · Jun 202019922001200920172026
48 results for Probabilistic Predictions

This research focuses on invariant probabilistic predictions, showing they are not robust under distribution shifts.

problem The challenge of creating robust probabilistic predictions that remain consistent under distribution shifts.
method A causality-inspired framework to investigate invariance and robustness of probabilistic predictions with respect to proper scoring rules.
result Arbitrary distribution shifts do not admit invariant and robust probabilistic predictions, unlike point predictions.

PGBM creates probabilistic predictions efficiently.

problem Creating probabilistic predictions for large-scale data.
method Approximates leaf weights as random variables, learns moments via stochastic tree ensemble update equations.
result PGBM offers significant speedup and accuracy improvements over existing methods.

Proposes a method to apply conformal prediction to probabilistic time series forecasting models.

problem Obtaining accurate prediction regions for multi-step time series forecasting with probabilistic models.
method Conformalises conditional normalising flows to generate potentially disjoint prediction regions.
result Improves predictive efficiency in time series forecasting with multimodal distributions.

Treeffuser predicts tabular data distributions using gradient-boosted trees.

problem Probabilistic prediction with flexible, non-parametric models.
method Gradient-boosted trees for score estimation in conditional diffusion model.
result Treeffuser outperforms existing methods in probabilistic prediction tasks.

Paper quantifies uncertainty in probabilistic models using Gaussian Processes.

problem Assessing reliability of probabilistic machine learning predictions.
method Systematic framework for estimating epistemic and aleatoric uncertainty, using Gaussian Processes and Monte Carlo sampling.
result Effective approach for quantifying prediction confidence in probabilistic models.

Predictive modelling and supervised learning are central to modern data science. With predictions from an ever-expanding number of supervised black-box strategies - e.g., kernel methods, random forests, deep learning aka neural networks - being employed as a basis for decision making processes, it is crucial to underst…

2018-01-02abs ↗pdf ↗

Proposes using diffusion models for probabilistic stock market predictions.

problem Uncertainties in financial data make deterministic models ineffective for stock market predictions.
method Utilizes Denoising Diffusion Probabilistic Models (DDPM) and Masked Relational Transformer (MRT).
result Achieves state-of-the-art performance in stock movement prediction and portfolio management.

Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction

problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics

Study introduces TeMoP model for better stock market predictions.

problem Decreasing prediction errors and robustness across datasets in machine learning models.
method Probabilistic multiple lag order model based on trend encoding.
result TeMoP model outperforms machine learning models in accuracy and stability across different stock indexes.

Develops a neural framework for probabilistic forecasting of dynamical systems.

problem Uncertainty quantification in dynamical systems using trajectory-oriented approaches.
method D2D neural probabilistic forecasting framework using kernel mean embeddings and mixture density networks.
result The D2D model captures distributional evolution in chaotic systems and produces skillful probabilistic forecasts.

Paper improves Tm prediction of protein fragments using sparsity and probabilistic models.

problem Improving accuracy of melting temperature prediction for protein fragments.
method Promoting sparsity in pre-trained transformer models and adopting probabilistic frameworks.
result Mean absolute error of 0.23C for predicting melting temperature.

Improved probabilistic solar irradiance forecasting models for grid integration.

problem Enhancing accuracy of solar irradiance forecasts for grid integration.
method Developed and calibrated probabilistic models using post-hoc calibration techniques.
result NGBoost model with CRUDE calibration achieves comparable performance to numerical weather prediction models.

Two new methods generate probabilistic forecasts of individual treatment effects.

problem Generating probabilistic forecasts of individual treatment effects for risk-aware decision-making.
method Proposes CCT and CMC meta-learners combining conformal predictive systems with analytic convolution or Monte Carlo sampling.
result Achieve probabilistically calibrated predictive distributions and performant continuous ranked probability scores.

We present Natural Gradient Boosting (NGBoost), an algorithm for generic probabilistic prediction via gradient boosting. Typical regression models return a point estimate, conditional on covariates, but probabilistic regression models output a full probability distribution over the outcome space, conditional on the cov…

2019-10-08abs ↗pdf ↗

Fast probabilistic option price predictions using modular Bayesian inference.

problem Accurate probabilistic predictions of future option prices.
method Modular approximate Bayesian inference framework that combines multiple data sources.
result Accurate probabilistic option-price predictions in realistic scenarios.

ProbRes calibrates probabilistic forecasts by learning volatility dynamics.

problem Quantifying risk and uncertainty in time series forecasting.
method ProbRes learns conditional mean and volatility separately, generating well-calibrated prediction intervals.
result ProbRes accurately captures predictive distributions and produces well-calibrated prediction intervals.

New method improves probabilistic electricity price predictions.

problem Improving point forecasts to probabilistic distributions for better decision-making.
method Isotonic Distributional Regression combined with other postprocessing methods.
result Isotonic Distributional Regression outperforms other methods in combining probabilistic distributions.

End-to-end deep model for coherent probabilistic forecasts in hierarchical time series.

problem Hierarchical probabilistic forecasting for coherent predictions.
method Dirichlet proportions model for learning root and child distributions.
result Significant improvements over state-of-the-art baselines (up to 26%).

Bayesian approach models neurodegenerative diseases without clinical labels.

problem Personalized, predictive modeling of neurodegenerative diseases.
method Probabilistic programmed deep kernel learning combining Gaussian processes and neural networks.
result Surpasses deep learning in accuracy and timeliness of predicting neurodegeneration.

Paper proposes a probabilistic method to handle missing data in decision trees.

problem Handling missing data in decision trees.
method At deployment time, use density estimators to compute expected predictions. At learning time, fine-tune tree parameters to minimize expected prediction loss.
result Effective compared to baselines in experiments.

COLEP improves robustness of conformal prediction via probabilistic circuits.

problem Adversarial perturbations can undermine the coverage guarantees of conformal prediction.
method COLEP uses probabilistic circuits to learn and reason about different semantic concepts, providing certifiable coverage guarantees.
result COLEP achieves higher prediction coverage and accuracy than a single model, especially with non-trivial knowledge models.

Incorporating constraints is a major concern in probabilistic machine learning. A wide variety of problems require predictions to be integrated with reasoning about constraints, from modelling routes on maps to approving loan predictions. In the former, we may require the prediction model to respect the presence of phy…

2020-01-29abs ↗pdf ↗

Active learning methods, like uncertainty sampling, combined with probabilistic prediction techniques have achieved success in various problems like image classification and text classification. For more complex multivariate prediction tasks, the relationships between labels play an important role in designing structur…

2019-12-29abs ↗pdf ↗

Unified probabilistic gradient boosting for entire conditional distribution modeling.

problem Creating accurate probabilistic forecasts from regression tasks.
method Unified probabilistic gradient boosting framework using XGBoost and LightGBM, modeling conditional moments or CDF via Normalizing Flows.
result Achieves state-of-the-art forecast accuracy.

DCK improves air quality index prediction with probabilistic spatial models.

problem Non-Gaussian, complex spatial structure of air quality index.
method Deep classifier kriging (DCK) for non-Gaussian, nonlinear spatial prediction.
result DCK outperforms conventional methods in predictive accuracy and uncertainty quantification.

Efficiently combines probabilistic predictions using kernel embeddings.

problem Combining multiple probabilistic predictions to improve forecast accuracy.
method Embed predictions into RKHS, optimizes kernel-based scoring rules, finds efficient implementation.
result Generalised linear pool outperforms traditional linear pool in operational wind speed forecasts.

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their ability to represent uncertainty about predictions. In safety-critical applicatio…

2019-02-19abs ↗pdf ↗

Proposes a framework for automated radiation therapy treatment planning with uncertainty quantification.

problem Quantifying uncertainties in dose-related quantities for automated treatment planning.
method Three-step pipeline: feature extraction, dose statistic prediction, and dose mimicking.
result Probabilistic treatment plans agree better with clinical counterparts than non-probabilistic ones.

A method for multidimensional probabilistic electricity market forecasting is proposed.

problem Uncertainty in simultaneous multivariate predictions of electricity markets.
method Repeated resampling to estimate uncertainty of simultaneous multivariate predictions.
result The method provides highly accurate predictions and gains are largest when considering functions of variables.

JoLT uses LLMs to make probabilistic predictions on tabular data.

problem Making probabilistic predictions on tabular data efficiently and without preprocessing.
method JoLT leverages LLMs' in-context learning to define joint distributions over tabular data.
result JoLT outperforms other methods on tabular classification and regression tasks.

ProFnet models HDFTS with neural networks, offering scalable probabilistic forecasts.

problem Modeling high-dimensional functional time series with nonlinear trends and high spatial dimensions.
method Integrates feedforward and deep neural networks with probabilistic modeling.
result Superior performance in forecasting Japan's mortality rates.

Even though probabilistic treatments of neural networks have a long history, they have not found widespread use in practice. Sampling approaches are often too slow already for simple networks. The size of the inputs and the depth of typical CNN architectures in computer vision only compound this problem. Uncertainty in…

2018-05-29abs ↗pdf ↗

New method improves forecast accuracy using CRPS for probabilistic predictions.

problem Improving forecast accuracy for probabilistic predictions, especially in the tails of distributions.
method Introduces a new weighting method for pointwise CRPS learning, optimizing across quantiles.
result Proposed fully adaptive Bernstein online aggregation (BOA) method for pointwise CRPS online learning has optimal convergence properties.

Method predicts hardware resource usage by control software with guaranteed linear convergence.

problem Predicting time-varying hardware resource availability in control software.
method Path structured multimarginal Schrödinger bridge (MSBP) for learning stochastic resource usage.
result Guaranteed linear convergence to accurate prediction of hardware resource utilization.

Introduces Rashomon Capacity to measure predictive multiplicity in probabilistic classifiers.

problem Predictive multiplicity in classification models leading to unjustified decisions.
method Introduces Rashomon Capacity, a metric for probabilistic classifiers, and provides a rigorous derivation.
result Rashomon Capacity captures nuanced score variations and provides strategies for disclosing conflicting models.

We develop a technique for generalising from data in which models are samplers represented as program text. We establish encouraging empirical results that suggest that Markov chain Monte Carlo probabilistic programming inference techniques coupled with higher-order probabilistic programming languages are now sufficien…

2014-07-09abs ↗pdf ↗