Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4590135180 · Jun 202019922001200920172026
48 results for probabilistic response

Study develops efficient algorithm for probabilistic penetration response of composite plates.

problem Probabilistic modeling of discrete structural response, focusing on binary events like buckling.
method Adaptive domain-based decomposition, sparse grid sampling, assumption of monotonic behavior.
result Efficient computational framework for probabilistic penetration response of composite plates.

The study optimizes sampling in complex systems with probabilistic response distributions.

problem Calibrating and optimizing complex systems with probabilistic response distributions.
method Non-parametric Bayesian approach to modeling spatial fields of probability distributions, introducing adaptive sampling strategies.
result Adaptive sampling strategies improve system evaluations by guiding focus towards key features.

PPPD framework extracts physical characterizations from stochastic mechanical systems.

problem Complex system behavior requires more than probabilistic descriptions of QoI.
method Probabilistic Performance-Pattern Decomposition (PPPD) framework.
result Decomposes system behaviors into meaningful patterns in response space.

Previous work on recommender systems mainly focus on fitting the ratings provided by users. However, the response patterns, i.e., some items are rated while others not, are generally ignored. We argue that failing to observe such response patterns can lead to biased parameter estimation and sub-optimal model performanc…

2012-10-16abs ↗pdf ↗

Treeffuser predicts tabular data distributions using gradient-boosted trees.

problem Probabilistic prediction with flexible, non-parametric models.
method Gradient-boosted trees for score estimation in conditional diffusion model.
result Treeffuser outperforms existing methods in probabilistic prediction tasks.

An important, yet largely unstudied, problem in student data analysis is to detect misconceptions from students' responses to open-response questions. Misconception detection enables instructors to deliver more targeted feedback on the misconceptions exhibited by many students in their class, thus improving the quality…

2017-03-24abs ↗pdf ↗

We consider numerical schemes for root finding of noisy responses through generalizing the Probabilistic Bisection Algorithm (PBA) to the more practical context where the sampling distribution is unknown and location-dependent. As in standard PBA, we rely on a knowledge state for the approximate posterior of the root l…

2017-11-02abs ↗pdf ↗

Novel F2NARX model improves surrogate modeling for stochastic dynamical systems.

problem Challenges in constructing accurate and efficient surrogate models for stochastic dynamical systems.
method Function-on-Function Nonlinear AutoRegressive model with eXogenous inputs (F2NARX) combining PCA and Gaussian process regression.
result F2NARX outperforms state-of-the-art NARX models in efficiency and accuracy.

Here, we present a novel approach to solve the problem of reconstructing perceived stimuli from brain responses by combining probabilistic inference with deep learning. Our approach first inverts the linear transformation from latent features to brain responses with maximum a posteriori estimation and then inverts the …

2017-05-19abs ↗pdf ↗

Unified probabilistic gradient boosting for entire conditional distribution modeling.

problem Creating accurate probabilistic forecasts from regression tasks.
method Unified probabilistic gradient boosting framework using XGBoost and LightGBM, modeling conditional moments or CDF via Normalizing Flows.
result Achieves state-of-the-art forecast accuracy.

Bayesian inference of discrete component states in civil infrastructures using PGMs and GNNs.

problem Inferring discrete states of civil infrastructure components from measurable responses is an ill-posed inverse problem.
method The study proposes a novel Bayesian inversion paradigm based on Probabilistic Graphical Models (PGMs) and Graph Neural Networks (GNNs). PGMs are used to model the problem, with parameters learned from data and structural topology prior. Inference is accomplished by GNNs, and a graph property-based training strategy is developed.
result The proposed framework effectively solves the challenges of inferring the posterior PDF for discrete variables in high-dimensional problems.

Framework predicts responses in misspecified systems using GPLFM and BNNs.

problem Predicting responses in dynamical systems with model misspecification.
method Integrates GPLFM and BNNs for uncertainty-aware inference and prediction.
result Systematic propagation of uncertainty from diagnosis to prediction.

The vast majority of current machine learning algorithms are designed to predict single responses or a vector of responses, yet many types of response are more naturally organized as matrices or higher-order tensor objects where characteristics are shared across modes. We present a new machine learning algorithm BaTFLE…

2016-12-09abs ↗pdf ↗

Nonparametric estimation of the conditional distribution of a response given high-dimensional features is a challenging problem. It is important to allow not only the mean but also the variance and shape of the response density to change flexibly with features, which are massive-dimensional. We propose a multiscale dic…

2013-12-04abs ↗pdf ↗

New analysis shows how cross-entropy training shapes attention in transformers.

problem Understanding how gradient-based learning creates the required internal geometry in transformers.
method Developed a first-order analysis of cross-entropy training effects on attention scores and values in a transformer attention head.
result Introduced an advantage-based routing law and responsibility-weighted update for attention scores and values, respectively.

Taleb (2018) claimed a novel approach to evaluating the quality of probabilistic election forecasts via no-arbitrage pricing techniques and argued that popular forecasts of the 2016 U.S. Presidential election had violated arbitrage boundaries. We show that under mild assumptions all such political forecasts are arbitra…

2019-07-02abs ↗pdf ↗

New method estimates effects of multiple nutrients on blood glucose.

problem Estimating physiological response to multiple nutrient treatments.
method Convolution-based multi-output Gaussian process model.
result Improved prediction accuracy and better interpretation of individual nutrient effects.

New method uses probabilistic independence to discover disease signatures from medical records.

problem Insufficiently precise diagnosis of clinical disease leading to treatment failures.
method Unsupervised machine learning using probabilistic independence to disentangle disease patterns.
result Inferred 2000 clinical disease signatures from medical records, improving cancer prediction.

We propose a new framework of CatBoost that predicts the entire conditional distribution of a univariate response variable. In particular, CatBoostLSS models all moments of a parametric distribution (i.e., mean, location, scale and shape [LSS]) instead of the conditional mean only. Choosing from a wide range of continu…

2020-01-04abs ↗pdf ↗

A probabilistic query may not be estimable from observed data corrupted by missing values if the data are not missing at random (MAR). It is therefore of theoretical interest and practical importance to determine in principle whether a probabilistic query is estimable from missing data or not when the data are not MAR.…

2016-11-15abs ↗pdf ↗

We propose a new framework of XGBoost that predicts the entire conditional distribution of a univariate response variable. In particular, XGBoostLSS models all moments of a parametric distribution (i.e., mean, location, scale and shape [LSS]) instead of the conditional mean only. Choosing from a wide range of continuou…

2019-07-06abs ↗pdf ↗

Proposes β4β^{4}-IRT, a new IRT model with enhanced discrimination estimation.

problem Symmetry problem in β3β^3-IRT causing incorrect discrimination values.
method Gradient descent method, link functions, and new parameters for discrimination.
result Improved parameter recovery in experiments compared to β3β^3-IRT.

Paper explores limits and possibilities of aligning LLMs with human preferences.

problem Aligning LLMs with diverse human preferences to ensure fairness and informed outcomes.
method Analysis of probabilistic representation of human preferences and preservation of diverse preferences.
result LLMs can't fully align with human preferences using reward-based approaches due to Condorcet cycles, but mixed strategies are statistically possible.

Adaptive probabilistic load forecasting improves performance in power systems.

problem Complexity of electricity load forecasting due to changing drivers and local generation.
method Adaptive probabilistic approach using Kalman filter and online gradient descent.
result Adaptive probabilistic forecasts improve performance in both point and probabilistic forecasting.

In this article, we propose a novel probabilistic framework to improve the accuracy of a weighted majority voting algorithm. In order to assign higher weights to the classifiers which can correctly classify hard-to-classify instances, we introduce the Item Response Theory (IRT) framework to evaluate the samples' diffic…

2019-11-11abs ↗pdf ↗

Massive Open Online Courses (MOOCs) bring together thousands of people from different geographies and demographic backgrounds -- but to date, little is known about how they learn or communicate. We introduce a new content-analysed MOOC dataset and use Bayesian Non-negative Matrix Factorization (BNMF) to extract communi…

2014-03-18abs ↗pdf ↗

Paper introduces methods to handle missing data in probabilistic regression trees.

problem Handling missing data in probabilistic regression trees.
method Three approaches: uniform probability, partial observation, and dimension-reduced smoothing.
result Preserves interpretability while extending applicability to incomplete datasets.

DistPred provides a fast, distribution-free method for regression and forecasting.

problem Deterministic point estimates in regression and prediction tasks.
method Transforming proper scoring rules into a differentiable form and using it as a loss function.
result Achieved state-of-the-art performance and significantly improved computational efficiency.

Paper presents a method for imputing and forecasting structural response from incomplete sensor data.

problem Missing sensor data in structural health monitoring (SHM).
method Incremental Bayesian tensor learning for spatiotemporal missing data reconstruction and forecasting.
result The proposed method achieves accurate and robust imputation and prediction even with high rates of missing data.

Probabilistic NDVI forecasting from sparse satellite data.

problem Challenges in short-term NDVI forecasting due to sparse and irregular satellite data.
method Probabilistic forecasting framework using historical NDVI and meteorological observations, with temporal-distance weighted quantile loss and extreme-weather feature engineering.
result The proposed method outperforms baselines on pointwise and probabilistic evaluation metrics.

VED framework learns low-dimensional latent representations of physical systems.

problem Learning latent representations of complex physical systems.
method Variational Encoder-Decoder (VED) framework with KL divergence and covariance regularization.
result VED achieves lower-dimensional latent representations with improved feature disentanglement.

Wasserstein gradient boosting predicts probability distributions for supervised learning.

problem Distribution-valued supervised learning where outputs are probability distributions.
method Fits a new weak learner to Wasserstein gradients of loss functionals of probability distributions.
result Superior performance in probabilistic prediction compared to existing methods.

Enhances PCE surrogates using transfer learning for expensive simulations.

problem Over-sampling in PCE for expensive forward models.
method Transfer learning from similar tasks to a new task with limited training data.
result Improves scalability and accuracy of PCE surrogates.

Paper optimizes demand aggregation for low-level electricity markets.

problem Accurate short-term load forecasting at low aggregation levels for market participants.
method Probabilistic portfolio optimization of residential households' demand using ARMA-GARCH models or KDE forecasts.
result Seasonal Residual approach outperforms others in accuracy and efficiency.

A new model improves analysis of neural activity from calcium imaging.

problem Statistical modeling of deconvolved calcium signals for neural activity interpretation.
method Proposed a zero-inflated gamma (ZIG) model to characterize calcium responses as a mixture of a gamma distribution and a point mass.
result The ZIG model outperforms simpler models in neural encoding and decoding problems.