Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

8.5%17.0%25.5%33.9% · Feb 202619922001200920172026
48 results for Joint Probability Estimation

Novel approach for estimating joint probability densities using tensor decompositions and dictionaries.

problem Estimating joint probability densities of mixed discrete and continuous variables.
method Low-rank tensor decomposition combined with dictionary learning.
result Better classification and lower error rates compared to existing methods.

Estimates joint probability distribution from 1-way marginals using low-rank tensors and random projections.

problem Nonparametric estimation of joint probability mass function (PMF) from limited data.
method Low-rank tensor decomposition and random projections to link data to PMF estimation.
result Estimates joint density from 1-way marginals using transformed space and novel algorithm.

Method estimates joint probability density from samples using low-rank decomposition and random projections.

problem Estimating joint probability density from limited samples.
method Low-rank tensor decomposition, dictionaries, and Radon transforms.
result Algorithm outperforms previous methods in estimating synthetic probability densities.

This work proposes a new method to estimate joint probability from pairwise marginals, reducing sample complexity.

problem Direct nonparametric estimation of high-dimensional joint probability is infeasible due to the curse of dimensionality.
method Developed a coupled nonnegative matrix factorization (CNMF) framework using only pairwise marginals.
result The method provably recovers the joint probability mass function up to bounded error in finite iterations under reasonable conditions.

We analyse time series of CDS spreads for a set of major US and European institutions on a pe- riod overlapping the recent financial crisis. We extend the existing methodology of ε-drawdowns to the one of joint ε-drawups, in order to estimate the conditional probabilities of abrupt co-movements among spreads. We correc…

2012-05-04abs ↗pdf ↗

This paper presents a Bayesian method for estimating the rank of a low-rank tensor model of joint PMF.

problem Estimating the rank of a low-rank tensor model of joint PMF from observed data.
method Bayesian framework for estimating low-rank components and rank simultaneously, using variational inference.
result Automatic rank detection and improved estimation accuracy compared to cross-validation methods.

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful generative models. Our method masks the autoencoder's parameters to respect autoregressive constraints: ea…

2015-02-12abs ↗pdf ↗

Proposes methods to estimate posterior probability and propensity score functions without assuming constant propensity score.

problem Learning from biased positive-unlabeled data.
method Parametric approach to joint estimation of posterior probability and propensity score functions using maximum likelihood and alternating maximization.
result Proposed methods are comparable or better than existing methods based on Expectation-Maximisation scheme.

This work extends stochastic localization to joint probability measures for data analysis.

problem Data distributional analysis in high-dimensional probability.
method Unified stochastic localization under Eldan's α-scheme, coupled probability measures via shared Brownian motion.
result Eldan's α-distance as a scalable surrogate for Wasserstein distance.

Missing data and noisy observations pose significant challenges for reliably predicting events from irregularly sampled multivariate time series (longitudinal) data. Imputation methods, which are typically used for completing the data prior to event prediction, lack a principled mechanism to account for the uncertainty…

2017-08-16abs ↗pdf ↗

The paper proposes a method to estimate joint probability from unpaired data using entropic transport kernels.

problem Estimating joint probability from unpaired data with unknown internal ordering.
method Maximum-likelihood inference, entropic optimal transport kernels, EMML algorithm.
result The method can recover true density from empirical approximations as the number of blocks increases.

Paper estimates AI hallucinations in conditional generation tasks.

problem Estimating the frequency of AI-generated incorrect responses.
method Developed a method to estimate hallucination probability from generated responses and log probabilities.
result Method accurately estimates hallucination rate in natural language and synthetic tasks.

The paper bounds and identifies joint probabilities in causal inference with monotonicity assumptions.

problem Bounding and identifying joint probabilities of potential outcomes and observed variables under monotonicity assumptions.
method Proposes new families of monotonicity assumptions, formulates bounding problem as linear programming, introduces new monotonicity assumption for identification.
result Validated methods through numerical experiments and applied to real-world datasets.

Hidden regular variation is a sub-model of multivariate regular variation and facilitates accurate estimation of joint tail probabilities. We generalize the model of hidden regular variation to what we call hidden domain of attraction. We exhibit examples that illustrate the need for a more general model and discuss de…

2011-10-04abs ↗pdf ↗

OPAA estimates probability densities using functional analysis.

problem Estimating probability density functions efficiently and accurately.
method OPAA uses a parallelizable algorithm based on functional analysis to estimate probability distributions.
result OPAA provides an efficient method to estimate probability density functions and normalizing weights.

A probabilistic query may not be estimable from observed data corrupted by missing values if the data are not missing at random (MAR). It is therefore of theoretical interest and practical importance to determine in principle whether a probabilistic query is estimable from missing data or not when the data are not MAR.…

2016-11-15abs ↗pdf ↗

First passage models, where corporate assets undergo correlated random walks and a company defaults if its assets fall below a threshold provide an attractive framework for modeling the default process. Typical one year default correlations are small, i.e., of order a few percent, but nonetheless including correlations…

2008-12-10abs ↗pdf ↗

I consider two problems in machine learning and statistics: the problem of estimating the joint probability density of a collection of random variables, known as density estimation, and the problem of inferring model parameters when their likelihood is intractable, known as likelihood-free inference. The contribution o…

2019-10-29abs ↗pdf ↗

The paper tackles joint learning of linear systems, improving accuracy with pooled data.

problem Estimating transition matrices of multiple related linear systems more accurately.
method Developed novel techniques to bound estimation errors and establish high probability bounds for singular values.
result Significant gains in accuracy achieved by pooling data across systems.

Random forests is a common non-parametric regression technique which performs well for mixed-type data and irrelevant covariates, while being robust to monotonic variable transformations. Existing random forest implementations target regression or classification. We introduce the RFCDE package for fitting random forest…

2018-04-16abs ↗pdf ↗

The goal of online display advertising is to entice users to "convert" (i.e., take a pre-defined action such as making a purchase) after clicking on the ad. An important measure of the value of an ad is the probability of conversion. The focus of this paper is the development of a computationally efficient, accurate, a…

2017-10-24abs ↗pdf ↗

Proposes a new model to better handle correlation risk in credit risk calculations.

problem Empirical evidence shows correlation risk is significant in credit risk models.
method Introduces a stochastic correlation extension of the Vasicek model using circular diffusion.
result Demonstrates how correlation volatility and persistence affect joint default and survival probabilities.

DynForest predicts event probabilities from longitudinal data, handling endogenous predictors.

problem Predicting individual risk using longitudinal patient history.
method Random survival forests with time-fixed features from longitudinal predictors.
result DynForest provides accurate individual event probability predictions.

The article explains the probabilistic method of default probability estimation by Pluto and Tasche.

problem Estimating default probabilities for portfolios with low default rates.
method Detailed derivation and explanation of the Pluto-Tasche method, including assumptions and inequalities.
result Clarification of borrower independence, conditional independence, and interaction between probability distributions.

GANF uses normalizing flows to detect anomalies in multiple time series.

problem Detecting anomalies in multiple time series with interdependencies.
method Bayesian network integration with normalizing flows for unsupervised anomaly detection.
result GANF effectively detects anomalies and identifies distribution drift in time series data.

AR-CSM models use derivatives of univariate log-conditionals to estimate joint distributions efficiently.

problem Scalability and stability issues in training autoregressive models.
method Parameterize joint distribution using derivatives of univariate log-conditionals and introduce Composite Score Matching (CSM) for efficient training.
result AR-CSM models are more scalable and stable compared to previous score matching algorithms.

Develops a new framework for joint portfolio risk forecasting.

problem Joint portfolio risk forecasting, especially for Value-at-Risk and Expected Shortfall.
method Semi-parametric multivariate framework with dynamic conditional correlation modeling.
result The proposed model outperforms existing approaches in risk forecasting.

Quantum probability theory reveals hidden structure in joint probability distributions.

problem Understanding hidden structure in joint probability distributions.
method Modeling joint probability distributions as density operators and applying partial trace.
result Decoding extra information in reduced density operators that captures subsystem interactions.

Econometric framework integrates heavy-tailed distributions with behavioral probability weighting for better asset pricing.

problem Underestimation of Value-at-Risk by traditional models in asset pricing.
method Developed an econometric framework combining heavy-tailed Student's tt distributions with behavioral probability weighting.
result Student's tt specifications outperform Gaussian models in 88.4% of cases, reducing underestimation of Value-at-Risk by 16.5 percentage points.