Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

68135203270 · Jun 202019922001200920172026
48 results for inference moments

We tackle causal inference under conditional moment restrictions using importance weighting.

problem Challenges in causal inference under conditional moment restrictions, especially in high-dimensional settings.
method Transform conditional moment restrictions to unconditional moment restrictions through importance weighting.
result Successfully estimate nonparametric functions defined under conditional moment restrictions.

A new method for estimating causal parameters from observables reduces the need for finite moment conditions.

problem Estimating causal parameters from observational data with unknown or infinite moment conditions.
method Variational Method of Moments (VMM) for a general class of estimators, including kernel and neural net-based methods.
result VMM estimators are consistent, asymptotically normal, and semiparametrically efficient.

This paper identifies and bounds ICE central moments using PO marginal central moments.

problem Identifying and characterizing treatment effect heterogeneity.
method Using only marginal central moments of potential outcomes, the paper identifies and bounds central moments of individual causal effects.
result Identification and bounding of central moments of ICE using marginal moments of POs.

New method approximates diffusion process posteriors using moment functions.

problem Approximating posteriors of stochastic differential equations.
method Constructs variational process as controlled prior, approximates posterior with moment functions, uses natural gradient descent.
result Richer variational approximations for state-dependent diffusion terms.

Corrected moment-based methods improve inference in topic model regression.

problem Inferential difficulties in topic model plug-in workflow for regression.
method Corrected spectral moment methods for LDA, response-weighted word moments.
result Direct identification of regression coefficients without estimating topic shares.

A method learns representations for conditional moment models with controlled ill-posedness.

problem Efficient estimation of nonparametric conditional moment models with flexible models is challenging.
method Proposes a procedure that learns spectral representations with controlled measures of ill-posedness.
result The proposed method can efficiently estimate representations from data and is L2 consistent.

QEM uses parallel importance weighting for fast approximate Bayesian inference.

problem Bayesian inference challenges in large models with many observations and latent variables.
method Expectation Maximization (EM) with massively parallel importance weighting.
result QEM is faster and more scalable than RWS and VI.

A new method of moments estimator goes beyond data reweighting.

problem Estimation of moment restrictions and conditional moment restrictions.
method Kernel Method of Moments (KMM) based on maximum mean discrepancy.
result KMM achieves competitive performance on conditional moment restriction tasks.

Estimates high-dimensional posterior densities by marginal distributions and neural networks.

problem High-dimensional probability density estimation for inference is difficult.
method Direct estimation of lower-dimensional marginal distributions, using Moment Networks for fast computation of moments.
result Demonstrates estimation of gravitational wave time series and applications in cosmology.

We propose moment-based variational inference as a flexible framework for approximate smoothing of latent Markov jump processes. The main ingredient of our approach is to partition the set of all transitions of the latent process into classes. This allows to express the Kullback-Leibler divergence between the approxima…

2019-05-14abs ↗pdf ↗

Paper provides Edgeworth expansions for network moments, improving accuracy of sampling distributions.

problem Accurate descriptions of sampling distributions of network moment statistics.
method Edgeworth expansion applied to studentized network moment statistics.
result Higher-order accurate approximation to sampling CDF of network moment statistics.

Develops a robust GMM estimator for outlier-tolerant inference.

problem Sensitive GMM estimation to outliers in inference problems.
method Robustified GMM estimator with computational efficiency and recovery guarantees.
result First computationally efficient GMM estimator for εε fraction of adversarial outliers with O(ε)O(\sqrtε) recovery guarantee.

Method estimates posterior model for boundary value problems with uncertain constraints.

problem Estimating posterior probability model for stochastic boundary value problems with uncertain constraints.
method Probabilistic learning inference using Kullback-Leibler divergence and MCMC.
result Method successfully estimates posterior probability measure with constraints.

New method for adaptive estimation and inference in econometric models without knowing smoothness.

problem Adaptive estimation and inference in ill-posed linear inverse problems with unknown smoothness.
method Discrepancy principle-based framework for adaptive hyperparameter selection.
result Achieves optimal rates in weak and strong metrics for linear functionals.

Expectation propagation (EP) is a powerful approximate inference algorithm. However, a critical barrier in applying EP is that the moment matching in message updates can be intractable. Handcrafting approximations is usually tricky, and lacks generalizability. Importance sampling is very expensive. While Laplace propag…

2019-10-27abs ↗pdf ↗

New method discovers mean and variance causal graphs from heteroscedastic data.

problem Understanding causal relationships in data with varying variance.
method Bayesian, moment-driven approach inferring separate mean and variance causal graphs.
result Accurately recovers mean and variance structures from heteroscedastic data.

This article investigates parameter estimation of affine term structure models by means of the generalized method of moments. Exact moments of the affine latent process as well as of the yields are obtained by using results derived for p-polynomial processes. Then the generalized method of moments, combined with Quasi-…

2015-08-07abs ↗pdf ↗

A new framework for lightweight BNNs learns heteroscedastic uncertainties efficiently.

problem Learning heteroscedastic uncertainties from BNNs for lightweight networks.
method Embedding heteroscedastic variances into BNN parameters and using moment propagation for inference.
result Improves predictive performance for lightweight BNNs without increasing parameter count.

Paper develops methods for inference on time series data using neural networks and sieves.

problem Inference on time series data with nonparametric conditional moment restrictions.
method GN-QLR based inference using general nonlinear sieves and multilayer neural networks.
result Optimally weighted GN-QLR statistic is asymptotically Chi-square distributed.

Many inference problems involving questions of optimality ask for the maximum or the minimum of a finite set of unknown quantities. This technical report derives the first two posterior moments of the maximum of two correlated Gaussian variables and the first two posterior moments of the two generating variables (corre…

2009-10-01abs ↗pdf ↗

Paper develops methods for estimating GLMs and SNR under proportional asymptotics.

problem Estimation of regression coefficients and SNR in high-dimensional GLMs.
method Method-of-Moments type estimators that bypass nuisance function estimation.
result Consistent and asymptotically normal estimators derived for targets of inference.

New method improves estimation of complex models from conditional moment restrictions.

problem Estimation of complex models from conditional moment restrictions.
method Functional Generalized Empirical Likelihood (GEL) with a practical method.
result The method achieves state-of-the-art performance on two problems.

We provide an approach for learning deep neural net representations of models described via conditional moment restrictions. Conditional moment restrictions are widely used, as they are the language by which social scientists describe the assumptions they make to enable causal inference. We formulate the problem of est…

2018-03-19abs ↗pdf ↗

IMM generates high-quality samples in few steps with stable training.

problem Slow inference and instability in generating high-quality samples using diffusion models and Flow Matching.
method Inductive Moment Matching (IMM) is a new generative model for one- or few-step sampling with a single-stage training procedure.
result IMM achieves state-of-the-art 2-step FID of 1.98 on CIFAR-10 for a model trained from scratch.

New method for ancestral inference in branching processes with random environments.

problem Determining ancestor distribution parameters in branching processes with random environments.
method Generalized method of moments for ancestral inference.
result Limiting distribution of ancestor and offspring estimators decouple and converge to independent Gaussian variables under certain conditions.

The total duration of drawdowns is shown to provide a moment-free, unbiased, efficient and robust estimator of Sharpe ratios both for Gaussian and heavy-tailed price returns. We then use this quantity to infer an analytic expression of the bias of moment-based Sharpe ratio estimators as a function of the return distrib…

2015-05-06abs ↗pdf ↗

New method for inference on strongly identified functionals even when nuisance functions are weakly identified.

problem Inference on continuous linear functionals of weakly identified nuisance functions defined by conditional moment restrictions.
method Proposes penalized minimax estimators for both the primary and debiasing nuisance functions, which can converge to fixed limits regardless of nuisance identifiability.
result Proves the asymptotic normality of a debiased estimator for the functional of interest, leading to asymptotically valid confidence intervals.

New SGMM algorithm for efficient estimation of moment restriction models.

problem Estimation and inference on overidentified moment restriction models.
method Stochastic Approximation to Generalized Method of Moments (SGMM).
result SGMM offers fast and scalable implementation with streaming dataset handling.

DML-CMR estimator reduces bias in CMR problems using deep neural networks.

problem Solving conditional moment restrictions with deep neural networks.
method Double/debiased machine learning framework for unbiased estimation.
result Achieves minimax optimal convergence rate of O(N1/2)O(N^{-1/2}).

Generative adversarial networks are a novel method for statistical inference that have achieved much empirical success; however, the factors contributing to this success remain ill-understood. In this work, we attempt to analyze generative adversarial learning -- that is, statistical inference as the result of a game b…

2018-09-12abs ↗pdf ↗

Cryptocurrency markets treat infrastructure failures and regulatory shocks differently, but the effect is not statistically significant.

problem Understanding how cryptocurrency markets differentiate between infrastructure failures and regulatory shocks.
method A multi-moment event study using GJR-GARCH-X model with matched dependence-robust inference.
result The differential impact of infrastructure failures and regulatory shocks on cryptocurrency markets is not statistically significant.

New GP-based method improves uncertainty quantification for causal functions.

problem Challenges in quantifying uncertainty for causal effects, especially for entire functions.
method GP-based approach using inner-product of observational functions in RKHS, with tractable posterior moments and calibration.
result Improves uncertainty quantification while maintaining causal effect estimation performance.

Paper develops efficient recursive learning for multi-channel systems with heterogeneous dynamics.

problem Accurately learning system dynamics in complex, multi-channel systems with nonlinear and noisy data.
method Formulates system as Gaussian process state-space models (GPSSMs), introduces heterogeneous multi-output kernel, and develops recursive inference framework.
result Matches SOTA offline GPSSMs in accuracy with 1/100 runtime, and outperforms SOTA online GPSSMs by 70% in accuracy under noise with 1/20 runtime.