A new method of moments estimator goes beyond data reweighting.
problem Estimation of moment restrictions and conditional moment restrictions.
method Kernel Method of Moments (KMM) based on maximum mean discrepancy.
result KMM achieves competitive performance on conditional moment restriction tasks.
New method improves estimation of complex models from conditional moment restrictions.
problem Estimation of complex models from conditional moment restrictions.
method Functional Generalized Empirical Likelihood (GEL) with a practical method.
result The method achieves state-of-the-art performance on two problems.
New method tightens sub-Gaussian concentration inequalities.
problem Estimating variance-type parameters of sub-Gaussian distributions.
method Using sub-Gaussian intrinsic moment norm to maximize normalized moments.
result Provides tighter sub-Gaussian concentration inequalities.
Empirical moment matrix reveals properties of point clouds.
problem Uncovering properties of point clouds, especially those with singular support.
method Combining statistics, real algebraic geometry, and approximation theory.
result The empirical moment matrix provides insights into data analysis.
Proposes robust graph embedding with noisy link weights.
problem Learning feature vectors from noisy link weights.
method β-graph embedding with empirical moment β-score.
result Computational tractability and local minimization of β-score.
Enhanced Adam uses higher-order moments for better performance.
problem Improving the performance of Adam optimization algorithm.
method Proposes HAdam, an extension of Adam using higher-order moments of the stochastic gradient.
result Higher-order moments of the stochastic gradient can lead to better performance than vanilla Adam.
This article investigates parameter estimation of affine term structure models by means of the generalized method of moments. Exact moments of the affine latent process as well as of the yields are obtained by using results derived for p-polynomial processes. Then the generalized method of moments, combined with Quasi-…
Proof of a simpler orthogonal double machine learning method.
problem Consistency and asymptotic normality of machine learning estimates.
method Alternative proof for Z-estimator in simpler setting.
result Orthogonal moments and consistency imply asymptotic normality.
A new method for generating samples without training, using smoothed score matching.
problem Generating samples efficiently and without training.
method Moment-matched score-smoothed overdamped Langevin dynamics (MM-SOLD).
result The method enables fast, robust, training-free sampling with competitive sample fidelity and diversity.
This paper identifies and bounds ICE central moments using PO marginal central moments.
problem Identifying and characterizing treatment effect heterogeneity.
method Using only marginal central moments of potential outcomes, the paper identifies and bounds central moments of individual causal effects.
result Identification and bounding of central moments of ICE using marginal moments of POs.
The hidden tail of empirical distributions is analyzed using extreme value theory.
problem Understanding the bias between in-sample mean and true statistical mean for large n. method Extreme value theory applied to empirical distributions and their moments.
result The hidden moment of order 0 for power law distributions follows an exponential distribution with expectation 1/n. New KCM tests improve specification testing via RKHS.
problem Improving specification tests for econometric models.
method Kernel conditional moment (KCM) tests based on RKHS.
result KCM tests have better finite-sample performance than existing tests.
Bayesian framework uses AI-generated data to improve parameter estimation.
problem Parameter estimation in models with unknown or unspecified likelihood.
method Exponentially tilted empirical likelihood with Dirichlet process posterior.
result AI-generated data can provide useful regularization for parameter estimation.
Efficient algorithm for mixed membership models with large p.
problem Learning mixed membership models with high p and k.
method Efficient algorithm reducing tensor decomposition to sub-tensor factorization.
result Provable guarantees and competitive empirical results.
Analyzes GJR-GARCH moments for efficient predictive distributions.
problem Estimating moments of GARCH processes for accurate predictions.
method Derives analytic expressions for GJR-GARCH moments and their limits.
result Analytic moments provide excellent approximate predictive distributions.
Empower efficient representation of distributions through moment-preserving methods.
problem Representing high-dimensional probability measures efficiently and accurately.
method Empower efficient representation of distributions through moment-preserving methods.
result Empowers efficient and accurate representation of high-dimensional probability measures.
GANs learn distributions by matching low-degree moments.
problem Understanding when GANs learn the target distribution efficiently.
method Theoretical analysis and empirical observation of GAN training process.
result GANs can learn notable distributions by matching polynomially many low-degree moments.
Tensor decomposition recovers Gaussian mixtures from moments.
problem Recovering Gaussian mixture models from datasets.
method Symmetric tensor decomposition of moment tensors built from empirical moments.
result Identifiable tensors with interpolation degree less than half their order.
DGMM improves Gaussian mixture modeling efficiency and stability.
problem Efficiently estimating Gaussian mixtures in high dimensions.
method Diagonally-weighted generalized method of moments (DGMM).
result DGMM achieves smaller estimation errors with shorter runtime.
New SGMM algorithm for efficient estimation of moment restriction models.
problem Estimation and inference on overidentified moment restriction models.
method Stochastic Approximation to Generalized Method of Moments (SGMM).
result SGMM offers fast and scalable implementation with streaming dataset handling.
The paper analyzes the performance of empirical risk minimization for p-norm linear regression.
problem Empirical risk minimization on p-norm linear regression. method Analyzes performance under various conditions and moment assumptions.
result High probability excess risk bounds for empirical risk minimizer, matching asymptotic rates.
We develop a scale-invariant truncated Lévy (STL) process to describe physical systems characterized by correlated stochastic variables. The STL process exhibits Lévy stability for the probability density, and hence shows scaling properties (as observed in empirical data); it has the advantage that all moments are fini…
Improves deep learning optimization with a new stochastic gradient method.
problem Noisy and sparse gradients in deep learning optimization.
method Proposes a family of double adaptive stochastic gradient methods (DASGrad).
result Analyzes theoretical convergence improvements and empirical validation.
Paper provides uniform deviation bounds for unbounded loss functions, improving k-Means clustering bounds.
problem Uniform deviation bounds for unbounded loss functions, specifically k-Means clustering.
method Novel framework to obtain uniform deviation bounds for unbounded loss functions.
result Improved bounds for k-Means clustering under weak assumptions, achieving $\mathcal{O}\left(m^{-\frac12}
ight)$ rate.
New statistical test for change-point detection using relative entropy.
problem Offline change-point detection using divergence metrics.
method Study of empirical relative entropy distributions, derivation of approximations, introduction of new Berry-Esseen bounds.
result Theoretical and practical validation of relative entropy for change-point detection.
The non-gaussianity of processes observed in financial markets and relatively good performance of gaussian models can be reconciled by replacing the Brownian motion with Levy processes whose Levy densities decay as exp(-lambda|x|) or faster, where lambda>0 is large. This leads to asymptotic pricing models. The leading …
Paper identifies tensor ranks via prior predictive matching, solving system of equations.
problem Determining the latent dimensions (ranks) in tensor factorization models.
method Prior predictive moment matching to transform moment matching conditions into a log-linear system of equations.
result Identifies which tensor models have identifiable ranks and derives rank estimators.
Empirical comparison of PCA and ICA on noisy time series.
problem Comparing PCA and ICA performance on noisy data.
method Applied PCA and ICA to two simulated noisy time series with varying distribution parameters and noise levels.
result ICA outperforms PCA due to considering higher moments of data distribution.
Theoretical models applied to option pricing should take into account the empirical characteristics of the underlying financial time series. In this paper, we show how to price basket options when assets follow a shifted log-normal process with jumps capable of accommodating negative skewness. Our technique is based on…
Paper provides Edgeworth expansions for network moments, improving accuracy of sampling distributions.
problem Accurate descriptions of sampling distributions of network moment statistics.
method Edgeworth expansion applied to studentized network moment statistics.
result Higher-order accurate approximation to sampling CDF of network moment statistics.
Deviation inequalities for stochastic approximation methods.
problem Establishing bounds on the deviation of stochastic approximation methods.
method Martingale approximation method for separately Lipschitz functions.
result Established various deviation inequalities for stochastic approximation by averaging and minimization.
Unified framework for imitation learning via moment matching.
problem Closing the gap between imitation and real-world performance.
method Classifying imitation learning algorithms based on reward or action-value moment matching, considering adversarial divergences.
result Derivation of bounds on policy performance for all algorithms in each class, and introduction of moment recoverability.
Proposes a robust IV estimator using optimal transport for corrupted or adversarial data.
problem Lack of robustness in traditional IV estimators for corrupted or adversarial data.
method Integrates data-derivative information through optimal transport to address geometric aspects of data.
result Improves robustness against data corruption and adversarial attacks.
The iterative nature of the expectation maximization (EM) algorithm presents a challenge for privacy-preserving estimation, as each iteration increases the amount of noise needed. We propose a practical private EM algorithm that overcomes this challenge using two innovations: (1) a novel moment perturbation formulation…
Study compares optimal vs. naive diversification in crypto markets, finds time-varying moments improve performance.
problem Optimizing portfolio construction in volatile crypto markets.
method Examines time-varying moments and transaction costs, incorporates turnover penalty.
result Time-varying moment estimators outperform conventional estimators in practical portfolio construction.
Estimates Heston SDE parameters from observable realized volatilities.
problem Estimating parameters of Heston SDEs from observable data.
method Constructs estimators from empirical moments of realized volatilities over sliding windows.
result Explicit bounds for the convergence of realized volatilities to true volatilities.
New method uses geometric moments for accurate machine learning potentials.
problem Creating high-dimensional potential energy surfaces efficiently.
method Feed-forward neural networks with invariant local molecular descriptors based on geometric moments.
result Accuracy comparable to established models, high efficiency.
Efficient policy learning from observational data using weighted classification reductions.
problem Efficient policy evaluation does not necessarily lead to efficient estimation of policy parameters.
method Proposed an estimation approach based on generalized method of moments, efficient for policy parameters.
result Demonstrated empirical efficiency and regret benefits of a proposed method.
A new framework for efficient large-scale learning using sketching of moments.
problem Efficiently learning from large datasets with limited computational resources.
method Compressing the training data into a low-dimensional sketch and solving a nonlinear least squares problem.
result Sufficient sketch sizes to control the generalization error of the procedure.
New bounds on machine learning model generalization error moments.
problem Understanding the performance of machine learning models.
method Information-theoretic bounds on the moments of the generalization error of learning algorithms.
result Proposed bounds on generalization error moments and their high-probability bounds.
Proposes DWMD for better matching of hidden representations across domains.
problem Measuring data distribution discrepancy between semantically related domains for feature representation matching.
method DWMD, a moment-based probability distribution metric that explicitly orders and weights higher-order moments.
result DWMD is error-free and can strictly reflect distribution differences without feature distribution assumptions.
New stability framework relaxes boundedness assumptions for generalization bounds.
problem Overly restrictive assumptions for modern learning settings with heavy-tailed or unbounded losses.
method Develops a stability-based framework requiring only finite Lp moment conditions. result Sharp generalization bounds derived for various learning paradigms.
We derive a general multivariate theory for realised characteristics of `model-free discretisation-invariant swaps', so-called because the standard no-arbitrage assumption of martingale forward prices is sufficient to derive fair-value swap rates for such characteristics which have no jump or discretisation errors. Thi…
Efficient algorithms estimate moments robustly to outliers.
problem Estimating moments of unknown distributions with adversarial outliers.
method Sum-of-squares relaxation of optimization problem.
result Improved guarantees and algorithms for independent component analysis and mixture learning.
A new method for estimating causal parameters from observables reduces the need for finite moment conditions.
problem Estimating causal parameters from observational data with unknown or infinite moment conditions.
method Variational Method of Moments (VMM) for a general class of estimators, including kernel and neural net-based methods.
result VMM estimators are consistent, asymptotically normal, and semiparametrically efficient.
The MEM method uses data-driven priors for linear inverse problems, proving convergence and estimating differences.
problem Linear inverse problems with approximate priors.
method Maximum Entropy on the Mean (MEM) method with data-driven priors.
result Empirical mean convergence and estimates for prior differences based on epigraphical distance.
We tackle causal inference under conditional moment restrictions using importance weighting.
problem Challenges in causal inference under conditional moment restrictions, especially in high-dimensional settings.
method Transform conditional moment restrictions to unconditional moment restrictions through importance weighting.
result Successfully estimate nonparametric functions defined under conditional moment restrictions.
A new model uses time-changed fractional Brownian motion to price financial options.
problem Non-semimartingale nature of fractional Brownian motion limits option pricing.
method Develops a time-changed fractional Brownian motion and a fractional Variance Gamma model.
result Empirical analysis shows consistent Hurst exponent of approximately 0.45.