A new method extracts features and reconstructs moments in dynamical systems using information geometry.
problem Reconstructing moments in dynamical systems efficiently and accurately.
method Information-geometric approach on spaces of probability measures.
result Moments can be expanded in eigenfunctions of a kernel integral operator, enabling nonparametric forecasting.
This paper uses HCR to predict bid-ask spreads from accessible data.
problem Predicting bid-ask spreads from incomplete data.
method Hierarchical correlation reconstruction (HCR) to model conditional distributions.
result Accurate predictions of bid-ask spreads with interpretable coefficients.
New method tightens sub-Gaussian concentration inequalities.
problem Estimating variance-type parameters of sub-Gaussian distributions.
method Using sub-Gaussian intrinsic moment norm to maximize normalized moments.
result Provides tighter sub-Gaussian concentration inequalities.
Improved GAN performance using higher-order Wasserstein moments.
problem Stabilizing and enhancing GANs for better mode coverage and stability.
method Deriving and training a GAN with a modified Wasserstein distance using higher-order moments.
result Training a GAN with higher-order Wasserstein moments improves performance, even with increased computational cost.
We present a generalization of Minkowski's classic theorem on the reconstruction of tetrahedra from algebraic data to homogeneously curved spaces. Euclidean notions such as the normal vector to a face are replaced by Levi-Civita holonomies around each of the tetrahedron's faces. This allows the reconstruction of both s…
A new filter reduces density fitting to a linear solve, improving performance on nonlinear systems.
problem Nonlinear Bayesian filtering challenges in representing belief distributions.
method Combines score matching with Stein's identity to avoid partition function evaluation.
result The Score Kalman Filter (SKF) outperforms existing methods on nonlinear systems.
Sharp threshold found for aligning Gaussian-weighted graphs.
problem Reconstructing planted permutations in Gaussian-weighted graphs.
method Analysis of MAP estimator and second moment method.
result Sharp information-theoretic threshold for exact recovery.
Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with the reconstruction loss. However, we reveal that this training recipe shared by …
New real algebraic maps with prescribed images and compositions are constructed locally like moment maps.
problem Constructing real algebraic maps with specific properties and compositions.
method Explicit construction of real algebraic hypersurfaces and maps with prescribed images and compositions.
result Explicit families of functions represented as compositions of constructed maps with canonical projections.
A new method for density estimation using mixture discrepancy and moments.
problem Generalizing histogram statistics to higher dimensions.
method Density estimation via mixture discrepancy and moments (DSP-mix and MSP).
result DSP-mix and MSP are computationally tractable and maintain accuracy with increased speed.
Recent work suggests that some auto-encoder variants do a good job of capturing the local manifold structure of the unknown data generating density. This paper contributes to the mathematical understanding of this phenomenon and helps define better justified sampling algorithms for deep learning based on auto-encoder v…
We propose a fair principal component analysis method that balances reconstruction error and subgroup fairness.
problem Fairness and robustness in principal component analysis for consequential domains.
method Distributionally robust optimization over the Stiefel manifold with a Riemannian subgradient descent.
result The proposed method achieves better performance on real-world datasets compared to state-of-the-art baselines.
New framework uses score-based priors to solve ill-conditioned polynomial equations, improving signal recovery from noisy data.
problem Recovering signals from low-order moments in inverse problems, especially ill-conditioned polynomial equations.
method Integrates score-based diffusion priors with moment-based estimators to regularize and solve nonlinear inverse problems.
result Diffusion priors improve recovery from third-order moments and make super-resolution MTD feasible.
In many signal processing applications, the aim is to reconstruct a signal that has a simple representation with respect to a certain basis or frame. Fundamental elements of the basis known as "atoms" allow us to define "atomic norms" that can be used to formulate convex regularizations for the reconstruction problem. …
New AMP algorithms improve multi-layer signal reconstruction.
problem Reconstructing signals and hidden variables from multi-layer networks with rotationally invariant weights.
method Developed multi-layer rotationally invariant generalized AMP (ML-RI-GAMP) algorithms and state evolution recursion.
result ML-RI-GAMP outperforms existing methods in terms of lower complexity and similar performance.
We model non-stationary volume-price distributions with a log-normal distribution and collect the time series of its two parameters. The time series of the two parameters are shown to be stationary and Markov-like and consequently can be modelled with Langevin equations, which are derived directly from their series of …
Nonparametric models are versatile, albeit computationally expensive, tool for modeling mixture models. In this paper, we introduce spectral methods for the two most popular nonparametric models: the Indian Buffet Process (IBP) and the Hierarchical Dirichlet Process (HDP). We show that using spectral methods for the in…
FM4PDE learns PDE solutions from sparse data.
problem Reconstructing PDE solutions from limited observations.
method Flow-matching generative framework that learns PDE coefficients and solutions.
result Error guarantees for guided procedures, including deterministic and stochastic samplers.
Efficient method for learning continuous exponential families beyond Gaussian.
problem Learning continuous exponential families with unbounded support.
method Interaction Screening approach for scalable learning of continuous graphical models.
result Our estimator maintains similar accuracy and sample complexity scalings compared to alternative approaches, while improving run-time.
This paper resolves the all-or-nothing phase transition in graph matching.
problem Recovering vertex correspondence between edge-correlated random graphs.
method Analysis of mutual information, truncated second-moment computation, and maximum likelihood estimator.
result Sharp thresholds for correct matching in both dense and sparse graphs.
SyNGLER generates synthetic networks efficiently while preserving key structural properties.
problem Efficiently generating realistic synthetic networks with preserved structural properties.
method SyNGLER uses latent space network models to learn and reconstruct node embeddings, then generates synthetic networks.
result SyNGLER produces synthetic networks that better preserve key network characteristics than existing approaches.
Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch is a collection of generalized moments of the underlying probability distributio…
Study geodesic X-ray transforms on hyperbolic surfaces, proposing new reconstruction methods.
problem Inverting geodesic X-ray transforms for symmetric tensor fields on asymptotically hyperbolic surfaces.
method Developed a decomposition theorem for m-tensor fields, used Guillemin-Kazhdan operators and 0-calculus, and provided explicit reconstruction methods.
result Explicit reconstruction methods for even tensor fields from their X-ray transform or normal operator.
New method generates realistic financial price paths with drawdowns.
problem Lack of realistic drawdown scenarios in financial simulations.
method Variational autoencoder with drawdown reconstruction loss and path signatures.
result Simulated paths closely match empirical drawdown data.
In this note we answer a question of G. Lecué, by showing that column normalization of a random matrix with iid entries need not lead to good sparse recovery properties, even if the generating random variable has a reasonable moment growth. Specifically, for every 2≤p≤c1logd we construct a random vector …
A new method calculates fractional moments using the moment-generating function.
problem Computing fractional moments from probability densities.
method Integral framework based on moment-generating function.
result Exact integral expressions for various types of moments.
Study compares weak and homotopy moment maps in multisymplectic geometry.
problem Existence and equivariance of moment maps in multisymplectic geometry.
method Comparison of weak and homotopy moment maps.
result Analysis of existence and equivariance phenomena.
For a GJR-GARCH specification with a generic innovation distribution we derive analytic expressions for the first four conditional moments of the forward and aggregated returns and variances. Moment for the most commonly used GARCH models are stated as special cases. We also the limits of these moments as the time hori…
This paper identifies and bounds ICE central moments using PO marginal central moments.
problem Identifying and characterizing treatment effect heterogeneity.
method Using only marginal central moments of potential outcomes, the paper identifies and bounds central moments of individual causal effects.
result Identification and bounding of central moments of ICE using marginal moments of POs.
We tackle causal inference under conditional moment restrictions using importance weighting.
problem Challenges in causal inference under conditional moment restrictions, especially in high-dimensional settings.
method Transform conditional moment restrictions to unconditional moment restrictions through importance weighting.
result Successfully estimate nonparametric functions defined under conditional moment restrictions.
Revisits Lee's Moment Formula, relaxing moment assumptions for implied volatility.
problem Implied volatility constraints under finite log-moments.
method Analyzes stock price martingale with finite log-moments, derives new bounds and proof.
result New bounds on implied volatility growth, relaxes moment assumptions.
Enhanced Adam uses higher-order moments for better performance.
problem Improving the performance of Adam optimization algorithm.
method Proposes HAdam, an extension of Adam using higher-order moments of the stochastic gradient.
result Higher-order moments of the stochastic gradient can lead to better performance than vanilla Adam.
A new GAN model uses characteristic functions to improve image generation.
problem Improving stability and diversity in GANs for complex distributions.
method Integrates characteristic functions to compare distributions directly, stabilizes training, and uses auto-encoder structure.
result Proposes RCF-GAN achieving superior image generation and reconstruction.
Developed moment estimators for affine stochastic volatility models.
problem Estimating parameters of affine stochastic volatility models.
method Introduced recursive equations for moments and proposed moment estimators.
result Established a central limit theorem and derived asymptotic covariance matrix.
HEBAE improves VAEs by adaptively balancing reconstruction and regularization.
problem Posterior collapse in VAEs leading to over-regularization and poor latent encoding.
method Hierarchical Empirical Bayes approach to probabilistic generative models.
result HEBAE generates higher quality samples with better FID scores.
Stiefel-Whitney classes of moment-angle manifolds are trivial.
problem Analyzing the topological properties of moment-angle manifolds.
method Proving triviality of Stiefel-Whitney classes for moment-angle manifolds, including partial quotients.
result Stiefel-Whitney classes of moment-angle manifolds are trivial.
A new method for estimating causal parameters from observables reduces the need for finite moment conditions.
problem Estimating causal parameters from observational data with unknown or infinite moment conditions.
method Variational Method of Moments (VMM) for a general class of estimators, including kernel and neural net-based methods.
result VMM estimators are consistent, asymptotically normal, and semiparametrically efficient.
Introduces generalized moment maps for almost Hermitian settings.
problem Extending classical moment map theory to almost Hermitian settings.
method Introduces momentumly closed forms and proves a variant of the Darboux-Weinstein theorem.
result Establishes convexity property and constructs reduction space for generalized moment maps.
Proposes Moment Exchange to use moments in image recognition models, improving generalization.
problem Discarding moments in image recognition models reduces stability and training time.
method Moment Exchange: replaces moments of learned features with another image's moments and interpolates labels.
result Improves generalization of recognition models across multiple datasets.
New KCM tests improve specification testing via RKHS.
problem Improving specification tests for econometric models.
method Kernel conditional moment (KCM) tests based on RKHS.
result KCM tests have better finite-sample performance than existing tests.
Constructs a moment map flow for isotropic maps on surfaces.
problem Understanding isotropic maps on surfaces and their properties.
method Develops a Kähler moment map geometry and a modified moment map flow.
result Polyhedral modified moment map flow induces a strong deformation retraction.
A new method of moments estimator goes beyond data reweighting.
problem Estimation of moment restrictions and conditional moment restrictions.
method Kernel Method of Moments (KMM) based on maximum mean discrepancy.
result KMM achieves competitive performance on conditional moment restriction tasks.
Moment Pooling reduces latent space dimensions in machine learning models.
problem High-dimensional latent spaces in machine learning models are hard to interpret.
method Moment Pooling extends Deep Sets networks to arbitrary multivariate moments.
result Latent dimensions as small as 1 can achieve similar performance to higher dimensions.
Deformation quantization yields a new moment map on symplectic diffeomorphisms.
problem Formalizing moment maps on diffeomorphism groups of symplectic manifolds.
method Deformation quantization framework applied to extrmDiff0(M). result Obtained a deformation of the Donaldson moment map.
The paper derives formulas for moments of a Student t distribution and applies them to quantify Lp-quantiles.
problem Understanding the moments and quantiles of a Student t distribution.
method Developed formulas for partial and complete moments, and derived relationships between Lp-quantiles. result For a Student t distribution, the Ln−j+1-quantile and Lj-quantile coincide at any confidence level. Cryptocurrency markets treat infrastructure failures and regulatory shocks differently, but the effect is not statistically significant.
problem Understanding how cryptocurrency markets differentiate between infrastructure failures and regulatory shocks.
method A multi-moment event study using GJR-GARCH-X model with matched dependence-robust inference.
result The differential impact of infrastructure failures and regulatory shocks on cryptocurrency markets is not statistically significant.
We propose a method of moments (MoM) algorithm for training large-scale implicit generative models. Moment estimation in this setting encounters two problems: it is often difficult to define the millions of moments needed to learn the model parameters, and it is hard to determine which properties are useful when specif…
We discuss the probabilistic properties of the variation based third and fourth moments of financial returns as estimators of the actual moments of the return distributions. The moment variations are defined under non-parametric assumptions with quadratic variation method but for the computational tractability, we use …