New estimator stabilizes higher-order influence functions for stable statistical inference.
problem Numerical instability in estimating inverse population Gram matrix.
method Proposes a new stabilized higher-order estimator without sample splitting.
result Stabilized estimator exhibits more stable performance and similar statistical guarantees.
New estimator stabilizes higher-order influence functions for bilinear forms.
problem Stability issues in estimating bilinear forms using higher-order influence functions.
method Proposes a new stabilized higher-order estimator for a class of bilinear forms without sample splitting.
result New estimator exhibits more stable finite-sample performance compared to the empirical higher-order estimator.
A new method predicts higher-order interactions in evolving graphs using simplicial complexes.
problem Predicting higher-order interactions in dynamic graphs with theoretical guarantees.
method Capturing higher-order interactions as simplices, modeling neighborhoods with face-vectors, and developing a nonparametric kernel estimator.
result Our method outperforms existing higher-order prediction methods and is theoretically consistent.
The paper provides estimates for higher-order Ricci curvature along Kähler-Ricci flows.
problem Estimating higher-order curvature along Kähler-Ricci flows on compact Kähler manifolds.
method Proving uniform bounds for Ricci curvature and scalar curvature in various orders and norms.
result A geometric obstruction causes a specific third-order derivative of Ricci curvature to blow up at rate et/2. Sharp spectral gap estimates for higher-order operators on hyperbolic spaces.
problem Estimating spectral gaps for higher-order operators on Cartan-Hadamard manifolds.
method Symmetrization-free proofs based on general functional inequalities.
result Solves a sharp asymptotic problem from Cheng and Yang and answers a question from Kristály.
Study improves BN TTA under distribution shift using higher-order asymptotics.
problem Improving BN TTA for changing data distributions.
method Integrates Edgeworth expansion and saddlepoint approximation with one-step M-estimation.
result Derives optimal weighting parameter for minimized mean-squared error.
Estimates hypergraphons for modeling complex interactions efficiently.
problem Modeling higher-order interactions using hypergraphons.
method Restricted class of Simple Lipschitz Hypergraphons (SLH) for efficient estimation.
result Optimal rates of convergence for SLH estimator.
Networks are a natural representation of complex systems across the sciences, and higher-order dependencies are central to the understanding and modeling of these systems. However, in many practical applications such as online social networks, networks are massive, dynamic, and naturally streaming, where pairwise inter…
A method to estimate high order derivatives of data distributions from samples.
problem Estimating high order derivatives of data distributions efficiently and accurately.
method Generalizing denoising score matching via Tweedie's formula to estimate higher order derivatives.
result Models trained with the proposed method can approximate second order derivatives more efficiently and accurately than via automatic differentiation.
We obtain sharp estimates involving the mean curvatures of higher order of a complete bounded hypersurface immersed in a complete Riemannian manifold. Similar results are also given for complete spacelike hypersurfaces in Lorentzian ambient spaces.
The paper defines and analyzes higher-order Yang-Mills-Higgs functionals and their gradient flows.
problem Analyzing the behavior of higher-order Yang-Mills-Higgs functionals and their gradient flows.
method Gauge fixing technique, L2-bound of the Higgs field, local L2-derivative estimates, energy estimates, blow-up analysis. result Solutions to the gradient flow do not hit finite time singularities under certain conditions.
New model estimates higher-order interactions in stochastic processes using lower-dimensional projections.
problem Estimating higher-order interaction effects in stochastic processes with limited data.
method Additive Poisson Process (APP) combines information geometry and generalized additive models to model intensity functions in lower dimensions.
result The model can estimate higher-order intensity functions with sparse data.
Improved estimation of higher order integrals using shrinkage techniques.
problem Estimating higher order Bochner integrals in non-parametric settings.
method Shrinkage of U-statistic towards a target element, considering kernel degeneracy.
result Consistent shrinkage estimators with fast rates of convergence, even for non-degenerate kernels.
The paper constructs denoisers that recover the Brenier map from higher-order score functions.
problem Estimating the Brenier map from noisy data.
method Constructs a hierarchy of denoisers using higher-order score functions.
result The T∞ denoiser recovers the Brenier map from the additive Gaussian model. Novel higher-order group synchronization for noisy local measurements on hypergraphs.
problem Synchronizing higher-order local measurements on hyperedges to global estimates on nodes.
method Message passing algorithm for global synchronization of higher-order measurements.
result Higher-order method outperforms standard pairwise synchronization methods in certain applications.
In this paper, we consider lower order eigenvalues of Laplacian operator with any order in Euclidean domains. By choosing special rectangular coordinates, we obtain two estimates for lower order eigenvalues.
Paper studies Laplace operator estimates in harmonic map heat flows.
problem Estimating Laplace operator in harmonic map heat flows outside singularities.
method Investigates estimates using spherical coordinates for T2 and T3 boundary conditions. result Provides higher-order estimates for the Ericksen--Leslie system.
We develop and implement a novel fast bootstrap for dependent data. Our scheme is based on the i.i.d. resampling of the smoothed moment indicators. We characterize the class of parametric and semi-parametric estimation problems for which the method is valid. We show the asymptotic refinements of the proposed procedure,…
Optimal first-order methods are shown to be fundamental limits in functional estimation.
problem Optimal functional estimation under weak conditions.
method Formalization of functional estimation with black-box nuisance function estimates and derivation of minimax lower bounds.
result First-order methods are optimal under weak conditions, but higher-order methods can outperform them when nuisance function structure is known.
Many nonlinear extensions of the Kalman filter, e.g., the extended and the unscented Kalman filter, reduce the state densities to Gaussian densities. This approximation gives sufficient results in many cases. However, this filters only estimate states that are correlated with the observation. Therefore, sequential esti…
We consider the higher order buckling eigenvalues of the following Dirichlet poly-Laplacian in the unit sphere (−Δ)pu=Λ(−Δ)u with order p(≥2). We obtain universal bounds on the (k+1)th eigenvalue in terms of the first kth eigenvalues independent of the domains. In particular, for p=2, our result is shar…
Users form information trails as they browse the web, checkin with a geolocation, rate items, or consume media. A common problem is to predict what a user might do next for the purposes of guidance, recommendation, or prefetching. First-order and higher-order Markov chains have been widely used methods to study such se…
This paper precisely estimates transformer derivatives for explicit learning guarantees.
problem Computing fully-explicit generalization bounds for transformers with precise higher-order derivative estimates.
method Analyzes and estimates all higher-order derivatives of transformers with multiple attention heads and layer normalization.
result Obtains explicit pathwise generalization bounds for transformers learning from non-i.i.d. samples.
New methods improve estimation accuracy in noisy settings.
problem Estimating treatment effects in the presence of treatment noise.
method Developed new structure-agnostic cumulant estimators and practical procedures for higher-order robustness.
result Demonstrated that existing DML estimator is suboptimal for non-Gaussian treatment noise and introduced ACE procedures for improved accuracy.
In this paper, we first introduce higher order Dirichlet-to-Neumann maps on graphs which can be viewed as a discrete analogue of the corresponding Dirichlet-to-Neumann maps on compact Riemannian manifolds with boundary and a higher order generalization of the Dirichlet-to-Neumann map on graphs introduced by Hua-Huang-W…
New Riemannian optimization improves variance estimation in mixed models.
problem Challenges in estimating variance parameters in linear mixed models due to constraints.
method Formulated as an optimization problem on a Riemannian manifold, using Riemannian gradient and Hessian.
result Yields higher quality variance parameter estimates compared to existing methods.
Paper proposes a new tensor model for mixed memberships and provides error bounds.
problem Estimating mixed memberships in higher-order multiway data.
method Tensor mixed-membership blockmodel, higher-order orthogonal iteration algorithm (HOOI), simplex corner-finding algorithm.
result Consistency of estimation procedure with error bounds under specific conditions.
Study optimizes zero-order strongly convex function minimization with higher order smoothness.
problem Optimizing a strongly convex function with noisy evaluations.
method Randomized approximation of projected gradient descent with smoothing kernel.
result Upper bounds and minimax lower bounds for the algorithm, showing near-optimality.
Method provides formal guarantees for decomposing model uncertainty.
problem Decomposing model uncertainty into aleatoric and epistemic components.
method Higher-order calibration using k-snapshots.
result Formal guarantees for aleatoric uncertainty matching real-world distribution.
Paper proves higher-order flow matching preserves optimality in generative modeling.
problem Theoretical guarantees for higher-order flow matching in generative modeling.
method Neural network approximations with controlled depth, width, and sparsity.
result Proves worst case optimality for second-order flow matching.
Training deep neural networks with spatio-temporal (i.e., 3D) or multidimensional convolutions of higher-order is computationally challenging due to millions of unknown parameters across dozens of layers. To alleviate this, one approach is to apply low-rank tensor decompositions to convolution kernels in order to compr…
Paper proposes a new method to identify causal graphs with latent variables using higher-order cumulants.
problem Estimating causal directed acyclic graphs with latent confounders.
method Uses higher-order cumulants to identify causal structures among observed and latent variables.
result Validates the proposed algorithm through simulations and real-world data.
The paper identifies causal effects in latent variable models using higher-order cumulants.
problem Challenges in identifying causal effects in latent variable models with latent confounders.
method Using higher-order cumulants, the paper addresses two challenging setups: a single proxy variable and underspecified instrumental variables.
result Causal effects are identifiable with a single proxy or instrument.
CDF2PDF is a method of PDF estimation by approximating CDF. The original idea of it was previously proposed in [1] called SIC. However, SIC requires additional hyper-parameter tunning, and no algorithms for computing higher order derivative from a trained NN are provided in [1]. CDF2PDF improves SIC by avoiding the tim…
Study privacy vs. utility in estimating network parameters with aggregated data.
problem Privacy-preserving estimation of network parameters from aggregated node degrees.
method β model, local and central differential privacy, minimax lower bounds, simple estimators.
result Achieved minimax-optimal risk bounds for parameter estimation under privacy constraints.
A new method for state estimation on complex networks.
problem Reconstructing latent dynamics from multivariate time-series on topological cell complexes.
method Topology-aware state space framework derived from stochastic partial differential equations, with state evolution following heat-like topological diffusion.
result The proposed method successfully recovers latent states and topological structures in real-world networks.
We provide a simple method and relevant theoretical analysis for efficiently estimating higher-order lp distances. While the analysis mainly focuses on l4, our methodology extends naturally to p = 6,8,10..., (i.e., when p is even). Distance-based methods are popular in machine learning. In large-scale applications, sto…
Based on ideas of L. Alías, D. Impera and M. Rigoli developed in "Hypersurfaces of constant higher order mean curvature in warped products", we develope a fairly general weak/Omori-Yau maximum principle for trace operators. We apply this version of maximum principle to generalize several higher order mean curvature est…
New quantum states capture more information, enabling advanced processing tasks.
problem Quantum information processing challenges with limited statistical information.
method Introducing Random-Coefficient Pure States (RCPS) and exploiting their higher-order statistics.
result RCPS provide richer information than density operators, enabling new quantum tasks.
In principle, higher-order networks that have multiple edge types are more informative than their lower-order counterparts. In practice, however, excessively rich information may be algorithmically infeasible to extract. It requires an algorithm that assumes a high-dimensional model and such an algorithm may perform po…
Study higher-order spin glass models for social network behavior with peer-group effects.
problem Modeling correlation phenomena on social networks with peer-group effects.
method Inference in higher-order Ising models to recover coefficients and peer-group effects.
result Strong concavity of log pseudo-likelihood implies statistical error rate of sqrt(d/n) for MPLE.
New stable HOIF estimators for statistical functionals.
problem Constructing numerically stable HOIF estimators for statistical functionals.
method Developed new sHOIF estimators with provable guarantees.
result 2nd order sHOIF estimators were validated in synthetic experiments.
We introduce higher-order Poincar'e constants for compact weighted manifolds and estimate them from above in terms of subsets. These estimates imply upper bounds for eigenvalues of the weighted Laplacian and the first nontrivial eigenvalue of the p-Laplacian. In the case of the closed eigenvalue problem and the Neuma…
The purpose of this paper is to prove the a priori estimates for constant scalar curvature Kaehler metrics with conic singularities along normal crossing divisors. The zero order estimates are proved by a reformulated version of Alexandrov's maximum principle. The higher order estimates follow from Chen-Cheng's frame …
New method bypasses assumptions for unbiased estimation of complex system interactions.
problem Inferring pair-wise and higher-order interactions from observational data.
method Cross-disciplinary approach using Targeted Learning for unbiased estimation.
result Universal estimator of all-order symmetric interactions without parametric assumptions.
The paper introduces a geometric flow for Lagrangian submanifolds that preserves Hamiltonian isotopy.
problem Finding stationary solutions for Hamiltonian stationary Lagrangian submanifolds.
method Introducing a geometric flow that is a gradient flow for volume and corresponds to a fourth order strictly parabolic scalar equation.
result Established short-time existence, uniqueness, and higher order estimates for compact initial Lagrangian immersions with uniformly bounded second fundamental forms.
We improve Gross-Wilson's local estimates to global ones. As an application, we study the blow-up limits of the degenerating Calabi-Yau metrics on singular fibers.
We define functionals generalising the Seiberg-Witten functional on closed spinc manifolds, involving higher order derivatives of the curvature form and spinor field. We then consider their associated gradient flows and, using a gauge fixing technique, are able to prove short time existence for the flows. We then pr…