HONEM learns embeddings for higher-order networks, improving performance in various tasks.
problem Existing methods fail to capture non-Markovian higher-order dependencies in networks.
method HONEM is a higher-order network embedding method designed for HON, capturing non-Markovian dependencies.
result HONEM outperforms other methods in node classification, network reconstruction, link prediction, and visualization.
New method for estimating higher-order network dependencies in streaming data.
problem Estimating higher-order dependencies in massive, dynamic, and streaming networks.
method Adaptive sampling and unbiased estimators for streaming networks, with a James-Stein shrinkage estimator.
result Our approach outperforms baseline methods in estimating higher-order network structure from streaming data.
Paper examines risk measure expansions under FGM dependence, improving accuracy at extreme levels.
problem Capturing higher-order tail behavior and dependence effects in risk measures.
method Second-order asymptotic expansions using extreme value theory and regular variation theory.
result Second-order approximations reduce approximation errors, especially at extreme confidence levels.
Develops a novel fast bootstrap for dependent data with higher-order accuracy.
problem Estimation of parametric and semi-parametric models for dependent data.
method i.i.d. resampling of smoothed moment indicators, asymptotic refinements under mild assumptions.
result Higher-order correct asymptotic confidence distributions and confidence intervals.
State-of-the-art methods in convex and non-convex optimization employ higher-order derivative information, either implicitly or explicitly. We explore the limitations of higher-order optimization and prove that even for convex optimization, a polynomial dependence on the approximation guarantee and higher-order smoothn…
We formulate higher order variations of a Lagrangian in the geometric framework of jet prolongations of fibered manifolds. Our formalism applies to Lagrangians which depend on an arbitrary number of independent and dependent variables, together with higher order derivatives. In particular, we show that the second varia…
FGNN generalizes graph neural networks to capture higher-order dependencies.
problem Capturing higher-order dependencies in graph-structured data.
method Introducing a factor graph neural network (FGNN) that can represent Max-Product Belief Propagation.
result FGNN effectively represents Max-Product Belief Propagation and performs well on both synthetic and real datasets.
Paper proposes a new method to identify causal graphs with latent variables using higher-order cumulants.
problem Estimating causal directed acyclic graphs with latent confounders.
method Uses higher-order cumulants to identify causal structures among observed and latent variables.
result Validates the proposed algorithm through simulations and real-world data.
The paper examines higher moments in insurance, focusing on coskewness and its impact on actuarial quantities.
problem The impact of higher-order moments on actuarial applications, particularly expected shortfall and life annuity valuation.
method Derives analytical bounds for mixed moments under unspecified dependence structure, applies copula-based mixture model.
result Coskewness and odd-order mixed moments exhibit a monotonic relationship with expected shortfall and annuity premiums.
We generalize the Lagrangian-Hamiltonian formalism of Skinner and Rusk to higher order field theories on fiber bundles. As a byproduct we solve the long standing problem of defining, in a coordinate free manner, a Hamiltonian formalism for higher order Lagrangian field theories. Namely, our formalism does only depend o…
We extend the geometric Hamilton-Jacobi formalism for hamiltonian mechanics to higher order field theories with regular lagrangian density. We also investigate the dependence of the formalism on the lagrangian density in the class of those yelding the same Euler-Lagrange equations.
CSD improves goodness-of-fit testing for higher-order dependence.
problem Insensitivity of standard KSDs to higher-order dependence features like tail dependence.
method Introduces Copula-Stein Discrepancy (CSD) that targets dependence geometry directly on copula density.
result CSD is sensitive to differences in tail dependence coefficients and metrizes weak convergence of copula distributions.
Dynamic Vine Copulas detect and quantify time-varying higher-order interactions in multivariate systems.
problem Time-varying dependence in multivariate systems, including tail behavior, asymmetry, and conditional structure.
method Dynamic Vine Copulas (DVC) framework for estimating and diagnosing non-Gaussian dependence, using fixed-root-order C-vines and smooth parameter trajectories.
result DVC detects and quantifies time-varying higher-order interactions, distinguishing between pairwise and conditional dependence.
Generalizes holographic method to higher codimension submanifolds.
problem Extract higher-order local invariants of embeddings.
method Natural generalization of holographic method to higher codimension submanifolds.
result New invariants obstructing the order-by-order construction of unit defining maps.
The geometrical theory of partial differential equations in the absolute sense, without any additional structures, is developed. In particular the symmetries need not preserve the hierarchy of independent and dependent variables. The order of derivatives can be changed and the article is devoted to the higher--order in…
Biological neurons learn tensor decompositions of higher-order correlations using nonlinear Hebbian plasticity.
problem Learning higher-order correlations in biological neurons.
method Introduce and study generalized nonlinear Hebbian learning rules.
result Neurons can learn tensor eigenvectors of higher-order input correlation tensors.
Expands differential geometry to higher-order infinitesimals.
problem No specific problem stated; general expansion of differential geometry.
method Introduces higher tangent vectors and jet connections, generalizes Riemannian metric tensor, develops higher-order integration theory.
result Natural analogues of Riemannian curvature tensor with novel phenomena.
The paper constructs denoisers that recover the Brenier map from higher-order score functions.
problem Estimating the Brenier map from noisy data.
method Constructs a hierarchy of denoisers using higher-order score functions.
result The T∞ denoiser recovers the Brenier map from the additive Gaussian model. Users form information trails as they browse the web, checkin with a geolocation, rate items, or consume media. A common problem is to predict what a user might do next for the purposes of guidance, recommendation, or prefetching. First-order and higher-order Markov chains have been widely used methods to study such se…
We consider higher-order linear-chain conditional random fields (HO-LC-CRFs) for sequence modelling, and use sum-product networks (SPNs) for representing higher-order input- and output-dependent factors. SPNs are a recently introduced class of deep models for which exact and efficient inference can be performed. By com…
PAGTN improves molecular property prediction by leveraging longer-range graph dependencies.
problem Local aggregation in GCNs misses higher-order graph properties.
method PAGTN uses path features and global attention layers to capture longer-range dependencies.
result PAGTN outperforms GCNs on various molecular property prediction datasets.
The paper defines and analyzes higher-order Yang-Mills-Higgs functionals and their gradient flows.
problem Analyzing the behavior of higher-order Yang-Mills-Higgs functionals and their gradient flows.
method Gauge fixing technique, L2-bound of the Higgs field, local L2-derivative estimates, energy estimates, blow-up analysis. result Solutions to the gradient flow do not hit finite time singularities under certain conditions.
We study underlying geometric structures for integral variational functionals, depending on submanifolds of a given manifold. Applications include (first order) variational functionals of Finsler and areal geometries with integrand the Hilbert 1-form, and admit immediate extensions to higher-order functionals.
In this article, we consider a 2 factors-model for pricing defaultable bond with discrete default intensity and barrier where the 2 factors are stochastic risk free short rate process and firm value process. We assume that the default event occurs in an expected manner when the firm value reaches a given default barrie…
This work learns models for population dynamics using variational methods and higher-order quadrature.
problem Modeling population dynamics of physical systems with stochastic and mean-field effects.
method Variational problem to infer gradient fields, combining Monte Carlo sampling with higher-order quadrature rules.
result Accurate prediction of population dynamics over a wide range of parameters.
We find a remarkable subalgebra of higher symmetries of the elliptic Euler-Darboux equation. To this aim we map such equation into its hyperbolic analogue already studied by Shemarulin. Taking into consideration how symmetries and recursion operators transform by this complex contact transformation, we explicitly give …
Study quantifies how LLMs capture higher-order statistical structure using cumulant expansion.
problem Understanding how LLMs internalize statistical structure during next-token prediction.
method Cumulant-expansion framework treating softmax entropy as perturbation around center distribution.
result Cumulants reveal distinct signatures for mathematical vs. general text prompts, quantifying feature-learning dynamics.
Paper proves higher-order flow matching preserves optimality in generative modeling.
problem Theoretical guarantees for higher-order flow matching in generative modeling.
method Neural network approximations with controlled depth, width, and sparsity.
result Proves worst case optimality for second-order flow matching.
New method identifies latent variables with causal dependencies from observed data.
problem Identify latent variables with causal relationships from observed data.
method Linear causal disentanglement via higher-order cumulants, with perfect and soft interventions.
result Recovery of parameters via coupled tensor decomposition and polynomial equations.
Gradients are natural first order differential operators depending on Riemannian metrics. The principal symbols of them are related to the enveloping algebra and higher Casimir elements. We give certain relations in the enveloping algebra, which induce not only identities for higher Casimir elements but also all Bochne…
A new method for approximating CV and bootstrap with higher-order infinitesimal jackknife.
problem Efficiently approximating cross-validation and bootstrap methods for machine learning.
method Higher-order infinitesimal jackknife (HOIJ) using Taylor series approximations and automatic differentiation.
result HOIJ provides higher-order accuracy and can be computed efficiently even in high dimensions.
We propose parametric copulas that capture serial dependence in stationary heteroskedastic time series. We develop our copula for first order Markov series, and extend it to higher orders and multivariate series. We derive the copula of a volatility proxy, based on which we propose new measures of volatility dependence…
The reduction theorems for general linear and classical connections are generalized for operators with values in higher order gauge-natural bundles. We prove that natural operators depending on the s1-jets of classical connections, on the s2-jets of general linear connections and on the r-jets of tensor fields …
Higher-order motif structures and multi-vertex interactions are becoming increasingly important in studies that aim to improve our understanding of functionalities and evolution patterns of networks. To elucidate the role of higher-order structures in community detection problems over complex networks, we introduce the…
Paper introduces models to discover complex structures in large hypergraphs.
problem Understanding dependency structures in complex systems represented as hypergraphs.
method Probabilistic models treating classes of similar units as nodes in a latent hypergraph, using low-rank representations.
result Improves link prediction and discovers interpretable structures in diverse real-world systems.
Quantization techniques have been applied in many challenging finance applications, including pricing claims with path dependence and early exercise features, stochastic optimal control, filtering problems and efficient calibration of large derivative books. Recursive Marginal Quantization of the Euler scheme has recen…
Hypergraphs are used in machine learning to model higher-order relationships in data. While spectral methods for graphs are well-established, spectral theory for hypergraphs remains an active area of research. In this paper, we use random walks to develop a spectral theory for hypergraphs with edge-dependent vertex wei…
Improved estimation of higher order integrals using shrinkage techniques.
problem Estimating higher order Bochner integrals in non-parametric settings.
method Shrinkage of U-statistic towards a target element, considering kernel degeneracy.
result Consistent shrinkage estimators with fast rates of convergence, even for non-degenerate kernels.
Bayesian method detects mesoscale structures in pathway data networks.
problem Mesoscale structures in pathway data networks are hard to detect due to dependencies between interactions.
method Bayesian approach modeling optimal partitioning and higher-order dynamics.
result Method can recover both proximity-based and role-based groupings of nodes.
SpeqNets improve graph neural networks by scaling and adapting to graph sparsity.
problem Graph neural networks struggle with permutation-equivariant functions and scalability to large graphs.
method Introducing sparsity-aware, permutation-equivariant graph networks with heuristics for graph isomorphism.
result Significantly improved predictive performance and reduced computation times compared to existing methods.
SurvFD and SurvSHAP-IQ provide interpretable survival models by analyzing feature interactions.
problem Non-additivity of hazard and survival functions limits standard additive explanation methods.
method SurvFD decomposes higher-order effects into time-dependent and time-independent components, extending Shapley interactions to time-indexed functions.
result SurvFD and SurvSHAP-IQ offer a new perspective on survival explanations, explicitly characterizing feature interactions.
Study higher-order spin glass models for social network behavior with peer-group effects.
problem Modeling correlation phenomena on social networks with peer-group effects.
method Inference in higher-order Ising models to recover coefficients and peer-group effects.
result Strong concavity of log pseudo-likelihood implies statistical error rate of sqrt(d/n) for MPLE.
This paper examines how Higher-Order Langevin Dynamics reduces memorization in diffusion models.
problem Memorization of training samples in diffusion models, violating copyright and privacy.
method Introduces Higher-Order Langevin Dynamics (HOLD) to regularize diffusion model trajectories.
result The dynamics of the data variable in HOLD are governed by a low-pass-filtered version of the learned score function, with smoothness increasing with model order.
Paper proposes a new tensor model for mixed memberships and provides error bounds.
problem Estimating mixed memberships in higher-order multiway data.
method Tensor mixed-membership blockmodel, higher-order orthogonal iteration algorithm (HOOI), simplex corner-finding algorithm.
result Consistency of estimation procedure with error bounds under specific conditions.
The paper introduces new KMEs to capture stochastic process filtrations.
problem Missing filtration information in stochastic processes.
method Higher order kernel mean embeddings (KMEs) conditioned on filtrations.
result Consistent estimators and tests for filtration-sensitive information.
Paper introduces techniques to learn higher-order programs, improving predictive accuracy and reducing learning times.
problem Expressing and learning complex programs in ILP.
method Extending meta-interpretive learning to support higher-order definitions as background knowledge.
result Learning higher-order programs reduces hypothesis space and sample complexity, improving predictive accuracy and reducing learning times.
Deterministic bounds for tensor singular values and vectors, differing from matrix cases.
problem Spectral learning of higher-order orthogonally decomposable tensors.
method Deterministic perturbation bounds for singular values and vectors of orthogonally decomposable tensors.
result Perturbation affects each essential singular value/vector in isolation, independent of multiplicity and distance from other singular values.
We propose new positive definite kernels for permutations. First we introduce a weighted version of the Kendall kernel, which allows to weight unequally the contributions of different item pairs in the permutations depending on their ranks. Like the Kendall kernel, we show that the weighted version is invariant to rela…