We describe and extract time-ordered multibody interactions from complex systems.
problem Complex systems with temporal and multibody dependencies.
method Decompose multivariate Markov chains into time-ordered multibody interactions. Algorithm to extract interactions from data. Measure complexity of interaction ensembles.
result Robust and efficient algorithm to infer time-ordered multibody interactions from data.
Mixes higher-order simplicial complexes for data augmentation.
problem Lack of labeled data for complex systems with multiway interactions.
method Proposes mixup mechanisms for simplicial complexes, including linear and nonlinear mixup, and a convex clustering mixup.
result Synthetic simplicial complexes interpolate between existing data based on homomorphism densities.
The study examines higher-order modern portfolio theory with complex critical points and feasible portfolio variety.
problem Understanding the complex critical points and feasible portfolio variety in higher-order modern portfolio theory.
method Established genericity conditions for utility functions with higher-order cumulants, analyzed discriminant loci, and determined the dimension and degree of the feasible portfolio variety.
result The utility function has a constant number of complex critical points under genericity conditions, and the feasible portfolio variety has a determined dimension and degree.
Calculates knot X-torsion order using spectral sequences.
problem Calculating the X-torsion order of knots. method Using the reduced Bar-Natan--Lee--Turner spectral sequence.
result Example of X-torsion order 4. Paper derives estimates for complex Hessian equations on Hermitian manifolds.
problem Estimating solutions to complex Hessian equations on Hermitian manifolds.
method Derives second order estimates for solutions in a specific cone.
result Establishes second order estimates for solutions in Γk+1 cone. Paper develops a TR-SSQP method for noisy optimization with heavy-tailed noise.
problem Optimization problems with stochastic objectives and heavy-tailed noise.
method Trust-Region Stochastic Sequential Quadratic Programming (TR-SSQP) method.
result Achieves high-probability first-order and second-order stationarity bounds for heavy-tailed noise.
We define an order relation among oriented PD4-complexes. We show that with respect to this relation, two PD4-complexes over the same complex are homotopy equivalent if and only if there is an isometry between the second homology groups. We also consider minimal objects of this relation.
Study on automorphisms of complex bk-manifolds, extending previous work.
problem Investigate automorphisms of complex bk-manifolds with higher-order degeneracies. method Extend Mendoza's definition of complex b-manifolds to complex bk-manifolds and study their local and global automorphisms. result Propose bk-analogues for classical spaces of holomorphic functions. New method for identifying best designs in vector optimization with uncertain feedback.
problem Optimizing vector-valued outcomes with uncertain preferences.
method Stochastic bandit feedback, polyhedral ordering cone, (ε,δ)-PAC Pareto set identification. result Sample complexity characterized and matched by the naïve elimination algorithm.
The paper introduces new boundary operators and proves higher order CR Sobolev trace inequalities for Siegel domain and complex ball.
problem Establishing higher order CR Sobolev trace inequalities for Siegel domain and complex ball.
method Introducing conformally covariant boundary operators, proving extension theorems, and establishing trace inequalities.
result Generalized CR Sobolev trace inequalities for all γ ∈ (0, n+1) \mathbb{N}.
With higher-order neighborhood information of graph network, the accuracy of graph representation learning classification can be significantly improved. However, the current higher order graph convolutional network has a large number of parameters and high computational complexity. Therefore, we propose a Hybrid Lower …
A fundamental property of complex networks is the tendency for edges to cluster. The extent of the clustering is typically quantified by the clustering coefficient, which is the probability that a length-2 path is closed, i.e., induces a triangle in the network. However, higher-order cliques beyond triangles are crucia…
Diffusion models learn simple statistics before complex ones, revealing a sample complexity exponent.
problem Understanding the learning dynamics of diffusion models.
method Empirical observations and theoretical analysis of diffusion models and denoisers.
result Diffusion models learn simple statistics (pair-wise correlations) at linear sample complexity, while higher-order statistics (e.g., fourth cumulant) require cubic sample complexity.
Tutorials on signal processing on higher-order networks like simplicial complexes and hypergraphs.
problem Processing complex data structures with polyadic relationships.
method Introduction to simplicial complexes and hypergraphs, Fourier analysis, signal denoising, interpolation, embeddings, neural networks.
result Multi-relational operators like the Hodge Laplacian for simplicial complexes and tensor representations for hypergraphs.
Improved algorithms for convex-concave min-max optimization and monotone variational inequalities.
problem Efficiently solving constrained convex-concave min-max problems and monotone variational inequalities.
method Higher-order methods achieving iteration complexities of O(1/T^{ rac{p+1}{2}}) for p-th order derivatives.
result Achieved improved convergence rates for min-max and monotone variational inequalities.
A new hybrid-ordered SGD method reduces communication and complexity for non-convex optimization.
problem Balancing communication, computational complexity, and convergence rate in distributed non-convex optimization.
method Hybrid-ordered distributed SGD with pre-shared scalers and periodic vector communication.
result Order-wise faster convergence compared to existing methods.
New methods solve optimization problems with heavy-tailed noise, improving upon existing complexity bounds.
problem Optimization problems with heavy-tailed noise and weakly average smoothness.
method Normalized stochastic first-order methods with Polyak, multi-extrapolated, and recursive momentum.
result First-order oracle complexity results for finding approximate stochastic stationary points under heavy-tailed noise.
Study on higher order Levi forms on homogeneous CR manifolds, improving previous results.
problem Investigating nondegeneracy of higher order Levi forms on weakly nondegenerate homogeneous CR manifolds.
method Improving previous results by proving order constraints for real forms in complex flag manifolds and constructing CR vector bundles with arbitrary orders of nondegeneracy.
result General orbits of real forms in complex flag manifolds have order less or equal 3 and compact ones less or equal 2.
Classifies complex Dirac structures with invariants and local structure.
problem Classifying complex Dirac structures.
method Introducing invariants (order, type), proving existence and splitting theorems.
result Pointwise classification and local structure of complex Dirac structures.
The study sets limits on the complexity of Klein geometries.
problem Understanding the complexity of Klein geometries.
method Simple upper and lower bounds for the order of Klein geometries.
result Established upper and lower bounds for the order of Klein geometries.
We give different proofs and prove new results on the non complete solvability of some systems of complex first order p.d.e.'s, especially related to the analysis on CR manifolds.
Optimized variable orderings improve autoregressive model performance.
problem Challenges in variable ordering affect autoregressive model efficiency.
method Learn graphical model structure to inform optimal variable orderings.
result Graph-informed orderings yield higher-fidelity samples.
SGD's performance improves with critical batch size, minimizing SFO complexity.
problem Optimizing SGD's performance with batch size and learning rate.
method Analysis of SGD using constant and decaying learning rates, focusing on batch size effects.
result SGD with critical batch size minimizes SFO complexity.
A new method for state estimation on complex networks.
problem Reconstructing latent dynamics from multivariate time-series on topological cell complexes.
method Topology-aware state space framework derived from stochastic partial differential equations, with state evolution following heat-like topological diffusion.
result The proposed method successfully recovers latent states and topological structures in real-world networks.
Study develops advanced models to forecast complex LOB data.
problem Forecasting high-frequency data in a limit order book (LOB).
method Advanced multidimensional sequence-to-sequence models with compound multivariate embedding.
result Method outperforms other multivariate forecasting methods, achieving lowest forecasting error.
Paper improves stochastic bilevel optimization methods for highly-smooth problems.
problem Finding ε-stationary points in stochastic bilevel optimization. method Proposes F2SA-p methods using pth-order finite differences for hyper-gradient approximation. result Achieves upper complexity bound of ildeO(pε−4−p/2) for pth-order smooth problems. Optimal algorithms for Riemannian optimization with reduced complexity.
problem Stochastic optimization on Riemannian manifolds with limited data.
method Zeroth-order Riemannian Averaging Stochastic Approximation algorithms using Riemannian moving-average estimators and novel geometric conditions.
result Achieves optimal sample complexities for generating approximate first-order stationary solutions.
The paper studies lifts of complex structures on a manifold.
problem Understanding higher-order lifts of extended almost complex structures.
method Proved theorems on Nijenhuis tensor and introduced a new tensor field.
result Basic results on almost analytic complex vectors are investigated.
Paper proposes a method to find approximate SOSP for nonconvex conic optimization problems.
problem Finding approximate second-order stationary points in nonconvex conic optimization.
method Newton-CG based barrier method with complexity guarantees.
result Achieves iteration complexity of O(ε^(-3/2)) for finding (ε,√ε)-SOSP.
New method finds stationary points in bilevel optimization problems.
problem Solving nonconvex-strongly-convex bilevel optimization problems.
method Restarted Accelerated HyperGradient Descent (RAHGD) method.
result Achieves best-known theoretical guarantees for finding stationary points in bilevel optimization.
The genus of knots is a one of the fundamental invariant and can be seen as a complexity of knots. In this paper, we give a lower bound of genus using Dehornoy floor, which is a measure of complexity of braids in terms of braid ordering.
We consider two types of minimal Poincaré 4-complexes. One is defined with respect to the degree 1-map order. This idea was already present in our previous papers, and more systematically studied later by Hillman. The second type of minimal Poincaré 4-complexes were introduced by Hambleton, Kreck and Teichner. It…
A new method solves a complex optimization problem efficiently.
problem Nonconvex-strongly-concave constrained minimax optimization.
method First-order augmented Lagrangian method with a first-order subproblem solver.
result Achieves improved operation complexity for finding solutions.
Zeroth-order optimization is an important research topic in machine learning. In recent years, it has become a key tool in black-box adversarial attack to neural network based image classifiers. However, existing zeroth-order optimization algorithms rarely extract second-order information of the model function. In this…
Zeroth-order (a.k.a, derivative-free) methods are a class of effective optimization methods for solving complex machine learning problems, where gradients of the objective functions are not available or computationally prohibitive. Recently, although many zeroth-order methods have been developed, these approaches still…
As in [5], we study holomorphic maps of positive degree between compact complex manifolds, and prove that any holomorphic map of degree one from a compact complex manifold to itself is biholomorphic. This conclusion confirms that under a mild restriction the holomorphic Gromov relation ">_" is indeed a partial order.
Paper transforms a complex equation into simpler forms for analysis.
problem Analyzing a fourth-order dispersive flow equation on Kähler manifolds.
method Developed the generalized Hasimoto transformation to simplify the equation.
result Explicit expressions derived for three examples of compact Kähler manifolds.
This article presents the further steps of the previously done studies taking into consideration the k-th order extensions of a complex manifold. In the previous studies higher order vertical and complete lifts of structures on the complex manifold were introduced. Presently, k-th extended spaces of a product manifold …
A new method solves complex constrained minimax problems.
problem Solving constrained minimax optimization problems.
method First-order augmented Lagrangian method.
result Established an operation complexity of O(ε−4logε−1). New neural networks model complex phenomena with fewer parameters.
problem Challenges in studying higher-order interactions in neural networks.
method Introducing curved neural networks using the maximum entropy principle.
result Curved neural networks accelerate memory retrieval and exhibit explosive phase transitions.
Comprehending complex systems by simplifying and highlighting important dynamical patterns requires modeling and mapping higher-order network flows. However, complex systems come in many forms and demand a range of representations, including memory and multilayer networks, which in turn call for versatile community-det…
New theorem links tropical phased matroids to higher-dimensional spheres.
problem Understanding topological properties of tropical phased matroids.
method Proving homeomorphism between topological order complex and a sphere.
result Topological order complex of tropical phased matroids is a (2n−3)-sphere. Novel methods for accelerating optimization in complex bilevel and minimax problems.
problem Optimization challenges in bilevel and minimax problems, especially when strong convexity assumptions are not met.
method Accelerated fully first-order methods for Bilevel Optimization (BLO) and Minimax Optimization (NCSC).
result State-of-the-art complexity for finding approximate second-order stationary points in BLO and NCSC.
New algorithm reduces sample and communication complexities in federated Q-learning.
problem Optimal Q-function learning in federated Q-learning with limited communication.
method Introduced Fed-DVR-Q algorithm for order-optimal sample and communication complexities.
result Complete characterization of sample-communication complexity trade-off.
A new method predicts higher-order interactions in evolving graphs using simplicial complexes.
problem Predicting higher-order interactions in dynamic graphs with theoretical guarantees.
method Capturing higher-order interactions as simplices, modeling neighborhoods with face-vectors, and developing a nonparametric kernel estimator.
result Our method outperforms existing higher-order prediction methods and is theoretically consistent.
A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher…
We note that known methods achieving the optimal oracle complexity for first order convex optimization require quadratic memory, and ask whether this is necessary, and more broadly seek to characterize the minimax number of first order queries required to optimize a convex Lipschitz function subject to a memory constra…
This paper simplifies computing higher-order U-statistics efficiently.
problem The inefficiency of computing higher-order U-statistics in practice. method Decomposition, connection to Einstein summation, and treewidth-based complexity estimate.
result A new, more efficient algorithm to compute U-statistics.