Machine learning applied to algebraic geometry for physics problems.
problem Reformulating algebraic geometry problems as tensor mappings for machine learning.
method Supervised and unsupervised machine learning techniques applied to algebraic geometry problems.
result Machine learning provides insights into the structure of algebraic geometry data.
Paper introduces a generalized Bures-Wasserstein geometry for SPD matrices.
problem Understanding the geometry of SPD matrices for machine learning.
method Proposes a generalized Bures-Wasserstein geometry parameterized by a symmetric positive definite matrix.
result The GBW geometry outperforms the BW geometry in machine learning applications.
Deep learning models viewed through tame geometry for convergence guarantees.
problem Understanding convergence guarantees in deep learning models.
method Introducing tame geometry concepts and tools for nonsmooth nonconvex settings.
result Illustrates tame geometry as a natural framework for AI systems, especially deep learning.
Optimization geometry affects deep learning performance.
problem The impact of optimization geometry on deep learning performance.
method Analysis of pseudogradient methods for learning generalized linear models.
result Non-asymptotic bounds on generalization error characterize model performance.
In this paper, we evaluate the accuracy of deep learning approaches on geospatial vector geometry classification tasks. The purpose of this evaluation is to investigate the ability of deep learning models to learn from geometry coordinates directly. Previous machine learning research applied to geospatial polygon data …
We create real-time geodesic rendering for non-isotropic geometries.
problem Challenging visualization of non-isotropic geometries.
method Novel methods for real-time native geodesic rendering.
result Methods can be applied to visualization, machine learning, and video games.
Model financial dynamics using 2-manifold geometries, revealing the torus as best for cyclical data.
problem Financial forecasting using complex market data.
method Embedding market data onto 2-manifolds (S2, R2, H2, T) guided by uniformization theorem, inferring latent curvature.
result The torus geometry best predicts cyclical financial data, aligning with IS-LM theory.
ICLR 2021 challenge in computational geometry and topology attracted 16 teams.
problem Designing and evaluating computational methods in differential geometry and topology.
method Designing and hosting an open-source competition with repositories Geomstats and Giotto-TDA.
result 16 teams participated in the challenge, showcasing innovative contributions to computational geometry and topology.
This paper proposes a geometry-aware active learning framework for spatiotemporal dynamic systems.
problem Challenges in modeling complex dynamic systems with 3D geometries and time evolution.
method Geometry-aware spatiotemporal Gaussian Process (G-ST-GP) and adaptive active learning strategy.
result The proposed framework outperforms traditional methods in predicting high-dimensional dynamic behaviors.
Training shapes the geometry of neural network feature maps, revealing local area magnification.
problem Understanding how training affects the geometric structure of neural network feature maps.
method Analyzing the Riemannian geometry induced by neural network feature maps at infinite width and after training.
result Training breaks the symmetry of the geometry induced by random neural network feature maps, magnifying local areas along decision boundaries.
GAGA learns a warped metric for geometry-aware data generation and interpolation.
problem Challenges in generating data with meaningful geometry in high-dimensional datasets.
method Combines manifold learning with generative modeling to learn a warped Riemannian metric.
result GAGA improves trajectory inference by 30% in single-cell population-level data.
Paper explores Monge-Ampère in deep learning and quantum geometry.
problem Understanding the Monge-Ampère equation in deep learning.
method Review of Boltzmann learning, connection to optimal transport, insights from quantum geometry, renormalization group flow.
result Space of covariance matrices in learning dynamics coincides with the CAH cone.
A new learning method using hyperbolic geometry for class labels.
problem Class label representation and learning in machine learning.
method Hyperbolic Prototype Learning with a new loss function based on hyperbolic geometry.
result Hyperbolic Prototype Learning is equivalent to logistic regression in the one-dimensional case.
A new method integrates autoencoders with geometry regularization for manifold learning.
problem Extracting simplified low-dimensional representations that capture intrinsic geometry in data.
method Integrates autoencoders with a geometric regularization term based on diffusion potential distances.
result The method preserves intrinsic structure, enables out-of-sample extension, and faithful reconstruction.
Natural gradient simplification for deep learning networks.
problem Efficiency in training deep Bayesian networks.
method Analysis of two geometries of Fisher information matrix and development of a method to simplify natural gradient for the second geometry.
result A method to simplify natural gradient for deep networks using an auxiliary recognition model.
GNPs learn operators on non-Euclidean geometries using neural networks.
problem Learning operators on complex geometries like manifolds.
method Geometric Neural Operators (GNPs) that incorporate geometric properties.
result GNPs can estimate metrics, solve PDEs, and learn LB operators on manifolds.
GABI learns geometry from diverse systems to improve Bayesian inference.
problem Bayesian inversion of physical systems with varying geometries.
method Geometric Autoencoders for Bayesian Inversion (GABI) learns geometry-aware priors from large datasets.
result GABI yields comparable predictive accuracy to deterministic methods and well-calibrated uncertainty quantification.
QCML uses quantum geometry to represent data.
problem Data representation and the curse of dimensionality.
method QCML encodes data as Hermitian matrices in Hilbert space.
result Data geometry reveals intrinsic dimension and topological properties.
GeoFunFlow tackles inverse problems on complex geometries with efficient learning.
problem Challenges in inverse problems governed by PDEs, especially on irregular geometries.
method Combines geometric function autoencoder and latent diffusion model trained via rectified flow.
result Achieves state-of-the-art reconstruction accuracy and efficient inference.
New geometry for optimal transport cost based on Bregman divergences.
problem Optimal transport cost calculation with Bregman divergences.
method Established properties, defined interpolations, constructed dualistic geometry.
result Derived generalized Pythagorean inequality and Bregman-Wasserstein barycenters.
NLGS optimizes latent geometry for better model performance.
problem Improving machine learning model performance by aligning latent space geometry with data structure.
method NLGS uses product manifolds with Gromov-Hausdorff distance for latent geometry search.
result NLGS finds optimal latent geometry with query-efficient Bayesian optimization.
Riemannian metric matching learns the geometry of high-dimensional datasets using neural networks.
problem Estimating the geometry of high-dimensional datasets from samples
method Riemannian metric matching using neural networks
result Riemannian metric matching rivals or improves k-NN-based diffusion geometry estimators Improved random forest proximities capture data geometry.
problem Inaccurate random forest proximities do not reflect learned data geometry.
method Introduce RF-GAP: Geometry- and Accuracy-Preserving proximities.
result RF-GAP improves geometric representation in tasks like data imputation.
Unified framework for Riemannian deep learning across manifold-valued representations.
problem Deep learning on manifold-valued representations often relies on Euclidean approximations or costly geometric operations.
method Develops reusable neural modules, manifold-specific network architectures, and geometric designs.
result Generalizes batch normalization and multinomial logistic regression to broader classes of manifolds.
Unified framework for Riemannian deep learning across manifold-valued representations.
problem Deep learning on manifold-valued data lacks reusable modules, specific network architectures, and efficient geometric operations.
method Develops reusable neural modules, manifold-specific network architectures, and geometric designs for broad classes of Lie groups and gyrogroups.
result Generalizes batch normalization and multinomial logistic regression to Riemannian manifolds, including SPD and hyperbolic spaces.
Proposes a scalable framework for extracting data manifold geometry.
problem Efficiently mapping and learning data manifold geometry.
method Score-based pullback Riemannian geometry integrating pullback Riemannian geometry and generative models.
result High-quality geodesics and reliable intrinsic dimension estimation.
VB uses natural gradients in information geometry.
problem Estimating or computing natural gradients in VB.
method Natural-gradient descent algorithm and Bayesian Learning Rule.
result Simplification of Bayes' rule and generalization of quadratic surrogates.
New method improves counterfactual distribution learning for high-dimensional outcomes.
problem Counterfactual distribution learning for high-dimensional outcomes with concentrated structure.
method Geometry-adaptive diffusion-guided smoothing estimators combining causal nuisance adjustment and local outcome geometry.
result Geometry-adaptive methods show steeper error decay in semi-synthetic experiments.
The paper analyzes how noise geometry influences the performance of SGD in machine learning.
problem Understanding how noise geometry affects the performance of stochastic gradient descent.
method Developed two metrics to quantify noise alignment strength and analyzed their effects on loss and subspace projection dynamics.
result Noise geometry can be used to guarantee alignment under certain conditions, aiding SGD's ability to escape from sharp minima.
The paper explores deep learning through algebra and geometry, highlighting geometric structures and differential processes.
problem Understanding the geometric and algebraic foundations of deep learning.
method Investigates neural networks from perceptron to transformer, emphasizing geometric structures and differential processes.
result A coordinate-free formulation of backpropagation equations using canonical scalar products on matrix spaces.
MSA compares neural representations' intrinsic geometry for better understanding.
problem Existing similarity measures fail to capture subtle distinctions between neural network solutions.
method Metric similarity analysis (MSA) using Riemannian geometry.
result MSA can disentangle features of neural computations and compare nonlinear dynamics.
Neural networks learn discrete tasks on continuous data via emergent geometry.
problem Understanding how neural networks perform discrete computations on continuous data.
method Analysis of Riemannian pullback metric across neural network layers.
result Neural networks learn to discretize continuous inputs and perform logical operations on these discretized variables.
Mathematical framework using Riemannian geometry for intelligence and consciousness.
problem Lack of a unified mathematical framework for intelligence and consciousness.
method Conceptualizes intelligence as tokens in a high-dimensional space, using Riemannian geometry to describe structure and dynamics.
result Integrates geometric concepts to offer a unified framework for intelligence and consciousness.
Riemannian metric learning improves data representation across various fields.
problem Traditional distance metrics fail to capture intrinsic data geometry.
method Leverages differential geometry to model data on Riemannian manifolds.
result Demonstrates remarkable success in diverse domains.
This work improves manifold learning for multi-modal data.
problem Distortions and modeling errors in multi-modal data.
method Isometrizing learned Riemannian structure and balancing regularity and expressivity.
result The synergy of proposed approaches enhances manifold learning.
Why and how that deep learning works well on different tasks remains a mystery from a theoretical perspective. In this paper we draw a geometric picture of the deep learning system by finding its analogies with two existing geometric structures, the geometry of quantum computations and the geometry of the diffeomorphic…
This work develops methods to analyze data on curved spaces using deep learning.
problem Analyzing data in non-linear, curved spaces.
method Pullback Riemannian geometry through diffeomorphisms.
result Diffeomorphisms need to map data into geodesic subspaces to ensure proper data analysis.
New methods estimate curvature, tangent spaces, and dimension of noisy data.
problem Estimating geometric properties of noisy or sparse data.
method Diffusion geometry tools for Riemannian manifold analysis.
result Significantly outperforms existing methods in noisy or sparse data.
Geometry-aware models improve cross-subject EEG decoding accuracy.
problem Strong inter-subject variability in motor imagery decoding.
method Discriminative Congruence Transform (DCT), Deep Linear DCT (DLDCT), Deep DCT-UNet (DDCT-UNet).
result Improves transductive cross-subject accuracy by 2-3%.
Neural Spacetimes learn DAGs by embedding nodes in a spacetime manifold.
problem Learning representations of weighted directed acyclic graphs (DAGs).
method Trainable deep learning-based geometries (Neural Spacetimes) that encode both edge weights and causality.
result Universal embedding theorem for DAGs with sub-cubic parameters and low distortion.
PFM generates novel samples on data manifolds using pullback geometry.
problem Generating novel samples on complex data manifolds.
method Pullback Flow Matching framework leveraging pullback geometry and isometric learning.
result PFM achieves improved manifold learning and generative performance.
Neural networks' feature geometry evolves like discrete Ricci flow.
problem Understanding neural feature representations and their geometric transformations.
method Approximating input manifold with geometric graphs and analyzing their evolution during training.
result Neural feature geometry evolves like discrete Ricci flow, with nonlinear activations playing a crucial role.
Paper combines geometry and time-series analysis for spatiotemporal data.
problem Multivariate time-series data from multiple sensors.
method Combines manifold learning, Riemannian geometry, and spectral analysis.
result Proposes Riemannian multi-resolution analysis (RMRA) for dynamic mode extraction.
GeoERM learns shared representations on Riemannian manifolds for multi-task learning.
problem Heterogeneous and adversarial tasks in MTL.
method Geometry-aware MTL framework embedding shared representation on Riemannian manifold, optimizing via manifold operations.
result GeoERM improves estimation accuracy and stability, outperforming alternatives.
IsUMap improves data visualization of complex geometries.
problem Accurately representing complex, locally distorted metric spaces.
method Integrates UMAP and Isomap with Vietoris-Rips filtrations.
result Significant improvements in data representation quality.
New method learns shape correspondences robustly from raw geometry.
problem Inaccurate and poor generalization of shape correspondences.
method Learning-based approach with feature-extraction network and functional map representation.
result Robust and accurate shape correspondence learning with less training data.
Develops Riemannian geometry for optimization on manifolds with detailed derivations.
problem Abstract high-level optimization on nonlinear spaces like matrix manifolds.
method Systematic derivation of geometric structures and constructions in coordinates and matrix form.
result Unified treatment of Riemannian geometry for optimization on manifolds.
A new method learns manifold-valued latents without an encoder.
problem Distorting data with intrinsic non-Euclidean structure.
method Riemannian generative decoder that learns latents directly.
result Learned representations respect the prescribed geometry and capture intrinsic non-Euclidean structure.