New geometric analysis shows L2 score error is flawed for diffusion models.
problem Score matching errors in diffusion models do not fully capture distributional quality.
method Decomposed score errors into gradient and solenoidal components, focusing on gradient's role in Fokker-Planck dynamics.
result Only gradient component affects marginal distributional quality; solenoidal component is structurally invisible.
Score matching errors are not sufficient for measuring diffusion model quality.
problem The L2 score matching error is not a reliable measure of diffusion model performance. method Decomposed score errors into gradient and solenoidal components and analyzed their geometric properties.
result Only the gradient component of the score error affects the marginal distributional quality.
Robust score matching improves parameter estimation in contaminated data.
problem Parameter estimation in data contaminated by outliers.
method Geometric median of means to develop a robust score matching procedure.
result Consistent parameter estimates in contaminated data settings.
Researchers use LLMs to judge other LLMs, but this study provides a new geometric perspective to understand when it works.
problem The challenge of evaluating LLMs using other LLMs as judges, considering both aleatoric and epistemic uncertainties.
method A geometric perspective on ranking LLM candidates using probability simplices, analyzing conditions for identifiable rankings and designing Bayesian priors.
result Geometric analysis reveals that rankings based on LLM judges are robust in many but not all datasets, emphasizing the importance of modeling epistemic uncertainty.
New analysis shows scores learn data manifolds better than distributions.
problem Learning the full distribution vs. just the data manifold.
method Novel analysis of scores in the small-σ regime.
result Scores learn data manifold information Θ(σ−2) stronger than distribution information. In this work, we addressed the issue of combining linear classifiers using their score functions. The value of the scoring function depends on the distance from the decision boundary. Two score functions have been tested and four different combination strategies were investigated. During the experimental study, the pro…
This work extends Tweedie's formulae to non-Gaussian processes for better diffusion model generation.
problem Limited exploration of non-Gaussian diffusion models and corresponding Tweedie's formulae.
method Extended Tweedie's formulae to geometric Brownian motion, squared Bessel, and Cox-Ingersoll-Ross processes.
result Demonstrated potential of non-Gaussian models in image and financial time series generation.
Decision trees and shallow neural networks have different geometric complexities, impacting their interpretability and accuracy.
problem The geometric simplicity of decision boundaries in decision trees conflicts with the approximation capabilities of shallow neural networks.
method Analysis of the Radon total variation (RTV) seminorm to compare geometric complexity of decision regions and neural network approximations.
result Smooth barrier scores can approximate decision regions with finite RTV, but their performance depends on the tube-mass condition near the decision boundary.
This paper improves diffusion models for low-dimensional data.
problem Theoretical foundations of diffusion models are lacking for low-dimensional data.
method Score approximation, estimation, and distribution recovery of diffusion models on low-dimensional data.
result Sample complexity bounds for distribution estimation using diffusion models are provided.
A new kernel-based nonconformity score improves multivariate prediction regions.
problem Tackling the challenge of compressing multivariate residual vectors into scalars while preserving geometric structure.
method Introducing a Multivariate Kernel Score (MKS) that decomposes into an anisotropic MMD, providing finite-sample coverage guarantees and convergence rates.
result The MKS produces prediction regions that explicitly adapt to geometric structure, reducing volume compared to ellipsoidal baselines.
Develops geometric framework for uncertainty-aware multi-class classification.
problem Silent failure of AI models when uncertain, especially in multi-class settings.
method Geometric framework treating probability vectors as points on the (c−1)-dimensional probability simplex, using Fisher--Rao metric for calibration and uncertainty quantification. result Empirical validation shows 72.5% of errors captured while deferring 34.5% of ambiguous predictions, reducing automated decision error rates from 16.8% to 6.9%.
Develops a local Fokker--Planck geometric framework for more accurate score estimation.
problem Inaccurate estimation of score function in non-linear, state-dependent drifts.
method Local Fokker--Planck geometric framework, time change to cumulative-variance coordinate, heat-ball mean-value representations, exact high-dimensional sampling.
result Exact local mean-value representations for the score and density, improved accuracy in low-density regions.
TopoGeoScore selects robust checkpoints using only source-domain representations.
problem Selecting robust checkpoints without target-domain labels or samples.
method Constructs class-conditional mutual k-nearest-neighbour graphs and extracts three interpretable signals.
result Source representations contain measurable global-local-topological evidence of robustness.
The paper analyzes elicitability of return risk measures and their scoring functions.
problem Elicitability of return risk measures and their scoring functions.
method Dual representation results for convex and geometrically convex return risk measures, axiomatic characterizations of Orlicz premia, and construction of strictly consistent scoring functions.
result Orlicz premia are the only elicitable return risk measures under different sets of conditions.
New approach to control diffusion processes with soft constraints.
problem Finding an optimal diffusion process with a target terminal distribution.
method Generalized Schrödinger bridge problem with soft constraints, solving for a geometric mixture of target and other distributions.
result The terminal distribution of the optimally controlled process is a geometric mixture of the target and another distribution.
A robust conformal method for set estimation using non-conformity scores.
problem Lack of robustness in standard conformal prediction methods for outliers or heavy tails.
method Robust conformal method based on non-conformity score defined as half-mass radius.
result Empirical conformal regions converge to robust population central set.
Study reveals LLM personas have two distinct components: frame-robust aggregated traits and frame-dependent geometric features.
problem Evaluation of LLM personas via psychometric questionnaires discards within-instance correlation structure.
method Constructed within-instance correlation matrices from IPIP-50 responses and analyzed geometry on SPD manifolds under manipulated question orderings.
result Persona expression comprises two dissociable components: aggregated features (Big Five scores) and geometric features (SPD manifold).
A novel score-based method solves high-dimensional Fokker-Planck equations with improved accuracy and speed.
problem High-dimensional Fokker-Planck equations suffer from the curse of dimensionality, leading to numerical errors and slow sampling.
method Score-based Physics-Informed Neural Networks (PINNs) that fit the score function in SDEs, using three methods: Score Matching, Sliced Score Matching, and Score-PINN.
result The score-based method outperforms traditional Monte Carlo and vanilla PINNs in high-dimensional settings, offering faster sampling and reduced errors.
Proposes a new method to minimize non-singleton predictions in conformal prediction.
problem Large prediction sets in conformal prediction are costly and inefficient.
method Introduces a new nonconformity score to minimize non-singleton sets and provides an algorithm to compute it efficiently.
result The proposed Singleton-Optimized Conformal Prediction (SOCOP) method increases singleton frequency by over 20% compared to standard scores, with minimal impact on average set size.
Diffusion models adapt to data geometry through log-domain smoothing.
problem Understanding why diffusion models generalize well across diverse domains.
method Investigating the role of score matching and log-domain smoothing in diffusion models.
result Log-domain smoothing adapts the diffusion model to the data manifold.
Generative models improved with smoothed score functions for better sample quality.
problem Improving generative models for better sample quality.
method Smoothed score functions based on factorial Gaussian kernels.
result Single noise level achieved 14.15 Fréchet inception distance on CIFAR-10.
Flexible approach for normal approximations in geometric and topological statistics.
problem Normal approximation for complex statistics not expressible as sums of score functions.
method Flexible add-one cost operator combined with strong stabilization theory.
result Established normal approximation results for geometric and topological statistics.
Improved sampling from high-dimensional Gaussians using smoothed scores.
problem Sampling from high-dimensional Gaussian distributions with gradient information.
method Using smoothed scores, which are gradients of the logarithms of Gaussian-convolved densities, to overcome approximation barriers.
result Improved sampling efficiency with a complexity of \(O\left(\left(\logκ+\log(e\sqrt d/δ_{
m TV})
ight)\log(e\sqrt d/δ_{
m TV})
ight)\) smoothed-score queries.
A new score function improves explainability and reliability of AI systems.
problem Designing AI systems that are explainable, robust, and trustworthy.
method Integrates conformal prediction with explainable machine learning using a novel score function.
result The method achieves improved performance on target classes and satisfies conformal guarantees.
Generative diffusion models gradually memorize training data, losing independent dimensions.
problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.
New method for sampling diffusion bridges on sub-Riemannian manifolds.
problem Sampling conditioned diffusion processes on sub-Riemannian manifolds is challenging.
method Score matching for machine learning, adapted to non-holonomic frames.
result Demonstrated method works on Heisenberg group and other sub-Riemannian manifolds.
Optimizes data-driven design problems on implicit manifolds using score functions.
problem Optimizing over implicit low-dimensional manifolds in high-dimensional data.
method Introduces a link function connecting data distribution to manifold operations, enabling efficient optimization.
result Establishes theoretical guarantees for feasibility and optimality of proposed algorithms.
Geometric framework for portfolio analysis detects financial crises and evaluates performance.
problem Detecting financial crises and evaluating portfolio performance in volatile markets.
method Geometric framework, copula models, statistical computing.
result Automated crisis detection and new portfolio score for performance evaluation.
FUSE neural centrality framework improves data point measurement in high dimensions.
problem Measuring centrality in high-dimensional data is expensive and unstable.
method Combines global and local heads trained on arbitrary representations.
result Reveals meaningful classical ordering and competitive performance.
This work extends diffusion models to function space for better generative modeling.
problem Limited applicability of diffusion models to functional data domains.
method Introduces Denoising Diffusion Operators (DDOs) for training diffusion models in function space.
result Demonstrates accurate function-valued generation at fixed cost.
New method assesses individual training points' privacy risk without retraining.
problem Privacy vulnerability of individual training points in membership inference attacks.
method Derives a closed-form decomposition of individual black-box MIA vulnerability, extending to deep networks.
result Proposes a surrogate score operating on last-layer representations that requires only a single trained model.
Some real-world problems revolve to solve the optimization problem \max_{x\in\mathcal{X}}f\left(x\right) where f\left(.\right) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only define a symmetric and non-negative similarity score on it. This setting requires…
Extends diffusion models to non-Euclidean spaces with geometric priors.
problem Difficulties in natural sciences with symmetries and non-Euclidean data.
method Constructs a noising process and neural network equivariant to symmetry group, approximates score function.
result Model can generate complex scalar and vector fields on synthetic and real-world data.
Geometric observables detect financial regime shifts with high accuracy.
problem Detecting regime shifts in financial markets.
method Extracted four geometric observables from equity-index returns and evaluated them against various baseline methods.
result The Berry Phase Rate achieves an unbiased out-of-sample median Cohen's d of 0.72, significantly reducing false alarms.
JORC-UMAP improves UMAP by incorporating geometric and topological priors.
problem UMAP's local Euclidean distance assumption fails to capture intrinsic manifold geometry, leading to topological tearing and structural collapse.
method JORC-UMAP introduces Ollivier-Ricci curvature as a geometric prior and Jaccard similarity as a topological prior to reinforce edges and reduce redundant links.
result JORC-UMAP reduces tearing and collapse more effectively than standard UMAP and other DR methods, as measured by SVM accuracy and triplet preservation scores.
Adaptive sampling improves graph diffusion models by maintaining uniform information speed.
problem Standard diffusion models overlook non-homogeneous dynamics on complex manifolds.
method Information-geometric framework using Fisher-Rao metric and Drift Variation Score (DVS).
result DVS solver ensures uniform rate of distributional change, improving structural fidelity and efficiency.
Geometrically, high-likelihood regions in DGMs are unlikely to generate OOD data.
problem The paradox of high-likelihood OOD detection in deep generative models.
method Local intrinsic dimension estimation to identify high-likelihood regions that do not generate OOD data.
result A method pairing likelihoods and LID estimates for reliable OOD detection.
JAPAN uses flow-based models to create adaptive prediction areas with better coverage guarantees.
problem Inadequate prediction areas from existing conformal prediction methods, especially for multimodal distributions.
method JAPAN employs density-based conformity scores using flow-based models to construct context-adaptive prediction areas.
result JAPAN produces more accurate and context-adaptive prediction areas compared to existing methods.
TRACE improves conformal prediction for multi-dimensional outputs.
problem Challenges in constructing valid and informative conformal prediction regions for multi-dimensional outputs.
method TRACE uses transport alignment in diffusion and flow matching models to define nonconformity scores.
result TRACE yields valid and adaptive conformal prediction regions for multimodal and non-convex distributions.
A new OOD detection method OTOD uses optimal transport theory to improve model performance.
problem Detecting unknown samples in real-world machine learning models.
method OTOD uses optimal transport theory to calculate an OOD score combining features, logits, and softmax probability space.
result OTOD outperforms state-of-the-art methods by significant margins on benchmarks.
Proposes Topology Distance for evaluating GANs.
problem Challenges in evaluating GANs' goodness.
method Builds Vietoris-Rips complex on image features and defines TD based on latent manifold comparisons.
result Demonstrates TD's superiority over existing metrics.
Bayesian neural networks (BNN) are the probabilistic model that combines the strengths of both neural network (NN) and stochastic processes. As a result, BNN can combat overfitting and perform well in applications where data is limited. Earthquake rupture study is such a problem where data is insufficient, and scientis…
The paper tracks patient recovery using graphs of joint movement data.
problem Tracking individual patient recovery trajectories in physical therapy.
method Bayesian learning of Random Geometric Graphs from joint movement data.
result Optimal exercise routines can be recommended based on patient recovery data.
This paper proposes a decorrelation-based approach to test hypotheses and construct confidence intervals for the low dimensional component of high dimensional proportional hazards models. Motivated by the geometric projection principle, we propose new decorrelated score, Wald and partial likelihood ratio statistics. Wi…
Improved diffusion models for manifold learning.
problem Learning distributions on general manifolds with geometric complexity.
method Revised approximations for score matching on symmetric spaces.
result Improved performance and scalability to high dimensions.
Generative models' evaluation scores can be misleading, leading to inflated grades.
problem Misleading evaluation scores for generative models.
method Analyzed and compared various scores for evaluating synthetic vs. ground-truth data.
result The Eden score avoids grade inflation and better aligns with human perception.
Embeddings in machine learning are low-dimensional representations of complex input patterns, with the property that simple geometric operations like Euclidean distances and dot products can be used for classification and comparison tasks. The proposed meta-embeddings are special embeddings that live in more general in…
The paper refines classical covariance asymptotics using geometric information geometry.
problem Deviation of finite-sample behavior from classical predictions in curved models.
method Develops a curvature-aware refinement by viewing parametric families as Riemannian manifolds with Fisher-Rao metric.
result Derives an \(n^{-2}\) correction to the leading \(n^{-1}I(θ)^{-1}\) covariance term for score-root estimators.