Paper investigates optimal transport map estimation in infinite-dimensional spaces.
problem Estimating optimal transport maps in infinite-dimensional spaces is challenging.
method Characterizes γ-smoothness for optimal transport maps and develops a polynomial-rate estimator. result Shows polynomial-order minimax risk for optimal transport map estimation.
We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clust…
Infinite-dimensional diffusion models tackle generative tasks for complex data.
problem Challenges in applying diffusion models to infinite-dimensional data.
method Directly formulate diffusion-based generative models in infinite dimensions.
result Developed guidelines for designing infinite-dimensional diffusion models.
Study infinite Euclidean distance discriminants of algebraic varieties.
problem Understanding the structure of data points with infinitely many critical points in Euclidean distance correspondence.
method Developed computer code to compute discriminants and proved properties of fibers.
result Infinite Euclidean distance discriminants contain all data points with infinitely many critical points for the nearest-point problem.
Develops robust methods for infinite-dimensional stochastic processes.
problem Measuring covariations in stochastic evolution equations in infinite dimensions.
method Asymptotic theory for jump robust measurement of covariations.
result Identifies scaling limits for realized covariations.
This paper tackles infinite-dimensional diffusion bridge simulation using operator learning.
problem Challenges in simulating diffusion bridges for modeling natural data due to intractable drift terms and continuous data representations.
method Merges score matching techniques with operator learning to directly learn infinite-dimensional bridges.
result Demonstrates high efficacy in simulating diffusion bridges for various applications, including real-world biological data.
This paper presents a natural extension of stagewise ranking to the the case of infinitely many items. We introduce the infinite generalized Mallows model (IGM), describe its properties and give procedures to estimate it from data. For estimation of multimodal distributions we introduce the Exponential-Blurring-Mean-Sh…
The paper analyzes Laplace learning for Gaussian measure data in infinite dimensions, proving convergence.
problem Analyzing Laplace learning for infinite-dimensional Gaussian measure data.
method Minimizes Dirichlet energy on a graph constructed from the full dataset.
result Proves pointwise convergence of the graph Dirichlet energy for Gaussian measure data.
The paper extends confidence sequences for infinite variance data.
problem Addressing confidence sequences for distributions with infinite variance.
method Establishing lower bounds and deriving tight confidence sequences for relaxed bounded pth-moment distributions. result Derived confidence sequences are tighter than those using Dubins-Savage inequality.
UDN adapts depth to data complexity, outperforming standard neural networks.
problem Adapting neural network depth to data complexity.
method Variational inference for infinitely deep neural networks with a novel algorithm.
result UDN outperforms standard neural networks and other infinite-depth approaches.
The paper solves curvature problems on infinite hyperbolic surfaces.
problem Prescribed curvature flow on hyperbolic surfaces with infinite topological type.
method Introduced a prescribed curvature flow adapted to infinite cellular decompositions.
result Established well-posedness of the flow and proved convergence under certain conditions.
Bayesian ReLU nets fix asymptotic overconfidence with infinite features.
problem Bayesian ReLU nets can be asymptotically overconfident far from training data.
method Extend finite ReLU BNNs with infinite ReLU features via a Gaussian process.
result The resulting model is asymptotically maximally uncertain far from the data.
This paper conditions non-linear infinite-dimensional diffusion processes.
problem Conditioning non-linear and infinite-dimensional diffusion processes.
method Infinite-dimensional Girsanov's theorem to condition function-valued stochastic processes.
result Conditioning of non-linear infinite-dimensional diffusion processes is achieved.
We derive asymptotic expansions for option data to detect infinite variation volatility.
problem Detecting infinite variation volatility in high-frequency option data.
method Nonparametric higher-order asymptotic expansions for small-time changes of characteristic functions of Itô semimartingales.
result Evidence of infinite variation volatility in high-frequency option data.
HIRM models noisy, sparse, heterogeneous relational data using hierarchical clustering and Dirichlet processes.
problem Modeling noisy, sparse, and heterogeneous relational data.
method Hierarchical Chinese restaurant process and Dirichlet process mixture for clustering and modeling relation values.
result HIRM generalizes standard models and discovers relational structure in real-world datasets.
FDPs generalize diffusion models to function spaces, enabling efficient image generation.
problem Efficiently generating images from continuous data.
method Introducing FDPs with new mathematical frameworks and training objectives.
result FDPs achieve high-quality image generation with fewer parameters.
Infinite Hidden Markov Models (iHMM's) are an attractive, nonparametric generalization of the classical Hidden Markov Model which can automatically infer the number of hidden states in the system. However, due to the infinite-dimensional nature of transition dynamics performing inference in the iHMM is difficult. In th…
This article presents some methods to control the bottom of the spectrum of the Laplacian λ0 on hyperbolic surfaces with infinite volume. Our first result bounds the λ0 of a geometrically finite surface in terms of the geometry of its convex core. We then focus on infinite type periodic hyperbolic surfaces built …
Paper proposes robust estimators for heavy-tailed data with infinite variance.
problem Developing robust estimators for heavy-tailed data with infinite variance.
method Proposes two robust estimators: ridge log-truncated M-estimator and elastic net log-truncated M-estimator.
result Demonstrates robustness of log-truncated estimations over standard estimations through simulations and real data analysis.
This paper presents a new model called infinite mixtures of multivariate Gaussian processes, which can be used to learn vector-valued functions and applied to multitask learning. As an extension of the single multivariate Gaussian process, the mixture model has the advantages of modeling multimodal data and alleviating…
The paper proposes a Gaussian mixture model for Hilbert-space-valued data.
problem Challenges in characterizing probability measures for infinite-dimensional random objects.
method Gaussian mixture framework based on kernel mean embeddings.
result The proposed algorithm yields a dense class of approximations in infinite-dimensional spaces.
We present the Infinite Latent Events Model, a nonparametric hierarchical Bayesian distribution over infinite dimensional Dynamic Bayesian Networks with binary state representations and noisy-OR-like transitions. The distribution can be used to learn structure in discrete timeseries data by simultaneously inferring a s…
The paper discusses the importance of infinite-mean models in finance and risk management.
problem Classic statistical models assume finite mean or variance, which is not suitable for heavy-tailed data.
method Discussion and recent results on infinite-mean models in economics and finance.
result Classic statistical results for finite-mean models often fail or flip for infinite-mean models.
In this paper, we present an infinite hierarchical non-parametric Bayesian model to extract the hidden factors over observed data, where the number of hidden factors for each layer is unknown and can be potentially infinite. Moreover, the number of layers can also be infinite. We construct the model structure that allo…
Paper introduces infinite-dimensional generative models using Doob's h-transform.
problem Defining generative models in infinite dimensions.
method Using Doob's h-transform to force a reference diffusion towards a target distribution.
result The forced process can be approximated by minimising a score-matching objective.
Enhances clustering for functional data, robust to outliers.
problem Challenges of clustering infinite-dimensional functional data and outlier sensitivity.
method Extends OCLUST algorithm to handle functional data, trimming outliers.
result Strong performance in clustering and outlier identification on simulated and real-world datasets.
Hybridizes physical and data-driven methods for predicting physicochemical properties.
problem Predicting physicochemical properties accurately using limited data.
method Distills physical method predictions into a prior model and combines with sparse experimental data using Bayesian inference.
result Significant improvements in predicting activity coefficients at infinite dilution compared to baselines and ensemble methods.
Bayesian approach learns linear operators from noisy data.
problem Learning linear operators from noisy data in infinite-dimensional spaces.
method Bayesian approach with Gaussian priors.
result Establishes posterior contraction rates and generalization error guarantees.
Project infinite time series graphs to finite marginal models using number theory.
problem Handling infinite time series graphs for causal inference.
method Projection method using number theory to find common ancestors in infinite graphs.
result Developed algorithm to project infinite graphs to finite marginal models.
New method reduces over-parametrization in neural networks, ensuring sparsity and finite network size.
problem Over-parametrization leads to too many active neurons in neural networks, especially with large data.
method Investigates a nonconvex regularization method for shallow ReLU networks.
result Locally optimal networks are finite even with infinite data, maintaining approximation guarantees and network size bounds.
Most existing approaches to clustering gene expression time course data treat the different time points as independent dimensions and are invariant to permutations, such as reversal, of the experimental time course. Approaches utilizing HMMs have been shown to be helpful in this regard, but are hampered by having to ch…
The paper constructs solutions with infinite-time singularities in Lagrangian mean curvature flow.
problem Infinite-time singularities in Lagrangian mean curvature flow.
method Constructing solutions by gluing special Lagrangian 'Lawlor necks' and analyzing dynamics of neck size.
result The flow decomposes initial data into a union of special Lagrangians intersecting at one point.
The study of universal approximation of arbitrary functions f:X→Y by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors have shown various forms of the universality of both fixed depth and fixed width…
Unified asymptotic theory and tests for ACD models reveal infinite-mean durations in cryptocurrency trading.
problem Challenges in asymptotic theory for ACD models, especially for integrated ACD.
method Unified asymptotic theory for quasi-maximum likelihood estimator, hypothesis testing framework.
result Infinite-mean durations in cryptocurrency trading, rejected integrated ACD hypothesis.
Infinite-dimensional SBDMs improve image generation across multiple resolutions.
problem Efficient image generation at high resolutions and across different levels.
method Developed SBDMs in infinite-dimensional setting, using trace class operators and operator networks.
result Improved efficiency and generalization across resolution levels.
This work investigates training infinite mixtures with maximum likelihood for improved uncertainty quantification.
problem Improving uncertainty quantification in neural networks.
method Investigates training infinite mixtures with maximum likelihood instead of variational inference.
result The proposed method leads to stochastic networks with increased predictive variance, improved robustness, and higher entropy on out-of-distribution data.
This paper presents an infinite variational autoencoder (VAE) whose capacity adapts to suit the input data. This is achieved using a mixture model where the mixing coefficients are modeled by a Dirichlet process, allowing us to integrate over the coefficients when performing inference. Critically, this then allows us t…
The study analyzes transfer learning in infinite-width neural networks, improving generalization on target tasks.
problem Improving generalization in neural networks when using pretraining on a source task.
method Developed a theory under gradient flow for infinitely wide networks, analyzing fine-tuning and joint pretraining.
result Summary statistics of randomly initialized networks after pretraining are adaptive kernels that depend on both source and target data.
Transformers handle infinite dimensional inputs effectively by feature extraction and dynamic feature selection.
problem Understanding the approximation and estimation ability of Transformers with infinite dimensional inputs.
method Anisotropic smoothness analysis and feature extraction properties of Transformers.
result Transformers avoid the curse of dimensionality and dynamically select important features.
Study on Yang-Mills heat flow on R4 bundles, showing infinite time bubbling.
problem Understanding the long-time behavior of Yang-Mills heat flow on R4 bundles. method Construction of initial data and globally defined solutions, proof of existence of bubble-tower solutions.
result Demonstrates infinite time bubbling for Yang-Mills heat flow on R4 bundles. New method reduces forecasting error by up to 67% in various data types.
problem Outliers and model misspecification in online infinite hidden Markov models.
method Batched Robust iHMM (BR-iHMM) with bounded posterior influence function.
result Reduces one-step-ahead forecasting error by up to 67% in various data types.
Veech groups uniformize Teichmüller geodesic curves in Riemann moduli space. Recently, examples of infinitely generated Veech groups have been given. We show that these can even have infinitely many cusps and infinitely many infinite ends. We further show that examples exist for which each direction of an infinite end …
Many data are naturally modeled by an unobserved hierarchical structure. In this paper we propose a flexible nonparametric prior over unknown data hierarchies. The approach uses nested stick-breaking processes to allow for trees of unbounded width and depth, where data can live at any node and are infinitely exchangeab…
We generalise surface cluster algebras to the case of infinite surfaces where the surface contains finitely many accumulation points of boundary marked points. To connect different triangulations of an infinite surface, we consider infinite mutation sequences. We show transitivity of infinite mutation sequences on tria…
While adversarial training can improve robust accuracy (against an adversary), it sometimes hurts standard accuracy (when there is no adversary). Previous work has studied this tradeoff between standard and robust accuracy, but only in the setting where no predictor performs well on both objectives in the infinite data…
The study investigates how data variability impacts the generalization of neural networks.
problem Understanding the impact of data variability on neural network generalization.
method Developed a field-theoretic formalism to compute generalization properties of neural networks, focusing on data variability.
result Data variability leads to non-Gaussian action, affecting the learning curve and generalization properties of neural networks.
We construct a infinite-dimensional manifold structure adapted to analytic Lie pseudogroups of infinite type. More precisely, we prove that any isotropy subgroup of an analytic Lie pseudogroup of infinite type is a regular infinite-dimensional Lie group, modelled on a locally convex strict inductive limit of Banach spa…
This paper is one step toward infinite energy gauge theory and the geometry of infinite dimensional moduli spaces. We generalize a gluing construction in the usual Yang-Mills gauge theory to an ``infinite energy'' situation. We show that we can glue an infinite number of instantons, and that the resulting instantons ha…