Study optimal rates for multiclass classification, resolving open questions.
problem Optimal rates for multiclass classification with any label space.
method Establishes optimal rates for all hypothesis classes, defining new tree structures.
result Optimal rates for multiclass classification with no infinite DSL trees.
The paper analyzes Laplace learning for Gaussian measure data in infinite dimensions, proving convergence.
problem Analyzing Laplace learning for infinite-dimensional Gaussian measure data.
method Minimizes Dirichlet energy on a graph constructed from the full dataset.
result Proves pointwise convergence of the graph Dirichlet energy for Gaussian measure data.
A novel framework for regression with multiple experts, addressing challenges in infinite and continuous label spaces.
problem Challenges in regression with multiple experts due to the infinite and continuous nature of the label space.
method Introduces a novel framework for regression with deferral, analyzing both single-stage and two-stage scenarios with new surrogate loss functions.
result Proves H-consistency bounds for both single-stage and two-stage methods, providing stronger guarantees than Bayes consistency. Bounds on conformal dimension for certain Coxeter group boundaries.
problem Determining conformal dimensions for specific Coxeter group boundaries.
method Quasi-isometric embeddings and geometric actions on CAT(-1) spaces.
result Upper and lower bounds on conformal dimension for specified Coxeter groups.
A new method for online multi-label stream classification.
problem Challenges in classifying continuous data streams with concept drift and delayed labels.
method Online unsupervised incremental method based on self-organizing maps.
result The method is highly competitive in both stationary and concept drift scenarios.
Graph Lie algebras have infinite prolongation if they have a vertex of degree one.
problem Determining when the prolongation of a graph Lie algebra is infinite-dimensional.
method Analyzing labeled direct graphs and their associated Lie algebras.
result Graph Lie algebras are infinite-dimensional if and only if they have a vertex of degree one.
Study computable multiclass learning within PAC framework.
problem Computable multiclass learnability in finite label space.
method Proposed computable version of Natarajan dimension and generalized to distinguishers.
result Characterizes CPAC learnability for certain dimensions and embeddings.
Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the Dirichlet process mixture models or extensions thereof for which efficient Gibbs sam…
Many machine learning problems can be characterized by mutual contamination models. In these problems, one observes several random samples from different convex combinations of a set of unknown base distributions and the goal is to infer these base distributions. This paper considers the general setting where the base …
We construct examples of free-by-cyclic hyperbolic groups which fiber in infinitely many ways over Z. The construction involves adding a specialized square 2-cell to a non-positively curved, squared 2-complex defined by labeled oriented graphs. The fundamental groups of the resulting complexes are hyperbolic, free-by-c…
New MCMC method tackles label-switching problem for clustering.
problem Label-switching problem impedes MCMC efficiency in discrete clustering.
method Formulated optimal transport couplings for partition space.
result Our method efficiently overcomes label-switching problem.
We develop methods to efficiently approximate data in metric spaces without additional assumptions.
problem Efficiently approximating data in metric spaces without imposing structural assumptions.
method Identify discrete modulus of continuity, investigate consistency, propose algorithm, and develop approximation theory.
result Consistent approximation of data in metric spaces without structural assumptions.
Infinitely wide GCNs perform as GPs for graph semi-supervised learning.
problem Graph-based semi-supervised classification with limited labeled data.
method Proposes GPGC model combining GCNs and GPs for semi-supervised learning.
result GPGC outperforms state-of-the-art methods on various datasets.
In this paper we consider the problems of supervised classification and regression in the case where attributes and labels are functions: a data is represented by a set of functions, and the label is also a function. We focus on the use of reproducing kernel Hilbert space theory to learn from such functional data. Basi…
After Fossas-Parlier, we consider two graphs G0(S) and G∞(S), constructed from multicurves on connected, orientable surfaces of infinite-type. Our first result asserts that G∞(S) has finite diameter, which extends a result of Fossas-Parlier. Next, we prove that the…
Study on optimal ReLU networks with weight decay for interpolation.
problem Interpolating data with radially symmetric distributions using shallow ReLU networks.
method Weight decay regularization in infinite neuron, infinite data limit; analysis of growth rates.
result Existence and growth rates of unique radially symmetric minimizers with weight decay.
Conditional random fields (CRFs) have been shown to be one of the most successful approaches to sequence labeling. Various linear-chain neural CRFs (NCRFs) are developed to implement the non-linear node potentials in CRFs, but still keeping the linear-chain hidden structure. In this paper, we propose NCRF transducers, …
We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clust…
Novikov's problem of semiclassical orbits of quasi-electrons in a normal metal leads to a correspondance between 3-ply periodic functions in R and fractals in R P^2. These fractals are the complement of infinitely many open sets labeled by integer 2-cycles of T^3. Here we present a characterization of the fractal point…
Efficient algorithms learn from coarse labels instead of fine grained ones.
problem Learning from coarse labels when fine labels are unavailable.
method Formalized coarse label settings, used a reduction for SQs, and provided efficient algorithms.
result Any problem learnable from fine labels can be learned efficiently from coarse labels.
Many machine learning problems can be characterized by mutual contamination models. In these problems, one observes several random samples from different convex combinations of a set of unknown base distributions. It is of interest to decontaminate mutual contamination models, i.e., to recover the base distributions ei…
GD with early stopping trains shallow neural nets for nonparametric regression robustly.
problem Learning Lipschitz regression functions with noisy labels.
method Overparameterized shallow neural networks trained by GD with early stopping.
result Optimal rates of convergence for nonparametric regression.
Paper develops a new method for open-set and imbalanced classification with valid prediction sets.
problem Tackles open-set and imbalanced classification with new prediction methods.
method Develops a new family of conformal p-values and a selective sample splitting algorithm.
result Valid prediction sets with valid coverage in open-set scenarios and informative predictions under extreme class imbalance.
We propose a general approach for supervised learning with structured output spaces, such as combinatorial and polyhedral sets, that is based on minimizing estimated conditional risk functions. Given a loss function defined over pairs of output labels, we first estimate the conditional risk function by solving a (possi…
The Ollivier Ricci flow with prescribed curvature on infinite graphs.
problem Ricci flow with prescribed curvature on infinite graphs.
method Existence and uniqueness of the solution to the Ricci flow.
result Convergence of the Ricci flow for graphs with girth at least 6.
Gradient flows on distributions of distributions for machine learning tasks.
problem Designing gradient flows for datasets of probability distributions.
method Representing classes as conditional distributions, modeling datasets as mixture distributions, using Wasserstein over Wasserstein (WoW) distance and gradients.
result Demonstrated gradient flows for dataset transfer and distillation tasks.
Extends FJS analysis to general label spaces, including classification and regression.
problem Distribution shift in general label spaces, including covariate and label shifts.
method Proposes a framework for analyzing FJS in general label spaces and generalizes existing results.
result Generalizes FJS analysis to general label spaces, including classification and regression.
A new framework CL embeds features and labels for multi-label classification.
problem Exponential growth of output space in multi-label classification.
method Compact Learning (CL) framework that embeds features and labels simultaneously.
result CMLL maximizes label-feature dependency and minimizes label space loss.
An important problem in multi-label classification is to capture label patterns or underlying structures that have an impact on such patterns. This paper addresses one such problem, namely how to exploit hierarchical structures over labels. We present a novel method to learn vector representations of a label space give…
Study of deep linear neural networks with proportional width and depth.
problem Lack of descriptive power in Gaussian limit of deep linear neural networks.
method Proportional infinite-width infinite-depth limit for deep linear neural networks.
result Characterization of limiting distribution as a nontrivial mixture of Gaussians.
PML-LFC improves PML by estimating label confidence from both feature and label spaces.
problem PML challenges in real-world scenarios where only some labels are relevant.
method PML-LFC estimates label confidence using feature and label space similarities, training a predictor with these values.
result PML-LFC achieves superior performance on synthetic and real-world datasets.
This paper investigates a novel algorithmic approach to data representation based on kernel methods. Assuming that the observations lie in a Hilbert space X, the introduced Kernel Autoencoder (KAE) is the composition of mappings from vector-valued Reproducing Kernel Hilbert Spaces (vv-RKHSs) that minimizes the expected…
Study on infinite-dimensional Heisenberg groups using hypoelliptic heat kernels.
problem Properties of hypoelliptic heat kernels on infinite-dimensional reduced Heisenberg groups.
method Construction and study of hypoelliptic heat kernels on infinite-dimensional reduced Heisenberg groups.
result Hypoelliptic logarithmic Sobolev inequalities on the space.
Better uncertainty estimates for neural networks using Gaussian process priors.
problem Poor uncertainty estimates in neural networks, especially on out-of-distribution data.
method Characterize the function-space prior of an ensemble of infinitely-wide neural networks as a Gaussian process and use it to build a probabilistic model.
result The approach improves calibration of neural networks, especially under distributional shift.
CcGAN tackles conditional image generation for continuous labels.
problem Mathematical challenges in conditioning on continuous, scalar labels.
method Proposes novel empirical losses and label input methods for continuous conditional GANs.
result CcGAN generates diverse, high-quality images from continuous labels.
Extreme multi-label classification (XMC) refers to supervised multi-label learning involving hundreds of thousand or even millions of labels. In this paper, we develop a suite of algorithms, called Bonsai, which generalizes the notion of label representation in XMC, and partitions the labels in the representation space…
Study on infinite energy maps from surfaces to CAT(0) spaces.
problem Harmonic maps with infinite energy from Riemann surfaces to CAT(0) spaces.
method Estimates of energy growth near punctures, proof of uniqueness.
result Precise estimates of energy growth near punctures and proof of uniqueness of harmonic maps.
Enhances labels from unlabeled data using sample correlations.
problem Lack of label distributions in real-world applications.
method Proposes LESC and gLESC methods to enhance label distributions.
result Improves performance of label enhancement through sample correlations.
This paper is one step toward infinite energy gauge theory and the geometry of infinite dimensional moduli spaces. We generalize a gluing construction in the usual Yang-Mills gauge theory to an ``infinite energy'' situation. We show that we can glue an infinite number of instantons, and that the resulting instantons ha…
The feasibility of existing data stream algorithms is often hindered by the weakly supervised condition of data streams. A self-evolving deep neural network, namely Parsimonious Network (ParsNet), is proposed as a solution to various weakly-supervised data stream problems. A self-labelling strategy with hedge (SLASH) i…
We extend rectified flow to infinite-dimensional Hilbert space.
problem Extending rectified flow to infinite-dimensional spaces.
method Established a rigorous functional formulation using the superposition principle for continuity equations.
result Demonstrated superior performance compared to existing models.
Paper constructs infinitely many tangent functors on diffeological spaces.
problem Tangent spaces in diffeological spaces are not uniquely defined.
method Introduced and constructed infinitely many non-isomorphic tangent functors.
result The choice of tangent functor is not unique outside smooth manifolds.
New non-trivial Kaehler-Ricci solitons found in infinite dimensional complex space forms.
problem Non-trivial Kaehler-Ricci solitons in infinite dimensional complex space forms.
method Exhibited families of non trivial radial Kaehler-Ricci solitons in infinite dimensional complex space forms.
result Non-trivial Kaehler-Ricci solitons exist in infinite dimensional complex space forms, contradicting previous finite dimensional results.
End-to-end deep metric learning tackles multi-label image classification.
problem Multi-label image classification problem.
method Two-way deep distance metric learning in a latent space with a reconstruction module.
result Our method outperforms state-of-the-arts on publicly available image datasets.
Paper connects sampling and labeling biases in large-output spaces.
problem Efficient training in large-output spaces with label imbalance.
method Unified approach to address sampling and labeling biases.
result Different negative sampling schemes trade-off performance on dominant and rare labels.
We propose a model of quantum gravity in arbitrary dimensions defined in terms of the BV quantization of a supersymmetric, infinite dimensional matrix model. This gives an (AKSZ-type) Chern-Simons theory with gauge algebra the space of observables of a quantum mechanical Hilbert space H. The model is motivated by previ…
The paper explains how data augmentation improves semi-supervised learning efficiency.
problem Improving accuracy from a small fraction of labeled data.
method Data augmentation induces a similarity graph, which is graph-Laplacian-regularized for downstream learning.
result A fast transductive rate of O(1/nL) is achieved, reducing the number of labels needed. Multi-label learning is concerned with the classification of data with multiple class labels. This is in contrast to the traditional classification problem where every data instance has a single label. Due to the exponential size of output space, exploiting intrinsic information in feature and label spaces has been the…