Study selective classification with halfspaces, achieving error bounds under Gaussian distributions.
problem Modeling relationships in subsets of data defined by selection rules.
method Sparse linear classifiers for subsets defined by halfspaces, focusing on Gaussian feature distributions.
result First PAC-learning algorithm for homogeneous halfspace selectors with error guarantee $\bigO*{\sqrt{\mathrm{opt}}}$.
Establishes a condition for multiclass classification-calibration of Gamma-Phi losses.
problem Ensuring classification-calibration of multiclass Gamma-Phi losses.
method Develops a general sufficient condition for classification-calibration of Gamma-Phi losses.
result Proves the first family of nonconvex multiclass surrogate losses for which classification-calibration has been fully justified.
Paper classifies structures on 5D manifolds with specific rank and conditions.
problem Classifying tangent distributions on 5D manifolds.
method Established necessary and sufficient topological condition for existence.
result Classification of structures up to homotopy as formal Cartan distributions.
Characterizes distribution-free rates in unbalanced classification problems.
problem Minimizing error under two different distributions in unbalanced settings.
method Characterizes minimax rates over all pairs of distributions using a geometric condition.
result Identifies a dichotomy between hard and easy classes based on a three-points-separation condition.
Duncan and Ihrig (1993) gave a classification of the flat homogeneous spaces of metric signature (m,2), provided that a certain condition on the development image of these spaces holds. In this note we show that this condition can be dropped, so that Duncan and Ihrig's classification is in fact the full classification …
This paper considers the classification of linear subspaces with mismatched classifiers. In particular, we assume a model where one observes signals in the presence of isotropic Gaussian noise and the distribution of the signals conditioned on a given class is Gaussian with a zero mean and a low-rank covariance matrix.…
Study derives error decay rates for kernel classification under source and capacity conditions.
problem Understanding prediction error decay rates for real data sets.
method Derived decay rates for misclassification error under Gaussian design for SVM and ridge classification.
result Rates accurately describe learning curves for data sets satisfying source and capacity conditions.
Enhanced H-consistency bounds derived under relaxed conditions.
problem Quantifying the relationship between zero-one estimation error and surrogate loss estimation error.
method Relaxing the condition on the surrogate loss conditional regret and presenting a general framework for establishing enhanced H-consistency bounds. result Derivation of more favorable H-consistency bounds in various scenarios. MCD reformulates conditional density estimation into binary classification.
problem Conditional density estimation in statistical and machine learning.
method Marginal Contrastive Discrimination, reformulating into marginal and ratio density functions for binary classification.
result Significantly outperforms existing methods on most density models and regression datasets.
Study shows exponential error reduction in multiclass classification without bias-variance trade-off.
problem Multiclass classification with margin conditions.
method Analysis of classification error under hard-margin conditions.
result Exponential decrease in classification error without bias-variance trade-off.
Paper tackles leveraging unlabeled data for PU classification and robust generation.
problem Scarcity of labeled data in machine learning problems.
method Introduces a novel training framework that simultaneously targets PU classification and conditional generation using extra unlabeled data.
result Proves the effectiveness of a Classifier-Noise-Invariant Conditional GAN (CNI-CGAN) that enhances PU classifier performance and leverages extra data.
Study on estimating conditional risk in machine learning.
problem Estimating expected loss of prediction models given input features.
method Analyzed in classification and regression settings, showing equivalence to standard regression. Developed theoretical insights and empirical validation.
result Conditional risk calibration is distinct from existing uncertainty quantification problems.
Enhanced consistency bounds derived for classification under a new noise condition.
problem Enhanced consistency bounds for classification under a new noise condition.
method Model Margin Noise (MM noise) assumption, derived enhanced H-consistency bounds.
result Enhanced H-consistency bounds under MM noise condition, interpolates between linear and square-root regimes.
A fundamental theorem in the study of Dunwoody manifolds is a classification of finite graphs on 2n vertices that satisfy seven conditions (concerning planarity, regularity, and a cyclic automorphism of order n). Its significance is that if the presentation complex of a cyclic presentation is a spine of a 3-manifol…
This work bounds classification error in machine learning for low Bayes error conditions.
problem Understanding the error mismatch between Bayes error and model-based classification error.
method Applying classification error bounds to study the relationship with Kullback-Leibler divergence and proposing a linear approximation for low Bayes error conditions.
result A linear approximation of the classification error bound for low Bayes error conditions is proposed.
The paper develops distribution-free methods for ordinal classification.
problem Constructing valid prediction sets for ordinal classification problems.
method Leveraging conformal prediction and multiple testing with FWER control.
result The proposed methods achieve satisfactory levels of marginal and class-specific conditional coverages.
New method uses graph generative models for graph classification.
problem Graph classification for non-relational i.i.d. data.
method Derive classification formulas from GGM, train generative graph auto-encoder model.
result New conditional ELBO for training graph auto-encoder model.
A U(n)-manifold is multiaxial if the isotropy groups are always conjugate to unitary subgroups. The classification and the concordance of such manifolds have been studied by Davis, Hsiang and Morgan under much more strict conditions. We show that in general, without much extra condition, the homotopy classification of …
New approach improves classification guarantees by focusing on direction rather than regression risk.
problem Improving classification guarantees in binary classification problems.
method Establishing a geometric distinction between classification and regression, leveraging scale invariance.
result Improved guarantees for classification risk compared to regression risk.
New tests for binary classification regression functions without distribution assumptions.
problem Testing regression functions in binary classification without distributional assumptions.
method Conditional kernel mean embeddings and resampling-based framework.
result Distribution-free hypothesis tests with exact type I error control.
The paper classifies special types of contact metric manifolds with curvature conditions.
problem Classifying N(κ)-contact metric manifolds with specific curvature tensors. method Examining flatness conditions on T-curvature tensor and analyzing specific curvature tensors. result A classification of N(κ)-contact metric manifolds under various curvature conditions. Graphs models are vulnerable to distribution shifts, which this work explains and mitigates.
problem Graph Neural Networks (GNNs) are susceptible to distribution shift, leading to performance degradation.
method Theoretical analysis quantifying conditional shift, proposing an approach to estimate and minimize it.
result The proposed approach demonstrates up to 10% absolute ROC AUC improvement under various distribution shifts.
New conformal prediction methods for long-tailed classification problems.
problem Rare classes are systematically omitted in existing conformal prediction methods.
method Introduced a new conformal score function and a new interpolation procedure.
result Smoothly trade off set size and class-conditional coverage.
We consider three-dimensional Lorentzian metrics that locally admit four independent Killing vectors. Their classification is summarized, and conditions for characterizing them are found. These consist of algebraic classification of the traceless Ricci tensor, and other conditions satisfied by the curvature and its der…
In this work we investigate intra-day patterns of activity on a population of 7,261 users of mobile health wearable devices and apps. We show that: (1) using intra-day step and sleep data recorded from passive trackers significantly improves classification performance on self-reported chronic conditions related to ment…
Paper investigates methods to improve classification by inducing a hierarchy from flat labels.
problem Improving classification performance on datasets lacking a natural hierarchy.
method The approach involves clustering conditional distributions and using a hierarchical classifier with the induced hierarchy.
result The methods can discover latent hierarchies and improve accuracy in various applications.
MAGIC-Flow generates and classifies medical images with interpretability.
problem Challenges in generative modeling for medical imaging.
method Conditional multiscale normalizing flow architecture.
result MAGIC-Flow creates realistic, diverse samples and improves classification.
Neural networks can approximate high-dimensional classifiers with ReLU networks under margin conditions.
problem Approximating high-dimensional discontinuous classifiers with neural networks.
method Using ReLU neural networks with three hidden layers, approximating a classifier with a Barron-regular decision boundary.
result High-dimensional discontinuous classifiers can be approximated with a rate of n−1 under strong margin conditions. The paper classifies solutions to a Liouville equation on a half-space with a specific boundary condition.
problem Classifying solutions to a Liouville equation with a nonlinear Neumann boundary condition.
method Analyzing the n-Laplacian Liouville equation on the half-space R+n with positive nonlinear Neumann boundary condition. result The classification of solutions extends previous results for n=2 and p=n. Study shows exponential convergence in classification errors using random features and SGD.
problem Scalability issues in kernel methods for large datasets.
method Binary classification problem with random features and stochastic gradient descent.
result Exponential convergence rate of expected classification error achieved.
We tackle imbalanced classification by weighting losses and derive robust risks.
problem Imbalanced classification where a label has low marginal probability.
method We examine convergence rates of weighted risks, define robust risks, and derive new robust risk problems.
result We show that particular weightings lead to conditional value at risk (CVaR) and derive new robust risk problems.
Study adversarial classification with data corruption up to ε, deriving geometric flows.
problem Optimizing classifiers against adversarial data corruption.
method Variational analysis, geometric flows, mean curvature equations.
result Rigorous proof of initial value problem for small ε, global minimizer of adversarial problem.
Paper analyzes risk bounds for in-context learning in multiclass classification.
problem Risk bounds for in-context learning in multiclass classification.
method Formalizes tasks as sequences of labeled examples and queries, estimates conditional class probabilities, establishes oracle inequality for KL divergence.
result ICL achieves minimax optimal rate for conditional probability estimation.
We consider stochastic gradient descent and its averaging variant for binary classification problems in a reproducing kernel Hilbert space. In the traditional analysis using a consistency property of loss functions, it is known that the expected classification error converges more slowly than the expected risk even whe…
Study proposes a clustering and logistic regression algorithm for PU classification under Non-SCAR.
problem PU classification under Non-SCAR condition when SCAR condition is unsatisfied.
method 2-means clustering followed by logistic regression.
result Efficacy of the proposed algorithm demonstrated on 11 real data sets and a synthetic set.
When performing regression or classification, we are interested in the conditional probability distribution for an outcome or class variable Y given a set of explanatoryor input variables X. We consider Bayesian models for this task. In particular, we examine a special class of models, which we call Bayesian regression…
In many real-world classification problems, the labels of training examples are randomly corrupted. Most previous theoretical work on classification with label noise assumes that the two classes are separable, that the label noise is independent of the true class label, or that the noise proportions for each class are …
Unified framework for classification and image generation.
problem Limited supervision in classification and image generation.
method Triple Generative Adversarial Network (Triple-GAN) as a three-player minimax game.
result Unique equilibrium converges to data distribution, achieving excellent classification and generation results.
CARD models predict the distribution of continuous or categorical responses.
problem Uncertainty in predicting continuous or categorical responses.
method Combines denoising diffusion and conditional mean estimation.
result Outperforms state-of-the-art methods in conditional distribution prediction.
Study improves adversarial classification using distributionally robust models.
problem Improving robustness against adversarial attacks in classification models.
method Distributionally robust chance constraints with Wasserstein ambiguity, reformulated as a regularized ramp loss minimization problem.
result Standard descent methods can converge to the global minimizer for the distributionally robust adversarial classification model.
Complete classification of Hermitian manifolds with flat Gauduchon connections.
problem Classifying compact Hermitian manifolds with flat Gauduchon connections.
method Analyzing properties of Hermitian manifolds and using Gauduchon connections.
result Established a conjecture about Kähler-like conditions and flatness.
Risk bounds for Classification and Regression Trees (CART, Breiman et. al. 1984) classifiers are obtained under a margin condition in the binary supervised classification framework. These risk bounds are obtained conditionally on the construction of the maximal deep binary tree and permit to prove that the linear penal…
We present a new replay-based method of continual classification learning that we term "conditional replay" which generates samples and labels together by sampling from a distribution conditioned on the class. We compare conditional replay to another replay-based continual learning paradigm (which we term "marginal rep…
Improved incremental sequence classification with temporal consistency.
problem Updating predictions as new sequence elements are revealed.
method Temporal-difference learning and a temporal-consistency condition for successive predictions.
result Optimizing a novel loss function improves data efficiency and predictive accuracy.
The study analyzes performance indices for class-imbalanced data and identifies conditions they must meet.
problem Distortions in performance indices under class imbalance.
method Identified two conditions for performance indices and analyzed four binary and five multi-class indices.
result Recommended appropriate indices for evaluating classifiers in class-imbalanced scenarios.
Near-Exponential Convergence Rates for kNN Classification
problem Convergence rates for kNN classification
method Introducing Boltzmann margin
result First near-exponential convergence rates for kNN classification
The use of deep networks to extract embeddings for speaker recognition has proven successfully. However, such embeddings are susceptible to performance degradation due to the mismatches among the training, enrollment, and test conditions. In this work, we propose an adversarial speaker verification (ASV) scheme to lear…
The paper identifies conditions for trend reversal in classification tasks.
problem Trend reversal in classification scores and dataset values.
method Algebraic conditions and numerical results for ridge regression.
result Existence of pathological regularization regimes for certain dataset conditions.