The study characterizes quadrics among affine hyperspheres based on centroid collinearity of sections.
problem Characterizing quadrics among affine hyperspheres based on section centroid collinearity.
method Extending Meyer and Reisner's theorem to unbounded convex sets and identifying additional assumptions.
result Ellipsoids, paraboloids, and one sheet of a two-sheeted hyperboloid are the only quadrics satisfying the centroid collinearity condition.
AEC method improves XAI for models with collinear features.
problem Collinearity issues in machine learning models.
method Divides multivariate models into univariate models to examine feature effects.
result AEC method is more robust and stable against collinearity.
Yau's Affine Normal Descent optimizes smooth unconstrained problems with geometrically adapted directions.
problem Optimizing smooth unconstrained problems with geometrically adapted directions.
method Yau's Affine Normal Descent (YAND) uses the equi-affine normal of level-set hypersurfaces as search directions.
result YAND converges globally under standard smoothness assumptions and locally quadratically near nondegenerate minimizers.
No feature ranking can be faithful, stable, and complete when features are collinear.
problem The impossibility of creating a feature ranking that is simultaneously faithful, stable, and complete when features are collinear.
method Proving the impossibility, quantifying it for four model classes, resolving it via ensemble averaging (DASH), and machine-verifying it with Lean 4 theorems.
result No method lies outside the dichotomy of faithful-complete methods (unstable, with rankings that flip up to 50% of the time) and ensemble methods (stable, reporting ties for symmetric features).
Bayesian regularization tackles collinearity in large-scale systems with correlated inputs.
problem Collinearity in large-scale linear systems identification due to correlated inputs.
method Bayesian regularization with stable spline covariance and Markov chain Monte Carlo scheme.
result Efficient reconstruction of impulse responses with high correlation among inputs.
We compute the Betti numbers and describe the cohomology algebras of the ordered and unordered configuration spaces of three points in complex projective spaces, including the infinite dimensional case. We also compute these invariants for the configuration spaces of three collinear and non-collinear points.
CDF uses centroids to split features for high-dimensional classification.
problem High-dimensional classification problems with complex class structures.
method CDF introduces a centroid-driven splitting strategy in decision trees.
result CDF outperforms conventional methods in high-dimensional classification.
A new classification method using disjoint centroids and normalized distance.
problem Improving classification accuracy and feature selection.
method Nearest disjoint centroid classifier with normalized distance.
result Our method outperforms other classifiers in terms of misclassification rates and feature usage.
Ball k-means reduces point-centroid distance computations for faster k-means clustering.
problem Efficiently finding k-means clusters in large datasets.
method Uses a ball to describe clusters, dividing them into stable and active areas, and adjusting points within annulus areas.
result Significantly reduces point-centroid distance computations, making k-means faster and more efficient.
We define a new method to estimate centroid for text classification based on the symmetric KL-divergence between the distribution of words in training documents and their class centroids. Experiments on several standard data sets indicate that the new method achieves substantial improvements over the traditional classi…
Centroid Transformers reduce memory and computation by summarizing inputs into centroids.
problem Efficiently summarize inputs with reduced memory and computation.
method Generalizes self-attention to map N inputs to M centroids (M ≤ N), reducing complexity.
result Centroid Transformers reduce memory and computation while preserving key information.
Bayesian approach tackles collinearity in large-scale linear system identification.
problem Collinearity in large-scale linear system identification.
method Bayesian regularization framework with Gaussian process and stable spline kernel. Novel Markov chain Monte Carlo scheme.
result Efficiently reconstructs impulse responses posterior by dealing with collinearity.
EKM addresses imbalanced data clustering by repelling centroids in large clusters.
problem Imbalanced data leads to biased clustering of large clusters.
method EKM introduces a novel centroid repulsion mechanism based on the Boltzmann operator.
result EKM outperforms benchmark algorithms on imbalanced data.
Centroid-Encoder reduces high-dimensional data for better visualization.
problem Visualizing high-dimensional data efficiently and accurately.
method Centroid-Encoder integrates label information to keep similar objects close in reduced space.
result Centroid-Encoder outperforms other techniques in visualizing high-dimensional data.
Empty core found in max-loss non-centroid clustering.
problem Core stability in non-centroid clustering under max-loss objective.
method Proof for all k≥3 and n≥9 agents, computer-aided proof for 2D Euclidean points.
result Core can be empty in non-centroid clustering under max-loss objective.
Due to the success of the bag-of-word modeling paradigm, clustering histograms has become an important ingredient of modern information processing. Clustering histograms can be performed using the celebrated k-means centroid-based algorithm. From the viewpoint of applications, it is usually required to deal with symm…
The paper proves a theorem linking convex body centroids and category theory.
problem Understanding centroids of sections of convex bodies.
method Lusternik-Schnirelmann category theory.
result At least n hyperplanes exist such that the center of mass of their intersection with a convex body lies on the boundary of the convex body.
Centroids Matching tackles catastrophic forgetting by matching feature vectors to class centroids.
problem Catastrophic forgetting in neural networks when learning new tasks.
method Centroids Matching operates in the embedding space of neural network features, matching these vectors to class centroids.
result Centroids Matching achieves high accuracy on all tasks without using external memory, even in realistic scenarios.
Optimizes a small set of centroid points to approximate bootstrap distribution.
problem Computational inefficiency of standard bootstrap methods in large-scale machine learning.
method Explicitly optimizes a small set of high quality centroid points to approximate the ideal bootstrap distribution.
result Accurately estimates uncertainty with a small number of bootstrap centroids, outperforming i.i.d. sampling.
This paper proposes the use of an optimization algorithm, namely PSO to decide the initial centroids in K-means, to eventually get better accuracy. The vectorized notation of the optimal centroids can be thought of as entities in an optimization space, where the accuracy of K-means over a random subset of the data coul…
New method converts video of dye plumes into PDEs for better understanding.
problem Inferring continuum models from uncalibrated video data.
method Develops a pipeline to convert grayscale recordings into scalar fields, isolates drift, and identifies transport laws.
result Selected reduced model outperforms advection-diffusion baselines and retains structural interpretability.
Text clustering method replaces centroids with summaries for interpretability and scalability.
problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.
We formally prove the connection between k-means clustering and the predictions of neural networks based on the softmax activation layer. In existing work, this connection has been analyzed empirically, but it has never before been mathematically derived. The softmax function partitions the transformed input space into…
The nearest-centroid classifier is a simple linear-time classifier based on computing the centroids of the data classes in the training phase, and then assigning a new datum to the class corresponding to its nearest centroid. Thanks to its very low computational cost, the nearest-centroid classifier is still widely use…
The paper generalizes the second Pappus-Guldin theorem for calculating volumes of bodies.
problem Calculating the volume of a body cut into perpendicular slices.
method Using a generalized formula and properties of centroids and floating bodies.
result A curve with centroid property exists for convex bodies, leading to simpler volume calculations.
Sharp Lp affine isoperimetric inequalities are established for the entire class of Lp projection bodies and the entire class of Lp centroid bodies. These new inequalities strengthen the Lp Petty projection and the Lp Busemann--Petty centroid inequality.
A conceptually simple way to classify images is to directly compare test-set data and training-set data. The accuracy of this approach is limited by the method of comparison used, and by the extent to which the training-set data cover configuration space. Here we show that this coverage can be substantially increased u…
We study the connectedness of the planar self-affine sets T(A,D) generated by an integer expanding matrix A with ∣det(A)∣=3 and a non-collinear digit set D={0,v,kAv} where k∈Z∖{0} and v∈Z2 such that {v,Av} is linearly independent. By chec…
Two-dimensional almost-Riemannian structures are generalized Riemannian structures on surfaces for which a local orthonormal frame is given by a Lie bracket generating pair of vector fields that can become collinear. Generically, the singular set is an embedded one dimensional manifold and there are three type of point…
Symmetry-electronic fingerprints reveal competing magnetic phases in two-dimensional materials.
problem Predicting magnetic ground states, moments, and anisotropy in two-dimensional magnets.
method Introduce the symmetry-electronic fingerprint (SEF), a physically interpretable representation that encodes crystallographic symmetry operations, Wyckoff-site geometry, and site-resolved electronic structure.
result SEF-trained models accurately classify magnetic ordering and regress moments alongside anisotropy energies.
In addition to finding meaningful clusters, centroid-based clustering algorithms such as K-means or mean-shift should ideally find centroids that are valid patterns in the input space, representative of data in their cluster. This is challenging with data having a nonconvex or manifold structure, as with images or text…
CCC clusters with controlled spread, outperforming standard methods.
problem Compact and structured clustering with spread control.
method Constrained Centroid Clustering using Lagrangian formulation.
result CCC achieves more compact clusters with reduced radial spread.
We study a notion of a Lipschitz, permutation-invariant "centroid" for triples of points in mapping class groups MCG(S), which satisfies a certain polynomial growth bound. A consequence (via work of Drutu-Sapir or Chatterji-Ruane) is the Rapid Decay Property for MCG(S).
The paper derives theoretical foundations for two common machine learning variable importance measures.
problem Understanding variable importance in machine learning problems.
method The paper derives closed-form expressions for Permute-and-Predict (PaP) and Leave-One-Covariate-Out (LOCO) methods.
result Theoretical derivations explain the behavior of PaP and LOCO under collinearity, linking them to coefficients and predictor variability.
Method counters noisy labels by discounting distant samples.
problem Training models with noisy labels in medical and autonomous domains.
method Discounting distant samples from class centroids in latent space.
result Significant improvements in classification accuracy.
In the paper, we focus on the connectedness of planar self-affine sets T(A,D) generated by an integer expanding matrix A with ∣det(A)∣=3 and a collinear digit set D={0,1,b}v, where b>1 and v∈R2 such that {v,Av} is linearly independent. We discuss the domain of…
Two XAI methods, SHAP and LIME, are discussed for tabular data models.
problem Making machine learning models transparent and trustworthy.
method SHAP and LIME methods for explaining model predictions.
result SHAP and LIME are model-dependent and sensitive to feature collinearity.
We propose a penalized orthogonal-components regression (POCRE) for large p small n data. Orthogonal components are sequentially constructed to maximize, upon standardization, their correlation to the response residuals. A new penalization framework, implemented via empirical Bayes thresholding, is presented to effecti…
New meta-learning method improves domain generalization by balancing parameters closer to domain centroids.
problem Improving domain generalization by reducing overfitting to specific domains.
method Arithmetic meta-learning with arithmetic-weighted gradients to balance parameters closer to domain centroids.
result Experimental validation of improved domain generalization performance.
New clustering method reduces data redundancy for better summaries.
problem Redundancies in data summaries limit their effectiveness in large datasets.
method Khatri-Rao clustering extends centroid-based clustering to produce more succinct summaries.
result Khatri-Rao k-Means and deep clustering frameworks produce more succinct summaries with similar accuracy.
This work discovers algebraic structures from data using a differentiable measure.
problem Discovering discrete algebraic rules from data.
method Formalizes the problem through Cayley-table completion and uses HyperCube operator-valued tensor factorization.
result Derives an absolute lower bound for the differentiable measure of algebraic complexity, proving it is attained only for group structures.
SIVF k-means algorithm speeds up sparse data clustering.
problem Efficiently clustering large-scale high-dimensional sparse data.
method Inverted-file structure for centroids, filter-based similarity reduction.
result SIVF achieves higher speed and lower memory consumption.
We consider the problem of learning linear prediction models with model misspecification bias. In such case, the collinearity among input variables may inflate the error of parameter estimation, resulting in instability of prediction results when training and test distributions do not match. In this paper we theoretica…
We introduce a new volume definition on normed vector spaces. We show that the induced k-area functionals are convex for all k. In the particular case k=2, our theorem implies that Busemann's 2-volume density is convex, which was recently shown by Burago-Ivanov. We also show how the new volume definition is relat…
HIV RNA viral load (VL) is an important outcome variable in studies of HIV infected persons. There exists only a handful of methods which classify patients by viral load patterns. Most methods place limits on the use of viral load measurements, are often specific to a particular study design, and do not account for com…
In N(k)-contact metric manifolds and/or (k,μ)-manifolds, gradient Ricci solitons, compact Ricci solitons and Ricci solitons with V pointwise collinear with the structure vector field ξ are studied.
This study evaluates cluster search algorithms using Gaussian mixture models.
problem Determining the optimal number of clusters in data sets generated by Gaussian mixture models.
method Examined centroid- and model-based cluster search algorithms in various cases.
result Model-based algorithms are more robust to cluster overlap and covariance type than centroid-based methods.
Self-affine tiles homeomorphic to a ball proven for a specific digit set.
problem Topology of self-affine tiles with collinear digit sets.
method Proving homeomorphism to a ball using integral self-affine tiles with collinear digit sets.
result A large class of integral self-affine tiles with collinear digit sets is homeomorphic to a closed 3-dimensional ball.