We consider the problem of diversity enhancing clustering, i.e, developing clustering methods which produce clusters that favour diversity with respect to a set of protected attributes such as race, sex, age, etc. In the context of fair clustering, diversity plays a major role when fairness is understood as demographic…
Neighbor embeddings balance attraction and repulsion to visualize data.
problem Visualizing high-dimensional datasets with trade-offs between continuous and discrete structures.
method Neighbor embeddings combine attractive and repulsive forces to visualize data.
result Changing the exaggeration parameter in t-SNE yields a spectrum of embeddings with a trade-off between continuous and discrete structures.
ARS visualization improves t-SNE dynamics with tunable attraction and repulsion.
problem Improve data visualization techniques for complex data sets.
method ARS framework based on t-SNE dynamics with normalized interactions and tunable kernels.
result ARS visualization provides better control over cluster tightness and spacing.
Paper proposes ARB-Loss to improve classification precision in imbalanced datasets.
problem Improving classification precision on minor classes in imbalanced datasets.
method Introduces Attraction-Repulsion-Balanced Loss (ARB-Loss) to balance gradients across different classes.
result ARB-Loss achieves state-of-the-art performance with one-stage training.
The standard loss function used to train neural network classifiers, categorical cross-entropy (CCE), seeks to maximize accuracy on the training data; building useful representations is not a necessary byproduct of this objective. In this work, we propose clustering-oriented representation learning (COREL) as an altern…
DNNs with L2 regularization reveal feature learning dynamics and sparsity.
problem Understanding feature learning in DNNs with L2 regularization. method Reformulating loss in terms of layerwise activations and covariances.
result Proving sparsity of local minima in L2-regularized DNNs. Continuous control tasks in reinforcement learning are important because they provide an important framework for learning in high-dimensional state spaces with deceptive rewards, where the agent can easily become trapped into suboptimal solutions. One way to avoid local optima is to use a population of agents to ensure…
A new method, tree-SNE, solves the scale problem in t-SNE.
problem Clustering and visualizing high-dimensional data, especially MNIST digits.
method Revisits t-SNE idea to create a 2+1 dimensional embedding with a scale parameter.
result The optimal embedding depends continuously on the scale parameter for all initial conditions.
CAMEL embeds data into a manifold using curvature-augmented forces.
problem Data visualization and dimensionality reduction.
method Formulates DR as a physics model with curvature-augmented forces.
result CAMEL outperforms existing methods on benchmark datasets.
Method identifies IPS governing equations from particle data efficiently.
problem Identify governing equations of interacting particle systems efficiently.
method Combines mean-field theory and WSINDy for large N and M. result Converges with rate O(N−1/2) for N≥100. Establishes a link between heat diffusion and manifold distances in data.
problem No theoretical link between diffusion-based manifold learning and geodesic distances.
method Formulates heat geodesic embeddings based on Riemannian geometry.
result Method outperforms state-of-the-art in preserving manifold distances and cluster structure.
Study on capillarity minimizers with nonlocal repulsion and gravity, proving existence and nonexistence.
problem Minimizing an energy functional with capillarity, nonlocal repulsion, and gravity.
method Quantitative isoperimetric inequalities applied to capillarity problem in a half-space.
result Existence and nonexistence of minimizers for various nonlocal kernels and masses.
Graph convolutions can enhance high frequencies, leading to over-sharpening.
problem Graph convolutions suffer from over-smoothing and poor performance on heterophilic graphs.
method Rigorously prove that linear graph convolutions minimize a generalized Dirichlet energy, showing that weight matrices induce edge-wise attraction or repulsion.
result Graph convolutions can enhance high frequencies, leading to over-sharpening instead of over-smoothing.