arXiv research

The $\mathcal{G}_I^0$ distribution is able to characterize different regions in monopolarized SAR imagery. It is indexed by three parameters: the number of looks (which can be estimated in the whole image), a scale parameter and a texture parameter. This paper presents a new proposal for feature extraction and region d…

To optimize a neural network one often thinks of optimizing its parameters, but it is ultimately a matter of optimizing the function that maps inputs to outputs. Since a change in the parameters might serve as a poor proxy for the change in the function, it is of some concern that primacy is given to parameters but tha…

This paper refines MMD for domain adaptation by balancing intra-class and inter-class distances.

Gaussian mixture models (GMM) are powerful parametric tools with many applications in machine learning and computer vision. Expectation maximization (EM) is the most popular algorithm for estimating the GMM parameters. However, EM guarantees only convergence to a stationary point of the log-likelihood function, which c…

Exact 1-Wasserstein distance between location-scale distributions derived, with privacy effects studied.

Method detects effects of synthesis parameters on plutonium oxide microstructure.

The paper connects geometric and topological concepts to bound distances between metric spaces.

As a fundamental problem of natural language processing, it is important to measure the distance between different documents. Among the existing methods, the Word Mover's Distance (WMD) has shown remarkable success in document semantic matching for its clear physical insight as a parameter-free model. However, WMD is e…

This study approximates distances between Gaussian processes and covariance operators using RKHS.

Bounds on geodesic distances on Stiefel manifold derived from new metrics.

Transportation distances have been used for more than a decade now in machine learning to compare histograms of features. They have one parameter: the ground metric, which can be any metric between the features themselves. As is the case for all parameterized distances, transportation distances can only prove useful in…

Region-based classification of PolSAR data can be effectively performed by seeking for the assignment that minimizes a distance between prototypes and segments. Silva et al (2013) used stochastic distances between complex multivariate Wishart models which, differently from other measures, are computationally tractable.…

The paper explores selecting the parameter α for Fermat distance to balance geometry and noise.

This paper relates parameter distance to gradient breakdown for a broad class of nonlinear compositional functions. The analysis leads to a new distance function called deep relative trust and a descent lemma for neural networks. Since the resulting learning rule seems to require little to no learning rate tuning, it m…

Images obtained with coherent illumination, as is the case of sonar, ultrasound-B, laser and Synthetic Aperture Radar -- SAR, are affected by speckle noise which reduces the ability to extract information from the data. Specialized techniques are required to deal with such imagery, which has been modeled by the G0 dist…

A new robust metric compares distributions more accurately than existing methods.

The scaled complex Wishart distribution is a widely used model for multilook full polarimetric SAR data whose adequacy has been attested in the literature. Classification, segmentation, and image analysis techniques which depend on this model have been devised, and many of them employ some type of dissimilarity measure…

In this paper, we present a simple non-parametric method for learning the structure of undirected graphs from data that drawn from an underlying unknown distribution. We propose to use Brownian distance covariance to estimate the conditional independences between the random variables and encodes pairwise Markov graph. …

Implicit Generative Models (IGMs) such as GANs have emerged as effective data-driven models for generating samples, particularly images. In this paper, we formulate the problem of learning an IGM as minimizing the expected distance between characteristic functions. Specifically, we minimize the distance between charact…

We propose a novel method to determine the dissimilarity between subjects for functional data clustering. Spline smoothing or interpolation is common to deal with data of such type. Instead of estimating the best-representing curve for each subject as fixed during clustering, we measure the dissimilarity between subjec…

A Discriminative Deep Forest (DisDF) as a metric learning algorithm is proposed in the paper. It is based on the Deep Forest or gcForest proposed by Zhou and Feng and can be viewed as a gcForest modification. The case of the fully supervised learning is studied when the class labels of individual training examples are …

In this paper we develop a new perspective on generalization of neural networks by proposing and investigating the concept of a neural network stiffness. We measure how stiff a network is by looking at how a small gradient step in the network's parameters on one example affects the loss on another example. Higher stiff…

Multi-label classification is a type of supervised learning where an instance may belong to multiple labels simultaneously. Predicting each label independently has been criticized for not exploiting any correlation between labels. In this paper we propose a novel approach, Nearest Labelset using Double Distances (NLDD)…

Proposes a Coulomb-like model for international trade flows, fitting real-world data.

Derives PDEs from data using manifold learning and neural networks.

A new distance metric for vMF distributions simplifies spherical data analysis.

New distance metric for neural architecture search reduces search space complexity.

Efficiently approximates neural network function space distance.

Study stability of curvature-dimension condition for negative dimensions.

New Riemannian radial distributions help estimate parameters on symmetric spaces.

Algorithm selects public datasets for private machine learning.

Ball k-means reduces point-centroid distance computations for faster k-means clustering.

Bounds neural network output distribution to Gaussian for random initialization.

The notion of task similarity is at the core of various machine learning paradigms, such as domain adaptation and meta-learning. Current methods to quantify it are often heuristic, make strong assumptions on the label sets across the tasks, and many are architecture-dependent, relying on task-specific optimal parameter…

We study how the length and the twisting parameter of a curve change along a Teichmuller geodesic. We then use our results to provide a formula for the Teichmuller distance between two hyperbolic metrics on a surface, in terms of the combinatorial complexity of curves of bounded lengths in these two metrics.

This paper proposes and analyzes a novel clustering algorithm that combines graph-based diffusion geometry with techniques based on density and mode estimation. The proposed method is suitable for data generated from mixtures of distributions with densities that are both multimodal and have nonlinear shapes. A crucial …

Deep neural networks (DNNs) are poorly calibrated when trained in conventional ways. To improve confidence calibration of DNNs, we propose a novel training method, distance-based learning from errors (DBLE). DBLE bases its confidence estimation on distances in the representation space. In DBLE, we first adapt prototypi…

We define a novel class of distances between statistical multivariate distributions by modeling an optimal transport problem on their marginals with respect to a ground distance defined on their conditionals. These new distances are metrics whenever the ground distance between the marginals is a metric, generalize both…

A projective parameter of a geodesic on a Finsler space is defined to be solution of a certain ODE. Using projective parameter and Funk metric, one can construct a projectively invariant intrinsic pseudo-distance on a Finsler space. In the present work, solutions of the projective parameter's ODE are characterized with…

Paper introduces a new robust loss function for RL.

Person re-identification (Re-ID) aims at matching images of the same person across disjoint camera views, which is a challenging problem in multimedia analysis, multimedia editing and content-based media retrieval communities. The major challenge lies in how to preserve similarity of the same person across video footag…

The recently developed bag-of-paths (BoP) framework consists in setting a Gibbs-Boltzmann distribution on all feasible paths of a graph. This probability distribution favors short paths over long ones, with a free parameter (the temperature $T$) controlling the entropic level of the distribution. This formalism enables…

In this paper we consider compact, Riemannian manifolds $M_1, M_2$ each equipped with a one-parameter family of metrics $g_1(t), g_2(t)$ satisfying the Ricci flow equation. Motivated by a characterization of the super Ricci flow developed by McCann-Topping, we introduce the notion of a super Ricci flow for a family of …

We analyze the semi-hard triplet loss using Edgeworth expansion for better understanding of its behavior.

The medoid of a set of n points is the point in the set that minimizes the sum of distances to other points. It can be determined exactly in O(n^2) time by computing the distances between all pairs of points. Previous works show that one can significantly reduce the number of distance computations needed by adaptively …

We propose a simple model for the behaviour of longterm investors on a stock market, consisting of three particles, which represent the current price of the stock and the opinion of the buyers, respectively sellers, about the right trading price. As time evolves, both groups of traders update their opinions with respec…

SWRLDA improves LDA for multi-class classification with edge classes.

For Gamma a finite, connected metric graph, we consider the space of configurations of n points in Gamma with a restraint parameter r dictating the minimum distance allowed between each pair of points. These restricted configuration spaces come up naturally in topological robotics. In this paper, we study the homotopy,…