arXiv research

A new method detects and corrects outliers using optimal transport.

RTSCV detects unknown unknowns to improve model performance.

Derives conformal parameters of curves using inscribed circular polygons.

We present new rectification theorems of degenerate quasi-conformal structures that give a meaning to quotients of Riemann surfaces with empty interior "fundamental domains". These techniques are used to define the unique renormalization of polynomials with Cantor set Julia sets.

Estimates nonlinear Hawkes processes using RKHSs with ReLU rectification.

Consider a bundle of circles passing through 0 in 4-dimensional space. It is said to be rectifiable if there is a germ of diffeomorphism at 0 that takes all circles from our bundle to straight lines. We will give a classification of all rectifiable bundles of circles containing sufficiently many circles in general posi…

In this work we compute lower Lipschitz bounds of $\ell_p$ pooling operators for $p=1, 2, \infty$ as well as $\ell_p$ pooling operators preceded by half-rectification layers. These give sufficient conditions for the design of invertible neural network layers. Numerical experiments on MNIST and image patches confirm tha…

Recently, the geodesibility of planar vector fields, which are algebrizable (differentiable in the sense of Lorch for some associative and commutative unital algebra), has been established. In this paper, we consider algebrizable three-dimensional vector fields, for which we give rectifications and Riemannian metrics u…

We study the supremum of the volume of hyperbolic polyhedra with some fixed combinatorics and with vertices of any kind (real, ideal or hyperideal). We find that the supremum is always equal to the volume of the rectification of the 1-skeleton. The theorem is proved by applying a sort of volume-increasing flow to any h…

The goal of this paper is to describe all local diffeomorphisms mapping a family of circles, in an open subset of $\r^3$, into straight lines. This paper contains two main results. The first is a complete description of the rectifiable collection of circles in $\r^3$ passing through one point. It turns out that to be r…

We revisit skip-gram negative sampling (SGNS), one of the most popular neural-network based approaches to learning distributed word representation. We first point out the ambiguity issue undermining the SGNS model, in the sense that the word vectors can be entirely distorted without changing the objective value. To res…

Fisheye cameras are commonly employed for obtaining a large field of view in surveillance, augmented reality and in particular automotive applications. In spite of their prevalence, there are few public datasets for detailed evaluation of computer vision algorithms on fisheye images. We release the first extensive fish…

Adaptive optimization algorithms such as Adam are widely used in deep learning. The stability of such algorithms is often improved with a warmup schedule for the learning rate. Motivated by the difficulty of choosing and tuning warmup schedules, recent work proposes automatic variance rectification of Adam's adaptive l…

PPI uses predictions and weighting to infer from partially labeled data.

Proposes PA-DSL for correcting noisy human labels in automated data labeling.

How to obtain a model with good interpretability and performance has always been an important research topic. In this paper, we propose rectified decision trees (ReDT), a knowledge distillation based decision trees rectification with high interpretability, small model size, and empirical soundness. Specifically, we ext…

New method reduces discrete flow transitions, improving perplexity estimation.

Fisheye cameras are commonly used in applications like autonomous driving and surveillance to provide a large field of view ($>180^{\circ}$). However, they come at the cost of strong non-linear distortions which require more complex algorithms. In this paper, we explore Euclidean distance estimation on fisheye cameras …

Critical volatility triggers log-normal to power-law transitions in interconnected systems.

The Mutual Information (MI) is an often used measure of dependency between two random variables utilized in information theory, statistics and machine learning. Recently several MI estimators have been proposed that can achieve parametric MSE convergence rate. However, most of the previously proposed estimators have th…

The Rectified Linear Unit (ReLU) is a foundational activation function in artficial neural networks. Recent literature frequently misattributes its origin to the 2018 (initial) version of this paper, which exclusively investigated ReLU at the classification layer. This paper formally corrects the citation record by tra…

Proposes top-label calibration and M2B framework for multiclass to binary calibration.

We introduce a new neural network model, together with a tractable and monotone online learning algorithm. Our model describes feed-forward networks for classification, with one output node for each class. The only nonlinear operation is rectification using a ReLU function with a bias. However, there is a rectifier on …

Framework corrects model form errors in structural dynamics predictions.

This paper improves the efficiency of generative models by optimizing the straightness of Rectified Flow.

Many applications require recovering a matrix of minimal rank within an affine constraint set, with matrix completion a notable special case. Because the problem is NP-hard in general, it is common to replace the matrix rank with the nuclear norm, which acts as a convenient convex surrogate. While elegant theoretical c…

Paper tackles RUL prediction with scarce data using indirect supervision.

AReLU uses attention-based rectification to improve neural network performance.

MuSiCNet tackles irregularly sampled multivariate time series by treating them as a hierarchy of relatively regular series.

Deep neural networks (DNNs) are known for their vulnerability to adversarial examples. These are examples that have undergone small, carefully crafted perturbations, and which can easily fool a DNN into making misclassifications at test time. Thus far, the field of adversarial research has mainly focused on image model…

PPI uses proxy data to improve inference from limited labels across related tasks.

Poisson variational autoencoders introduce a metabolic cost term that penalizes high baseline activity.

This paper is concerned with the structure of Gromov-Hausdorff limit spaces $(M^n_i,g_i,p_i)\stackrel{d_{GH}}{\longrightarrow} (X^n,d,p)$ of Riemannian manifolds satisfying a uniform lower Ricci curvature bound $Rc_{M^n_i}\geq -(n-1)$ as well as the noncollapsing assumption $Vol(B_1(p_i))>v>0$. In such cases, there is …

The paper studies how to allocate human validation in AI-assisted tasks to minimize errors.