arXiv research

We propose an $O(N\cdot M)$ sorting algorithm by Machine Learning method, which shows a huge potential sorting big data. This sorting algorithm can be applied to parallel sorting and is suitable for GPU or TPU acceleration. Furthermore, we discuss the application of this algorithm to sparse hash table.

Monotonic differentiable sorting networks improve upon previous methods.

Neural sorting network improves sorting accuracy for complex inputs.

We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking, the optimal solution is to use an efficient sorting algorithm, such as Quicksor…

Sorting an array is a fundamental routine in machine learning, one that is used to compute rank-based statistics, cumulative distribution functions (CDFs), quantiles, or to select closest neighbors and labels. The sorting function is however piece-wise constant (the sorting permutation of a vector does not change if th…

Developing electrophysiological recordings of brain neuronal activity and their analysis provide a basis for exploring the structure of brain function and nervous system investigation. The recorded signals are typically a combination of spikes and noise. High amounts of background noise and possibility of electric sign…

CLASSIX is a fast and explainable clustering method that sorts data and merges groups.

Neural model learns efficient, general algorithms for various problems.

Sorting input objects is an important step in many machine learning pipelines. However, the sorting operator is non-differentiable with respect to its inputs, which prohibits end-to-end gradient-based optimization. In this work, we propose NeuralSort, a general-purpose continuous relaxation of the output of the sorting…

Machine learning speeds up search procedures for sorted tables.

Spike sorting is a fundamental preprocessing step in neuroscience that is central to access simultaneous but distinct neuronal activities and therefore to better understand the animal or even human brain. But numerical complexity limits studies that require processing large scale datasets in terms of number of electrod…

Diffsurv extends differentiable sorting to handle censored time-to-event data.

There has been a recent surge of interest in studying permutation-based models for ranking from pairwise comparison data. Despite being structurally richer and more robust than parametric ranking models, permutation-based models are less well understood statistically and generally lack efficient learning algorithms. In…

A new method sorts models to find the best one with minimal risk.

New algorithm optimizes matrix reordering for noisy disordered matrices.

We present a preference learning framework for multiple criteria sorting. We consider sorting procedures applying an additive value model with diverse types of marginal value functions (including linear, piecewise-linear, splined, and general monotone ones) under a unified analytical framework. Differently from the exi…

A new sorting method using $R^2$ values improves causal discovery from noisy data.

We propose a novel concept of a Systemic Optimal Risk Transfer Equilibrium (SORTE), which is inspired by the Bühlmann's classical notion of an Equilibrium Risk Exchange. We provide sufficient general assumptions that guarantee existence, uniqueness, and Pareto optimality of such a SORTE. In both the Bühlmann and the SO…

DSPO optimizes portfolio construction from raw stock data efficiently.

New oracle uses uncertainty for active classification with noisy feedback.

In this short communication we introduce the quick clustering algorithm (QUIST), an efficient hierarchical clustering algorithm based on sorting. QUIST is a poly-logarithmic divisive clustering algorithm that does not assume the number of clusters, and/or the cluster size to be known ahead of time. It is also insensiti…

The paper sorts big data by revealed preferences, improving consumer and policy decisions.

Let S be a surface of genus g with p punctures with negative Euler characteristic. We study the diameter of the $ε$-thick part of moduli space of S equipped with the Teichmüller or Thurston's Lipschitz metric. We show that the asymptotic behaviors in both metrics are of order $\log \frac{g+p}ε$. The same result also ho…

Improved asset pricing using uncertainty-adjusted sorting in machine learning models.

Review and compare sorting model selection methods for preference disaggregation.

The sorting operation is one of the most commonly used building blocks in computer programming. In machine learning, it is often used for robust statistics. However, seen as a function, it is piecewise linear and as a result includes many kinks where it is non-differentiable. More problematic is the related ranking ope…

Differentiable sorting and rank normalization are incompatible, with specific conditions for admissibility.

This paper addresses two seemingly unrelated problems, (a) What is the entropy and energy accounting in the Maxwell Demon problem? and (b) How can the efficiency of markets be measured? Here we show, in a simple model for the Maxwell Demon, the entropy of the universe increases by an amount eta=0.839995520 in going fro…

One-bit measurements widely exist in the real world, and they can be used to recover sparse signals. This task is known as the problem of learning halfspaces in learning theory and one-bit compressive sensing (1bit-CS) in signal processing. In this paper, we propose novel algorithms based on both convex and nonconvex s…

I propose a frequency domain adaptation of the Expectation Maximization (EM) algorithm to group a family of time series in classes of similar dynamic structure. It does this by viewing the magnitude of the discrete Fourier transform (DFT) of each signal (or power spectrum) as a probability density/mass function (pdf/pm…

A new method reduces memory requirements for sorting high-dimensional data.

Current daily paper releases are becoming increasingly large and areas of research are growing in diversity. This makes it harder for scientists to keep up to date with current state of the art and identify relevant work within their lines of interest. The goal of this article is to address this problem using Machine L…

Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning framework. Surrogate and relaxation methods exist but tend to be specific to a given…

This paper optimizes object tracking on edge devices with small matrices.

Many problems at the intersection of combinatorics and computer science require solving for a permutation that optimally matches, ranks, or sorts some data. These problems usually have a task-specific, often non-differentiable objective function that data-driven algorithms can use as a learning signal. In this paper, w…

We propose the Neural Logic Machine (NLM), a neural-symbolic architecture for both inductive learning and logic reasoning. NLMs exploit the power of both neural networks---as function approximators, and logic programming---as a symbolic processor for objects with properties, relations, logic connectives, and quantifier…

SCQRNN prevents quantile crossing and improves computational efficiency.

SLOPE is a relatively new convex optimization procedure for high-dimensional linear regression via the sorted l1 penalty: the larger the rank of the fitted coefficient, the larger the penalty. This non-separable penalty renders many existing techniques invalid or inconclusive in analyzing the SLOPE solution. In this pa…

New method estimates mixture model components efficiently.

C-FAR automates clustering assessment for neural tracking.

We introduce a financial portfolio optimization framework that allows us to automatically select the relevant assets and estimate their weights by relying on a sorted $\ell_1$-Norm penalization, henceforth SLOPE. Our approach is able to group constituents with similar correlation properties, and with the same underlyin…

Online learning to rank is a core problem in machine learning. In Lattimore et al. (2018), a novel online learning algorithm was proposed based on topological sorting. In the paper they provided a set of self-normalized inequalities (a) in the algorithm as a criterion in iterations and (b) to provide an upper bound for…

The paper examines the stability of Fama-French multi-factor models over time.

An evolutionary algorithm (EA) is developed as an alternative to the EM algorithm for parameter estimation in model-based clustering. This EA facilitates a different search of the fitness landscape, i.e., the likelihood surface, utilizing both crossover and mutation. Furthermore, this EA represents an efficient approac…

Neural networks struggle with long sequences, but a new method improves their performance.

We introduce the functional mean-shift algorithm, an iterative algorithm for estimating the local modes of a surrogate density from functional data. We show that the algorithm can be used for cluster analysis of functional data. We propose a test based on the bootstrap for the significance of the estimated local modes …

In a recent paper, it is shown that the LASSO algorithm exhibits "near-ideal behavior," in the following sense: Suppose $y = Az + η$ where $A$ satisfies the restricted isometry property (RIP) with a sufficiently small constant, and $\Vert η\Vert_2 \leq ε$. Then minimizing $\Vert z \Vert_1$ subject to $\Vert y - Az \Ver…

The purpose of this paper is to introduce a new growth adjusted price-earnings measure (GA-P/E) and assess its efficacy as measure of value and predictor of future stock returns. Taking inspiration from the interpretation of the traditional price-earnings ratio as a period of time, the new measure computes the requisit…