Monotonic differentiable sorting networks improve upon previous methods.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Neural sorting network improves sorting accuracy for complex inputs.
Sorting an array is a fundamental routine in machine learning, one that is used to compute rank-based statistics, cumulative distribution functions (CDFs), quantiles, or to select closest neighbors and labels. The sorting function is however piece-wise constant (the sorting permutation of a vector does not change if th…
The sorting operation is one of the most commonly used building blocks in computer programming. In machine learning, it is often used for robust statistics. However, seen as a function, it is piecewise linear and as a result includes many kinks where it is non-differentiable. More problematic is the related ranking ope…
Diffsurv extends differentiable sorting to handle censored time-to-event data.
Differentiable sorting and rank normalization are incompatible, with specific conditions for admissibility.
Sorting input objects is an important step in many machine learning pipelines. However, the sorting operator is non-differentiable with respect to its inputs, which prohibits end-to-end gradient-based optimization. In this work, we propose NeuralSort, a general-purpose continuous relaxation of the output of the sorting…
Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning framework. Surrogate and relaxation methods exist but tend to be specific to a given…
EXAGREE selects a stakeholder-aligned model to reduce conflicting explanations in machine learning.
A new method reduces memory requirements for sorting high-dimensional data.
A theorem on the existence of the unique minimal topologic handle decomposition of differentiable simply connected five-dimensional manifolds is proved. For a decomposition of this sort, the number of handles of each index is given.
Modern neural network training relies on piece-wise (sub-)differentiable functions in order to use backpropagation to update model parameters. In this work, we introduce a novel method to allow simple non-differentiable functions at intermediary layers of deep neural networks. We do so by training with a differentiable…
In this paper, we aim to provide a notion of "relative objects", i.e. objects equipped with some sort of subobjects, in differential topology. In spite of active researches relating them, e.g. knot theory or the theory of manifolds with corners, there seem to be poor general notions to deal with them. Moreover, we want…
We propose an sorting algorithm by Machine Learning method, which shows a huge potential sorting big data. This sorting algorithm can be applied to parallel sorting and is suitable for GPU or TPU acceleration. Furthermore, we discuss the application of this algorithm to sparse hash table.
Natural analogs of Lie brackets on affine bundles are studied, based on natural examples from differential geometry and analytical mechanics. In particular, a close relation to Lie algebroids and, by a sort of duality, to affine analogs of Poisson structures is established as well as affine versions of the complete lif…
Physarum-inspired solver speeds up LP solving in neural networks.
We generalize stochastic smoothing for gradient estimation of non-differentiable functions.
We discuss two sorts of generalization of Lie groupoids. One is Lie -groupoids defined as simplicial manifolds with trivial . The other is the stacky Lie groupoid $\cG\rra M$ with $\cG$ a differentiable stack. We build 1-1 correspondence between Lie 2-groupoids and stacky Lie groupoids up to a certain…
Developing electrophysiological recordings of brain neuronal activity and their analysis provide a basis for exploring the structure of brain function and nervous system investigation. The recorded signals are typically a combination of spikes and noise. High amounts of background noise and possibility of electric sign…
We propose a novel concept of a Systemic Optimal Risk Transfer Equilibrium (SORTE), which is inspired by the Bühlmann's classical notion of an Equilibrium Risk Exchange. We provide sufficient general assumptions that guarantee existence, uniqueness, and Pareto optimality of such a SORTE. In both the Bühlmann and the SO…
We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking, the optimal solution is to use an efficient sorting algorithm, such as Quicksor…
Machine learning speeds up search procedures for sorted tables.
Many transformations in deep learning architectures are sparsely connected. When such transformations cannot be designed by hand, they can be learned, even through plain backpropagation, for instance in attention mechanisms. However, during learning, such sparse structures are often represented in a dense form, as we d…
DSPO optimizes portfolio construction from raw stock data efficiently.
Following Sullivan's spacial realization of a differential algebra, we construct a universal integrating Lie 2-groupoid for every Lie algebroid. Then We show that unlike Lie algebras which one-to-one correspond to simply connected Lie groups, Lie algebroids (integrable or not) one-to-one correspond to a sort of etale L…
The paper sorts big data by revealed preferences, improving consumer and policy decisions.
Develops a new method for statistical optimal allocation problems.
Many problems at the intersection of combinatorics and computer science require solving for a permutation that optimally matches, ranks, or sorts some data. These problems usually have a task-specific, often non-differentiable objective function that data-driven algorithms can use as a learning signal. In this paper, w…
Improved asset pricing using uncertainty-adjusted sorting in machine learning models.
Review and compare sorting model selection methods for preference disaggregation.
Following I. S. Krasilshchik and A. M. Vinogradov, we regard PDEs as infinite-dimensional manifolds with involutive distributions and consider their special morphisms called differential coverings, which include constructions like Lax pairs and Backlund transformations. We show that, similarly to usual coverings in top…
This paper addresses two seemingly unrelated problems, (a) What is the entropy and energy accounting in the Maxwell Demon problem? and (b) How can the efficiency of markets be measured? Here we show, in a simple model for the Maxwell Demon, the entropy of the universe increases by an amount eta=0.839995520 in going fro…
CLASSIX is a fast and explainable clustering method that sorts data and merges groups.
A new method sorts models to find the best one with minimal risk.
There are many theorems in the differential geometry literature of the following sort. Let M be a complete Riemannian manifold with some conditions on various curvatures, diameters, volumes, etc. Then M is homotopy equivalent to a finite CW complex, or M is the interior of a compact, topological manifold with boundary.…
Neural model learns efficient, general algorithms for various problems.
We consider the dynamics of player's strategies in repeated market games, where the selection of strategies is determined by a learning model. Prior theoretical analysis and experimental data show that after large number of plays the average number of agents who decide to enter, per round of the game, approaches the ma…
We present a preference learning framework for multiple criteria sorting. We consider sorting procedures applying an additive value model with diverse types of marginal value functions (including linear, piecewise-linear, splined, and general monotone ones) under a unified analytical framework. Differently from the exi…
Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the back-propagation of computational graphs. In order to expand the scope of learning problems tha…
We propose the Neural Logic Machine (NLM), a neural-symbolic architecture for both inductive learning and logic reasoning. NLMs exploit the power of both neural networks---as function approximators, and logic programming---as a symbolic processor for objects with properties, relations, logic connectives, and quantifier…
SCQRNN prevents quantile crossing and improves computational efficiency.
New method estimates mixture model components efficiently.
Spike sorting is a fundamental preprocessing step in neuroscience that is central to access simultaneous but distinct neuronal activities and therefore to better understand the animal or even human brain. But numerical complexity limits studies that require processing large scale datasets in terms of number of electrod…
The main goals of this paper are: i) To develop an abstract differential calculus on metric measure spaces by investigating the duality relations between differentials and gradients of Sobolev functions. This will be achieved without calling into play any sort of analysis in charts, our assumptions being: the metric sp…
Paper proposes a novel RRL framework that learns from images and incorporates expert knowledge.
The paper examines the stability of Fama-French multi-factor models over time.
The purpose of this paper is to introduce a new growth adjusted price-earnings measure (GA-P/E) and assess its efficacy as measure of value and predictor of future stock returns. Taking inspiration from the interpretation of the traditional price-earnings ratio as a period of time, the new measure computes the requisit…
A new sorting method using values improves causal discovery from noisy data.