Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

52104156208 · Jun 202019922001200920172026
48 results for differentiable sorting

Sorting an array is a fundamental routine in machine learning, one that is used to compute rank-based statistics, cumulative distribution functions (CDFs), quantiles, or to select closest neighbors and labels. The sorting function is however piece-wise constant (the sorting permutation of a vector does not change if th…

2019-05-28abs ↗pdf ↗

The sorting operation is one of the most commonly used building blocks in computer programming. In machine learning, it is often used for robust statistics. However, seen as a function, it is piecewise linear and as a result includes many kinks where it is non-differentiable. More problematic is the related ranking ope…

2020-02-20abs ↗pdf ↗

Differentiable sorting and rank normalization are incompatible, with specific conditions for admissibility.

problem Incompatibility between differentiable sorting and rank normalization.
method Formalized admissibility through monotone invariance, batch independence, and rank-space stability conditions.
result Different gap-sensitive and batchwise relaxations of rank normalization violate the conditions for admissibility.

Sorting input objects is an important step in many machine learning pipelines. However, the sorting operator is non-differentiable with respect to its inputs, which prohibits end-to-end gradient-based optimization. In this work, we propose NeuralSort, a general-purpose continuous relaxation of the output of the sorting…

2019-03-21abs ↗pdf ↗

Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning framework. Surrogate and relaxation methods exist but tend to be specific to a given…

2019-04-08abs ↗pdf ↗

EXAGREE selects a stakeholder-aligned model to reduce conflicting explanations in machine learning.

problem Conflicting explanations from different attribution methods limit the adoption of machine learning models in safety-critical domains.
method EXAGREE is a two-stage framework that selects a Stakeholder-Aligned Explanation Model (SAEM) from a set of similar-performing models, maximizing Stakeholder-Machine Agreement (SMA).
result EXAGREE achieves simultaneous gains in faithfulness, plausibility, and fairness over baselines while preserving task accuracy.

We propose an O(NM)O(N\cdot M) sorting algorithm by Machine Learning method, which shows a huge potential sorting big data. This sorting algorithm can be applied to parallel sorting and is suitable for GPU or TPU acceleration. Furthermore, we discuss the application of this algorithm to sparse hash table.

2018-05-11abs ↗pdf ↗

Natural analogs of Lie brackets on affine bundles are studied, based on natural examples from differential geometry and analytical mechanics. In particular, a close relation to Lie algebroids and, by a sort of duality, to affine analogs of Poisson structures is established as well as affine versions of the complete lif…

2002-03-12abs ↗pdf ↗

We generalize stochastic smoothing for gradient estimation of non-differentiable functions.

problem Gradient estimation for non-differentiable functions.
method Developed a general framework for relaxation and gradient estimation of non-differentiable black-box functions using stochastic smoothing with reduced assumptions.
result Empirically validated the effectiveness of variance reduction strategies for various non-differentiable tasks.

We discuss two sorts of generalization of Lie groupoids. One is Lie nn-groupoids defined as simplicial manifolds with trivial πkn+1π_{k\geq n+1}. The other is the stacky Lie groupoid $\cG\rra M$ with $\cG$ a differentiable stack. We build 1-1 correspondence between Lie 2-groupoids and stacky Lie groupoids up to a certain…

2006-09-14abs ↗pdf ↗

We propose a novel concept of a Systemic Optimal Risk Transfer Equilibrium (SORTE), which is inspired by the Bühlmann's classical notion of an Equilibrium Risk Exchange. We provide sufficient general assumptions that guarantee existence, uniqueness, and Pareto optimality of such a SORTE. In both the Bühlmann and the SO…

2019-07-09abs ↗pdf ↗

Many transformations in deep learning architectures are sparsely connected. When such transformations cannot be designed by hand, they can be learned, even through plain backpropagation, for instance in attention mechanisms. However, during learning, such sparse structures are often represented in a dense form, as we d…

2018-10-22abs ↗pdf ↗

DSPO optimizes portfolio construction from raw stock data efficiently.

problem Manual design and misalignment in traditional portfolio construction methods.
method End-to-end neural network framework with Monotonical Logistic Regression loss.
result DSPO constructs optimal sorted portfolios with high performance metrics.

Following Sullivan's spacial realization of a differential algebra, we construct a universal integrating Lie 2-groupoid for every Lie algebroid. Then We show that unlike Lie algebras which one-to-one correspond to simply connected Lie groups, Lie algebroids (integrable or not) one-to-one correspond to a sort of etale L…

2006-12-31abs ↗pdf ↗

The paper sorts big data by revealed preferences, improving consumer and policy decisions.

problem Sorting diverse consumer preferences for big data objects like colleges.
method Endogenous weighting of revealed preferences, considering spillover effects.
result Consistent steady-state solution to counterbalance equilibrium.

Develops a new method for statistical optimal allocation problems.

problem Statistical optimal allocation problems with constraints.
method Functional differentiability approach and Hadamard differentiability of value functions.
result Validates margin assumption for fast convergence rate of plug-in methods.

Many problems at the intersection of combinatorics and computer science require solving for a permutation that optimally matches, ranks, or sorts some data. These problems usually have a task-specific, often non-differentiable objective function that data-driven algorithms can use as a learning signal. In this paper, w…

2018-05-18abs ↗pdf ↗

Review and compare sorting model selection methods for preference disaggregation.

problem Selecting a representative sorting model from multiple compatible models.
method Reviewed and proposed new procedures for selecting sorting models, including robust assignment rule.
result Identified most efficient procedures in terms of classification accuracy and robustness.

Following I. S. Krasilshchik and A. M. Vinogradov, we regard PDEs as infinite-dimensional manifolds with involutive distributions and consider their special morphisms called differential coverings, which include constructions like Lax pairs and Backlund transformations. We show that, similarly to usual coverings in top…

2003-01-28abs ↗pdf ↗

This paper addresses two seemingly unrelated problems, (a) What is the entropy and energy accounting in the Maxwell Demon problem? and (b) How can the efficiency of markets be measured? Here we show, in a simple model for the Maxwell Demon, the entropy of the universe increases by an amount eta=0.839995520 in going fro…

2003-11-15abs ↗pdf ↗

There are many theorems in the differential geometry literature of the following sort. Let M be a complete Riemannian manifold with some conditions on various curvatures, diameters, volumes, etc. Then M is homotopy equivalent to a finite CW complex, or M is the interior of a compact, topological manifold with boundary.…

2005-10-21abs ↗pdf ↗

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the back-propagation of computational graphs. In order to expand the scope of learning problems tha…

2020-02-20abs ↗pdf ↗

We propose the Neural Logic Machine (NLM), a neural-symbolic architecture for both inductive learning and logic reasoning. NLMs exploit the power of both neural networks---as function approximators, and logic programming---as a symbolic processor for objects with properties, relations, logic connectives, and quantifier…

2019-04-26abs ↗pdf ↗

SCQRNN prevents quantile crossing and improves computational efficiency.

problem Quantile crossing issue in regression models.
method Integrates ad hoc sorting in training to prevent quantile crossing and enhance computational efficiency.
result SCQRNN achieves faster convergence and non-intersecting quantiles.

New method estimates mixture model components efficiently.

problem Estimating the number of components in finite mixture models.
method Group-Sort-Fuse (GSF) procedure for simultaneous estimation of order and mixing measure.
result GSF achieves consistent estimation of true mixture order and n1/2n^{-1/2} convergence rate.

The main goals of this paper are: i) To develop an abstract differential calculus on metric measure spaces by investigating the duality relations between differentials and gradients of Sobolev functions. This will be achieved without calling into play any sort of analysis in charts, our assumptions being: the metric sp…

2012-05-30abs ↗pdf ↗

Paper proposes a novel RRL framework that learns from images and incorporates expert knowledge.

problem Lack of effective methods to incorporate expert background knowledge and learn from non-relational data in RRL.
method Differentiable Inductive Logic Programming (ILP) for learning relational information from images and incorporating expert knowledge.
result Efficacy demonstrated on various environments and datasets, showing improved learning and generalization.

The paper examines the stability of Fama-French multi-factor models over time.

problem Stability of Fama-French multi-factor models over time.
method Rolling window method, Fama and MacBeth's two-step estimation, generalized GRS statistics.
result The effectiveness of Fama-French factors is not stable over time in all countries.

The purpose of this paper is to introduce a new growth adjusted price-earnings measure (GA-P/E) and assess its efficacy as measure of value and predictor of future stock returns. Taking inspiration from the interpretation of the traditional price-earnings ratio as a period of time, the new measure computes the requisit…

2020-01-22abs ↗pdf ↗

A new sorting method using R2R^2 values improves causal discovery from noisy data.

problem Improving causal discovery from noisy observational data.
method Introducing R2R^2-sortability and an algorithm, R2R^2-SortnRegress, to find causal order.
result Sorting variables by increasing R2R^2 yields a close-to-causal order.