Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4079119158 · May 202619922001200920172026
48 results for Ranked list truncation

We study the problem of rank aggregation: given a set of ranked lists, we want to form a consensus ranking. Furthermore, we consider the case of extreme lists: i.e., only the rank of the best or worst elements are known. We impute missing ranks by the average value and generalise Spearman's ρto extreme ranks. Our main …

2014-10-16abs ↗pdf ↗

Proposes a method to handle sparse multiway count data with false zeros using zero-truncated Poisson regression.

problem Handling sparse multiway count data corrupted by false zeros.
method Zero-truncated Poisson regression with tensor completion.
result Accurate estimation of multiway count data from approximately IR2log22(I)IR^2\log_2^2(I) non-zero counts.

Truncated Singular Value Decomposition (SVD) calculates the closest rank-kk approximation of a given input matrix. Selecting the appropriate rank kk defines a critical model order choice in most applications of SVD. To obtain a principled cut-off criterion for the spectrum, we convert the underlying optimization prob…

2011-02-15abs ↗pdf ↗

Non-negative matrix factorization (NMF) minimizes the Euclidean distance between the data matrix and its low rank approximation, and it fails when applied to corrupted data because the loss function is sensitive to outliers. In this paper, we propose a Truncated CauchyNMF loss that handle outliers by truncating large e…

2019-06-02abs ↗pdf ↗

The conventional solution to the recommendation problem greedily ranks individual document candidates by prediction scores. However, this method fails to optimize the slate as a whole, and hence, often struggles to capture biases caused by the page layout and document interdepedencies. The slate recommendation problem …

2018-03-05abs ↗pdf ↗

Many web systems rank and present a list of items to users, from recommender systems to search and advertising. An important problem in practice is to evaluate new ranking policies offline and optimize them before they are deployed. We address this problem by proposing evaluation algorithms for estimating the expected …

2018-04-27abs ↗pdf ↗

We show that given an estimate A^\widehat{A} that is close to a general high-rank positive semi-definite (PSD) matrix AA in spectral norm (i.e., A^A2δ\|\widehat{A}-A\|_2 \leq δ), the simple truncated SVD of A^\widehat{A} produces a multiplicative approximation of AA in Frobenius norm. This observation leads to many inte…

2017-02-22abs ↗pdf ↗

New algorithm predicts ranked stock lists for long-short portfolios.

problem Constructing effective long-short stock portfolios using machine learning.
method Proposes a new listwise learn-to-rank loss function to emphasize top and bottom of a rank list.
result Demonstrates superior performance in constructing long-short portfolios with a 38% annual return.

Efficiently estimate Boolean product distribution parameters from truncated samples.

problem Estimating parameters of Boolean product distributions from truncated samples.
method Introducing fatness of truncation set, using membership queries, and adapting Stochastic Gradient Descent.
result Efficiently learn Boolean product distributions from truncated samples with small sample complexity.

List-wise learning to rank methods are considered to be the state-of-the-art. One of the major problems with these methods is that the ambiguous nature of relevance labels in learning to rank data is ignored. Ambiguity of relevance labels refers to the phenomenon that multiple documents may be assigned the same relevan…

2017-07-24abs ↗pdf ↗

The outcome of a functional genomics pipeline is usually a partial list of genomic features, ranked by their relevance in modelling biological phenotype in terms of a classification or regression model. Due to resampling protocols or just within a meta-analysis comparison, instead of one list it is often the case that …

2010-04-08abs ↗pdf ↗

The paper tackles targeted attacks on rank aggregation methods, proving the fixed point of adversarial game.

problem The security issue of rank aggregation methods, especially the vulnerability to targeted attacks.
method Formulated as a game-theoretic framework, the attack behavior is a fixed point of the composition of the adversary and the victim.
result The victims will produce the target ranking list once the adversary has complete information.

We study the rank distribution, the cumulative probability, and the probability density of returns of stock prices of listed firms traded in four stock markets. We find that the rank distribution and the cumulative probability of stock prices traded in are consistent approximately with the Zipf's law or a power law. It…

2004-12-01abs ↗pdf ↗

Learning to rank is an important problem in machine learning and recommender systems. In a recommender system, a user is typically recommended a list of items. Since the user is unlikely to examine the entire recommended list, partial feedback arises naturally. At the same time, diverse recommendations are important be…

2018-11-01abs ↗pdf ↗

Paper proposes a new model for imputing missing spatiotemporal traffic data.

problem Missing data and sparsity in spatiotemporal traffic data.
method Low-rank tensor completion (LRTC) framework with truncated nuclear norm (TNN).
result The proposed model outperforms state-of-the-art imputation models in various scenarios.

Many latent (factorized) models have been proposed for recommendation tasks like collaborative filtering and for ranking tasks like document or image retrieval and annotation. Common to all those methods is that during inference the items are scored independently by their similarity to the query in the latent embedding…

2012-10-16abs ↗pdf ↗

Study identifies and analyzes three types of errors in learning Fourier operators.

problem Statistical, discretization, and truncation errors in learning Fourier operators.
method Analysis of a Discrete Fourier Transform (DFT) based least squares estimator.
result Established upper and lower bounds on statistical, discretization, and truncation errors.

We show that an infinite family of contractible 4-manifolds have the same boundary as a special type of plumbing. Consequently their Ozsvath--Szabo invariants can be calculated algorithmically. We run this algorithm for the first few members of the family and list the resulting Heegaard--Floer homologies. We also show …

2012-04-17abs ↗pdf ↗

New model improves website ranking by considering user choices as a whole.

problem Optimizing content ordering for user clicks in website design.
method Introduced multinomial logit (MNL) choice model to LTR framework, proposing UCB algorithms.
result Proved theoretical bounds on regret for UCB algorithms in both known and unknown position parameter settings.

Smoothed analysis shows that many classes become learnable from positive-only samples.

problem Learning from positive-only samples is challenging due to negative results in worst-case settings.
method Smoothed analysis of positive-only learning, assuming samples from a reference distribution smooth with respect to the true distribution.
result All VC classes become learnable in the smoothed model with O(VC/ε2)O(VC/ε^2) positive samples for εε classification error.

In a stock market, the price fluctuations are interactive, that is, one listed company can influence others. In this paper, we seek to study the influence relationships among listed companies by constructing a directed network on the basis of Chinese stock market. This influence network shows distinct topological prope…

2015-03-03abs ↗pdf ↗

Paper proposes a new optimization framework for learning eigenfunctions of operators.

problem Computing eigenvalue decomposition of high-dimensional operators.
method Operator SVD with Neural Networks via Nested Low-Rank Approximation.
result Proposed method efficiently learns top-L singular values and functions in the correct order.

Sparse PCA is a widely used technique for high-dimensional data analysis. In this paper, we propose a new method called low-rank principal eigenmatrix analysis. Different from sparse PCA, the dominant eigenvectors are allowed to be dense but are assumed to have a low-rank structure when matricized appropriately. Such a…

2019-04-28abs ↗pdf ↗

For many internet businesses, presenting a given list of items in an order that maximizes a certain metric of interest (e.g., click-through-rate, average engagement time etc.) is crucial. We approach the aforementioned task from a learning-to-rank perspective which reveals a new problem setup. In traditional learning-t…

2017-02-24abs ↗pdf ↗

By proving precisely which singularity index lists arise from the pair of invariant foliations for a pseudo-Anosov surface homeomorphism, Masur and Smillie determined a Teichmueller flow invariant stratification of the space of quadratic differentials. In this paper we determine an analog to the theorem for Out(F3)Out(F_3).…

2013-11-18abs ↗pdf ↗

The problem of searching for experts in a given academic field is hugely important in both industry and academia. We study exactly this issue with respect to a database of authors and their publications. The idea is to use Latent Semantic Indexing (LSI) and Latent Dirichlet Allocation (LDA) to perform topic modelling i…

2013-11-25abs ↗pdf ↗

Improves medication name inference for telemedicine and conversational agents.

problem Challenges in mapping user-friendly medication names to standardized ones.
method Entity-boosted two-tower neural network for ranking SMN to DMP.
result State-of-the-art results achieved with improved attention-based ranking.

Recommender systems are widely used to recommend the most appealing items to users. These recommendations can be generated by applying collaborative filtering methods. The low-rank matrix completion method is the state-of-the-art collaborative filtering method. In this work, we show that the skewed distribution of rati…

2019-04-22abs ↗pdf ↗

The study assesses low-rank approximations in Gaussian Process regression.

problem Improving Gaussian Process regression efficiency with low-rank approximations.
method Analyzes two low-rank approximations: random Fourier features and Mercer expansion truncation.
result Bounds on the divergence and error between exact and approximate GP models.

The study assesses low-rank approximations in Gaussian Process regression.

problem Improving the efficiency of Gaussian Process regression while maintaining accuracy.
method Analyzes two low-rank approximations: random Fourier features and Mercer expansion truncation, and bounds the divergence and error between exact and approximate models.
result Theoretical bounds on the divergence and error between exact and approximate Gaussian Process models are provided.

Physics-inspired methods optimize SVD compression of LLMs.

problem Efficiently compressing large language models (LLMs) using SVD.
method FermiGrad for globally optimal rank selection and PivGa for lossless compression.
result Global optimization of SVD ranks and lossless compression of low-rank factors.