Efficiently accelerates attention calculation for Transformers with relative positional encoding.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A new method, REC, compresses images by encoding their latent representations efficiently.
Paper compares feature selection methods using GCM and LOCO, showing GCM methods generally outperform LOCO.
We study the K-armed dueling bandit problem, a variation of the standard stochastic bandit problem where the feedback is limited to relative comparisons of a pair of arms. The hardness of recommending Copeland winners, the arms that beat the greatest number of other arms, is characterized by deriving an asymptotic regr…
Paper proposes a federated learning framework for relative fairness.
We discuss the relative merits of optimistic and randomized approaches to exploration in reinforcement learning. Optimistic approaches presented in the literature apply an optimistic boost to the value estimate at each state-action pair and select actions that are greedy with respect to the resulting optimistic value f…
We explore a decomposition in which returns on a large class of portfolios relative to the market depend on a smooth non-negative drift and changes in the asset price distribution. This decomposition is obtained using general continuous semimartingale price representations, and is thus consistent with virtually any ass…
Algorithm estimates covariance from noisy data efficiently.
We investigate the relative information efficiency of financial markets by measuring the entropy of the time series of high frequency data. Our tool to measure efficiency is the Shannon entropy, applied to 2-symbol and 3-symbol discretisations of the data. Analysing 1-minute and 5-minute price time series of 55 Exchang…
EP-learning framework improves causal contrast estimation efficiency.
We consider the problem of metric learning subject to a set of constraints on relative-distance comparisons between the data items. Such constraints are meant to reflect side-information that is not expressed directly in the feature vectors of the data items. The relative-distance constraints used in this work are part…
Due to the recent advances on Neural Architecture Search (NAS), it gains popularity in designing best networks for specific tasks. Although it shows promising results on many benchmarks and competitions, NAS still suffers from its demanding computation cost for searching high dimensional architectural design space, and…
Logistic regression is a widely used method in several fields. When applying logistic regression to imbalanced data, for which majority classes dominate over minority classes, all class labels are estimated as `majority class.' In this article, we use an F-measure optimization method to improve the performance of logis…
A simplified model for fixed income portfolio optimisation.
New proof shows efficient ReLU networks for piecewise linear functions.
The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem within a context where numerical attributes are taken into account, which represents…
Paper proposes efficient algorithms for bandit problems with costly sampling.
We consider the question of efficient estimation in the tails of Gaussian copulas. Our special focus is estimating expectations over multi-dimensional constrained sets that have a small implied measure under the Gaussian copula. We propose three estimators, all of which rely on a simple idea: identify certain \emph{dom…
The paper analyzes portfolio credit risk using Archimedean copulas and introduces efficient simulation methods.
The objective of change-point detection is to discover abrupt property changes lying behind time-series data. In this paper, we present a novel statistical change-point detection algorithm based on non-parametric divergence estimation between time-series samples from two retrospective segments. Our method uses the rela…
A new LSV model uses relative quantities for better trading and risk management.
Deep learning natural language processing models often use vector word embeddings, such as word2vec or GloVe, to represent words. A discrete sequence of words can be much more easily integrated with downstream neural layers if it is represented as a sequence of continuous vectors. Also, semantic relationships between w…
Efficient algorithms solve joint graphical lasso problems.
DP-REC combines privacy and communication efficiency in federated learning.
Predictive models are increasingly deployed for the purpose of determining access to services such as credit, insurance, and employment. Despite potential gains in productivity and efficiency, several potential problems have yet to be addressed, particularly the potential for unintentional discrimination. We present an…
Understanding efficiency in high dimensional linear models is a longstanding problem of interest. Classical work with smaller dimensional problems dating back to Huber and Bickel has illustrated the benefits of efficient loss functions. When the number of parameters is of the same order as the sample size , $p \…
Entropy analysis via kernel methods for probabilistic inference.
Given two candidate models, and a set of target observations, we address the problem of measuring the relative goodness of fit of the two models. We propose two new statistical tests which are nonparametric, computationally efficient (runtime complexity is linear in the sample size), and interpretable. As a unique adva…
We propose a technique for increasing the efficiency of gradient-based inference and learning in Bayesian networks with multiple layers of continuous latent vari- ables. We show that, in many cases, it is possible to express such models in an auxiliary form, where continuous latent variables are conditionally determini…
RI-based variable ranking and selection outperforms lasso in high-dimensional datasets.
We provide a method for approximating Bayesian inference using rejection sampling. We not only make the process efficient, but also dramatically reduce the memory required relative to conventional methods by combining rejection sampling with particle filtering. We also provide an approximate form of rejection sampling …
New model optimizes portfolios with realistic transaction costs.
Cluster analysis is one of the essential tasks in data mining and knowledge discovery. Each type of data poses unique challenges in achieving relatively efficient partitioning of the data into homogeneous groups. While the algorithms for numeric data are relatively well studied in the literature, there are still challe…
MaxMax Q-Learning improves coordination in multi-agent reinforcement learning by refining action selection.
The writers propose a mathematical Method for deriving risk weights which describe how a borrower's income, relative to their debt service obligations (serviceability) affects the probability of default of the loan. The Method considers the borrower's income not simply as a known quantity at the time the loan is made, …
The selection of initial parameter values for gradient-based optimization of deep neural networks is one of the most impactful hyperparameter choices in deep learning systems, affecting both convergence times and model performance. Yet despite significant empirical and theoretical analysis, relatively little has been p…
Quantum memory limits set by relativity theory.
Adapts GRPO for off-policy RL, improving reward.
The visibility transformation embeds data position into signature features for efficient pattern recognition.
Recently, researchers have started applying convolutional neural networks (CNNs) with one-dimensional convolutions to clinical tasks involving time-series data. This is due, in part, to their computational efficiency, relative to recurrent neural networks and their ability to efficiently exploit certain temporal invari…
Reinforcement Patching optimizes dynamic sequence patching for efficient time series forecasting.
We introduce efficient numerical methods for generic HJM equations of interest rate theory by means of high-order weak approximation schemes. These schemes allow for QMC implementations due to the relatively low dimensional integration space. The complexity of the resulting algorithm is considerably lower than the comp…
Optimal design portfolios improve energy efficiency and reduce risk in uncertain reservoirs.
We propose the segmented iHMM (siHMM), a hierarchical infinite hidden Markov model (iHMM) that supports a simple, efficient inference scheme. The siHMM is well suited to segmentation problems, where the goal is to identify points at which a time series transitions from one relatively stable regime to a new regime. Conv…
Any closed, oriented, hyperbolic three-manifold with nontrivial second homology has many quasigeodesic flows, where quasigeodesic means that flow lines are uniformly efficient in measuring distance in relative homotopy classes. The flows are pseudo-Anosov flows which are almost transverse to finite depth foliations in …
A financial market comprising of a certain number of distinct companies is considered, and the following statement is proved: either a specific agent will surely beat the whole market unconditionally in the long run, or (and this "or" is not exclusive) all the capital of the market will accumulate in one company. Thus,…
Kernel -means clustering can correctly identify and extract a far more varied collection of cluster structures than the linear -means clustering algorithm. However, kernel -means clustering is computationally expensive when the non-linear feature map is high-dimensional and there are many input points. Kernel …
Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by conformal predictive systems may be useful, e.g., in decision making problems. Conf…