A new method reduces variance in training early-stage rankers for large-scale search systems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New ranking algorithms are continually being developed and refined, necessitating the development of efficient methods for evaluating these rankers. Online ranker evaluation focuses on the challenge of efficiently determining, from implicit user feedback, which ranker out of a finite set of rankers is the best. Online …
Improves text-to-SQL models by selecting the best SQL query from beam output.
Motivation: Post-database searching is a key procedure in peptide dentification with tandem mass spectrometry (MS/MS) strategies for refining peptide-spectrum matches (PSMs) generated by database search engines. Although many statistical and machine learning-based methods have been developed to improve the accuracy of …
We propose a computationally efficient wrapper feature selection method - called Autoencoder and Model Based Elimination of features using Relevance and Redundancy scores (AMBER) - that uses a single ranker model along with autoencoders to perform greedy backward elimination of features. The ranker model is used to pri…
Two-stage recommender systems struggle with exploration, leading to linear regret.
Two-stage recommender systems show better performance when components interact rather than operate independently.
Paper characterizes early-stage dementia signatures from sensor data.
A new method predicts stock ranking uncertainty to improve trading performance during regime shifts.
Algorithm ranks assets in fluctuating markets.
Study evaluates early-stage cybersecurity firms' performance using Crunchbase data.
Perceptron is a classic online algorithm for learning a classification function. In this paper, we provide a novel extension of the perceptron algorithm to the learning to rank problem in information retrieval. We consider popular listwise performance measures such as Normalized Discounted Cumulative Gain (NDCG) and Av…
Machine learning detects subtle glucose changes for early diabetes diagnosis.
A game-theoretic framework identifies influential hyperparameters for neural networks.
In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, mo…
We address the issue of the factors driving startup success in raising funds. Using the popular and public startup database Crunchbase, we explicitly take into account two extrinsic characteristics of startups: the competition that the companies face, using similarity measures derived from the Word2Vec algorithm, as we…
Enhances diffusion models by preprocessing data to improve reconstruction quality.
Gradient descent learns useful features even in the NTK regime.
In this paper, we address the issue of how to enhance the generalization performance of convolutional neural networks (CNN) in the early learning stage for image classification. This is motivated by real-time applications that require the generalization performance of CNN to be satisfactory within limited training time…
Gradient descent reshapes the function space of neural networks.
Alzheimer's disease (AD) is the most common neurodegenerative disease in older people. Despite considerable efforts to find a cure for AD, there is a 99.6% failure rate of clinical trials for AD drugs, likely because AD patients cannot easily be identified at early stages. This project investigated machine learning app…
Unified RL meta-learning framework for few-shot optimization.
In this paper we propose an algorithm that builds sparse decision DAGs (directed acyclic graphs) from a list of base classifiers provided by an external learning method such as AdaBoost. The basic idea is to cast the DAG design task as a Markov decision process. Each instance can decide to use or to skip each base clas…
Improves classifier performance in multi-stage processes with adversarial autoencoders and multi-task learning.
ABS dynamically adjusts batch size based on policy stability, improving RL performance.
CSLVAE generates large chemical libraries efficiently.
The paper analyzes CFG in masked diffusion models and proposes a new method to improve sample quality.
Survey on AI math foundations, focusing on neural networks.
Improves classifier performance in multi-stage selection processes.
CASP selects reliable policies for two-stage recommender systems by considering both value and support.
Examines learning efficiency in neural networks and related models.
Using the trends of estimated abilities in terms of item response theory for online testing, we can predict the success/failure status for the final examination to each student at early stages in courses. In prediction, we applied the newly developed nearest neighbor method for determining the similarity of learning sk…
With the proliferation of algorithmic high-frequency trading in financial markets, the Limit Order Book has generated increased research interest. Research is still at an early stage and there is much we do not understand about the dynamics of Limit Order Books. In this paper, we employ a machine learning approach to i…
New method uses impact IRR to assess impact investments.
New framework segments 3D scenes using neural algorithms and sub-Riemannian geometry.
Study predicts risk of true-lumen narrowing after ATAAD surgery using CT data.
The use of ensembles of neural networks (NNs) for the quantification of predictive uncertainty is widespread. However, the current justification is intuitive rather than analytical. This work proposes one minor modification to the normal ensembling methodology, which we prove allows the ensemble to perform Bayesian inf…
We apply our statistically deterministic machine learning/clustering algorithm *K-means (recently developed in https://ssrn.com/abstract=2908286) to 10,656 published exome samples for 32 cancer types. A majority of cancer types exhibit mutation clustering structure. Our results are in-sample stable. They are also out-o…
Investigates how FDI and R&D affect host countries' growth.
Field canals improvement projects (FCIPs) are one of the ambitious projects constructed to save fresh water. To finance this project, Conceptual cost models are important to accurately predict preliminary costs at the early stages of the project. The first step is to develop a conceptual cost model to identify key cost…
In this paper, we study the problem of safe online learning to re-rank, where user feedback is used to improve the quality of displayed lists. Learning to rank has traditionally been studied in two settings. In the offline setting, rankers are typically learned from relevance labels created by judges. This approach has…
We analyze the sectoral dynamics of startup venture financing. Based on a dataset of 52000 start-ups and 110000 funding rounds in the United States from 2000 to 2017, and by applying both Principal Component Analysis (PCA) and Tensor Component Analysis (TCA) in sector space, we visualize and measure the evolution of th…
We study ranking quantilized mean-field games to select top-performing agents.
Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents. We investigate the use of text generation techniques to augment the training data of a popular commercial artificial agent across categories of functionality, with the goal of faster development o…
We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest…
Student performance prediction - where a machine forecasts the future performance of students as they interact with online coursework - is a challenging problem. Reliable early-stage predictions of a student's future performance could be critical to facilitate timely educational interventions during a course. However, …
This paper develops a valuation model for private companies.
The learning rate warmup heuristic achieves remarkable success in stabilizing training, accelerating convergence and improving generalization for adaptive stochastic optimization algorithms like RMSprop and Adam. Here, we study its mechanism in details. Pursuing the theory behind warmup, we identify a problem of the ad…