Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2356 · Mar 201919922001200920172026
48 results for early-stage

A new method reduces variance in training early-stage rankers for large-scale search systems.

problem Training early-stage rankers for large-scale search systems is challenging due to exploding variance in policy gradient methods.
method Proposes credit-assigned policy gradient (CA-PG) to mitigate variance in training early-stage rankers.
result CA-PG significantly reduces variance in training early-stage rankers compared to vanilla policy gradient.

Study evaluates early-stage cybersecurity firms' performance using Crunchbase data.

problem Assessing performance of early-stage cybersecurity startups.
method Empirical analysis of 19 cybersecurity sectors using Crunchbase data.
result Significant variations in capital raised and post-money valuations across cybersecurity sectors.

Machine learning detects subtle glucose changes for early diabetes diagnosis.

problem Challenging early-stage diabetes diagnosis due to subtle glucose changes.
method Applied machine learning to synthetic glucose profiles generated by a biophysical model.
result High accuracy (above 85%) in detecting insulin resistance using various neural networks.

A game-theoretic framework identifies influential hyperparameters for neural networks.

problem Understanding which hyperparameters are most important for neural network performance.
method Employing Shapley Effects for global sensitivity analysis and Pareto front sets for identifying effective configurations.
result Reveals which hyperparameters are most influential for different objectives in neural networks.

Enhances diffusion models by preprocessing data to improve reconstruction quality.

problem Slow sampling and poor reconstruction quality in diffusion models, especially for small-scale networks.
method Applying Gaussianization preprocessing to the training data to make the target distribution more Gaussian-like.
result Improves generation quality, especially in the early stages of reconstruction with small networks.

Gradient descent learns useful features even in the NTK regime.

problem The ability of neural networks to learn useful features.
method Local convergence analysis of gradient descent with regularization.
result Gradient descent can capture ground-truth directions for feature learning even after the loss threshold is reached.

Gradient descent reshapes the function space of neural networks.

problem Understanding how feature learning affects the function space of neural networks.
method Characterized the evolution of the feature space during training using a two-layer neural network.
result Gradient descent induces a data-adaptive deformation that selectively enhances signal-aligned directions.

Improves classifier performance in multi-stage processes with adversarial autoencoders and multi-task learning.

problem Challenges in training classifiers due to varying sample sizes and information content across stages.
method Combines adversarial autoencoders, multi-task learning, and semi-supervised learning to address underfitting and overfitting.
result Our approach outperforms state-of-the-art methods across different domains.

ABS dynamically adjusts batch size based on policy stability, improving RL performance.

problem Diminishing returns with large batch sizes in RL due to non-stationary data.
method Adaptive Batch Scaling (ABS) with Behavioral Divergence metric.
result Larger batch sizes can improve RL performance, contrary to conventional wisdom.

The paper analyzes CFG in masked diffusion models and proposes a new method to improve sample quality.

problem Improving sample quality in conditional generation with CFG in masked diffusion models.
method Analyzing CFG's effect in a low-dimensional masked diffusion model, revealing early-stage guidance harms quality and late-stage improves it. Proposed a novel method to smooth transitions between distributions.
result The proposed method improves sample quality via a simple one-line code change.

Improves classifier performance in multi-stage selection processes.

problem Difficulty in training classifiers in multi-stage selection processes due to varying sample sizes and information.
method Multi-Stage Transfer Learning (MSGTL) approach that uses knowledge from simpler classifiers trained in early stages to improve later stages.
result MSGTL outperforms other transfer learning methods in real-world selection process data.

Examines learning efficiency in neural networks and related models.

problem Analyzing efficiency in deep learning models with singular learning coefficients.
method Examined learning coefficients in neural networks and three-layer neural networks with ReLU units.
result Extended results to include Softmax function, providing a broader understanding of learning efficiency.

Study predicts risk of true-lumen narrowing after ATAAD surgery using CT data.

problem Early post-surgery risk assessment for aortic dissection patients.
method Retrospective study with CT data, derived cross-sectional shapes, form factor (FF) for morphology assessment, linear discriminant analysis (LDA) for risk classification, LOPO-CV for prediction.
result Machine-learning model accurately predicts risk for all high-risk patients and low-risk patients, potentially reducing hospital visits.

We apply our statistically deterministic machine learning/clustering algorithm *K-means (recently developed in https://ssrn.com/abstract=2908286) to 10,656 published exome samples for 32 cancer types. A majority of cancer types exhibit mutation clustering structure. Our results are in-sample stable. They are also out-o…

2017-07-26abs ↗pdf ↗

We analyze the sectoral dynamics of startup venture financing. Based on a dataset of 52000 start-ups and 110000 funding rounds in the United States from 2000 to 2017, and by applying both Principal Component Analysis (PCA) and Tensor Component Analysis (TCA) in sector space, we visualize and measure the evolution of th…

2019-06-05abs ↗pdf ↗

We study ranking quantilized mean-field games to select top-performing agents.

problem Selecting top-performing agents in competitive scenarios.
method Developed two formulations: target-based and threshold-based, and provided analytic and semi-explicit solutions.
result Analytic and semi-explicit solutions for quantilized mean-field consistency conditions.

We study the problem of finding the optimal dosage in early stage clinical trials through the multi-armed bandit lens. We advocate the use of the Thompson Sampling principle, a flexible algorithm that can accommodate different types of monotonicity assumptions on the toxicity and efficacy of the doses. For the simplest…

2019-03-17abs ↗pdf ↗

Student performance prediction - where a machine forecasts the future performance of students as they interact with online coursework - is a challenging problem. Reliable early-stage predictions of a student's future performance could be critical to facilitate timely educational interventions during a course. However, …

2018-04-19abs ↗pdf ↗

The learning rate warmup heuristic achieves remarkable success in stabilizing training, accelerating convergence and improving generalization for adaptive stochastic optimization algorithms like RMSprop and Adam. Here, we study its mechanism in details. Pursuing the theory behind warmup, we identify a problem of the ad…

2019-08-08abs ↗pdf ↗

Early training of deep neural networks leads to small, directionally converging weights.

problem Training dynamics of deep homogeneous neural networks with small initializations.
method Gradient flow analysis and study of KKT points for neural correlation function.
result Weights converge in direction to KKT points during early training stages.

Machine learning accurately diagnoses cancer from whole genome sequencing data.

problem Accurate cancer diagnosis at all stages.
method Novel MLAC (Machine Learning Against Cancer) method using next-gen RNA sequencing.
result Perfect precision, sensitivity, and specificity achieved for most tumor types.

It is typical for a machine learning system to have numerous hyperparameters that affect its learning rate and prediction quality. Finding a good combination of the hyperparameters is, however, a challenging job. This is mainly because evaluation of each combination is extremely expensive computationally; indeed, train…

2019-07-19abs ↗pdf ↗

Following the thermodynamic formulation of multifractal measure that was shown to be capable of detecting large fluctuations at an early stage, here we propose a new index which permits us to distinguish events like financial crisis in real time . We calculate the partition function from where we obtain thermodynamic q…

2012-04-14abs ↗pdf ↗

The paper analyzes neural network dynamics after weights escape the origin.

problem Understanding gradient flow dynamics of neural networks after the origin.
method Analyzes gradient flow of homogeneous neural networks with locally Lipschitz gradients.
result Characterizes the first saddle point encountered after escaping the origin.

Adaptive importance sampling (AIS) uses past samples to update the \textit{sampling policy} qtq_t at each stage tt. Each stage tt is formed with two steps : (i) to explore the space with ntn_t points according to qtq_t and (ii) to exploit the current amount of information to update the sampling policy. The very funda…

2018-06-04abs ↗pdf ↗

Data augmentation improves financial prediction models, especially for small datasets.

problem Improving financial prediction models on small, noisy, non-stationary datasets.
method Evaluation of data augmentation methods combined with deep learning models on financial datasets.
result Data augmentation significantly improves financial performance, up to 400% improvement in risk-adjusted return.