Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2356 · Oct 202519922001200920172026
48 results for Token-Level Deferral

New L2D framework allows deferring specific parts of a sequence prediction to experts.

problem Current L2D methods defer entire predictions, which is not ideal for long sequences.
method Proposes token-level and one-time rejectors to defer specific outputs of a model prediction to experts.
result Granular deferrals achieve better cost-accuracy tradeoffs than whole deferrals.

Framework for deferring decisions to experts in sequential medical settings.

problem Myopic and non-adaptive decision-making by ML models in sequential medical contexts.
method Sequential Learning-to-Defer (SLTD) framework using model-based reinforcement learning.
result Adaptive deferral policy improves trade-off between long-term outcomes and deferral frequency.

This paper tackles deferral learning with multiple experts, providing strong theoretical guarantees.

problem Optimizing input assignment to experts balancing accuracy and computational cost.
method Introducing new surrogate loss functions and efficient algorithms with strong theoretical learning guarantees.
result Realizable HH-consistency, HH-consistency bounds, and Bayes-consistency for deferral learning.

Optimized deferral improves accuracy in imbalanced settings.

problem Imbalance in expert predictions leads to suboptimal performance in two-stage learning to defer.
method Developed novel cost-sensitive learning algorithms and margin-based loss functions tailored for expert imbalance.
result MILD algorithm shows clear improvements over baselines in image classification and LLM routing tasks.

This thesis tackles learning with multi-class abstention and multi-expert deferral, improving model reliability and efficiency.

problem Improving model reliability and efficiency in large language models (LLMs) by leveraging multiple experts.
method Developed new surrogate losses and consistency guarantees for multi-class classification and regression with deferral.
result Strong consistency guarantees for surrogate losses in multi-class classification and regression with deferral.

Improves accuracy and fairness in prediction systems with multiple domain experts.

problem Designing unbiased and accurate deferral systems with multiple experts.
method Proposes a framework for learning a classifier and deferral system that chooses to defer to multiple human experts.
result Significantly improves accuracy and fairness of final predictions compared to baselines.

A novel framework for regression with multiple experts, addressing challenges in infinite and continuous label spaces.

problem Challenges in regression with multiple experts due to the infinite and continuous nature of the label space.
method Introduces a novel framework for regression with deferral, analyzing both single-stage and two-stage scenarios with new surrogate loss functions.
result Proves HH-consistency bounds for both single-stage and two-stage methods, providing stronger guarantees than Bayes consistency.

Topic models are typically evaluated with respect to the global topic distributions that they generate, using metrics such as coherence, but without regard to local (token-level) topic assignments. Token-level assignments are important for downstream tasks such as classification. Even recent models, which aim to improv…

2019-05-18abs ↗pdf ↗

Proposes integrating global and local entropy for more reliable LLMs.

problem Uncertainty in large language models (LLMs) leads to unreliable predictions.
method Measures global uncertainty from hidden-state matrices and local uncertainty from tokens, combining them via a multiplicative gate.
result Global-Local Uncertainty (GLU) outperforms unsupervised baselines across multiple models and benchmarks.

The task of Natural Language Inference (NLI) is widely modeled as supervised sentence pair classification. While there has been a lot of work recently on generating explanations of the predictions of classifiers on a single piece of text, there have been no attempts to generate explanations of classifiers operating on …

2019-04-24abs ↗pdf ↗

Unified framework for deferring queries to top-k experts, improving accuracy-cost trade-offs.

problem Limitation of existing L2D frameworks to single-expert deferral.
method Top-kk Learning-to-Defer framework, including adaptive Top-k(x)k(x) variant.
result Superior accuracy-cost trade-offs with multi-expert deferral.

Uncertainty estimation is important for ensuring safety and robustness of AI systems. While most research in the area has focused on un-structured prediction tasks, limited work has investigated general uncertainty estimation approaches for structured prediction. Thus, this work aims to investigate uncertainty estimati…

2020-02-18abs ↗pdf ↗

Language models perform worse with implicit reward models than explicit ones.

problem Understanding why implicit reward models generalize worse than explicit ones.
method Investigated the root cause of the generalization gap between IM-RMs and EX-RMs.
result Implicit reward models rely more on superficial token-level cues, leading to worse generalization.

DOS improves language model generation by considering inter-token dependencies.

problem Lack of sequence-level information and inter-token dependencies in existing decoding strategies.
method Dependency-Oriented Sampler (DOS) that uses attention matrices to approximate inter-token dependencies.
result DOS consistently achieves superior performance on code generation and mathematical reasoning tasks.

Charmer improves character-level adversarial attacks for language models.

problem Efficiency and effectiveness of character-level adversarial attacks for language models.
method Query-based adversarial attack method that maintains semantic similarity.
result Charmer achieves high attack success rate and similar adversarial examples.

A new sampler for FLMs improves token-level decoding controls.

problem Sampling from FLMs using standard methods collapses marginals and produces invalid sequences.
method Samples clean one-hot endpoints from FLM token marginals and uses Ornstein-Uhlenbeck bridges conditioned on these endpoints.
result The method preserves token-wise posterior-predictive marginals and improves quality-diversity tradeoff.

TROLL improves RL for LLMs by replacing clipping with a trust region projection.

problem Clipping in RL for LLMs causes instability and suboptimal performance.
method TROLL uses a discrete differentiable trust region projection to replace clipping, balancing computational cost and effectiveness.
result TROLL consistently outperforms PPO-like clipping in training speed, stability, and final success rates.

Efficiently estimates uncertainty for LLM-based entity linking in tabular data.

problem Accurate and reliable uncertainty estimates for LLM-based entity linking in tabular data.
method Self-supervised approach using token-level features for single-shot inference.
result Effective uncertainty estimates detected at a fraction of computational cost.

Language models allocate information storage, not collapsing into uniform representations.

problem Incomplete neural collapse in language model representations.
method Analyzing variance and information sharing across 14 models, proving an information floor.
result Within-class variance is allocated information storage, not collapsed into uniform representations.

This paper provides intuition on the relationship of accrual and mark-to-market valuation for cash and forward interest rate trades. Discounted cashflow valuation is compared to spread-based valuation for forward trades, which explains the trader's view on valuation. This is followed by Taylor series approximation for …

2016-02-18abs ↗pdf ↗

ECLIPSE detects AI hallucinations in finance with high accuracy.

problem Hallucinations in AI-generated answers limit safe deployment in finance.
method Combines entropy estimation and perplexity decomposition to measure model evidence use.
result ECLIPSE achieves ROC AUC of 0.89 and average precision of 0.90 on financial QA dataset.

This paper fine-tunes LLMs for stock return prediction using financial news.

problem Improving stock return forecasting accuracy using LLMs.
method Fine-tuning LLMs with text and forecasting modules, comparing encoder-only and decoder-only models, and integrating token-level representations.
result LLMs' aggregated token-level embeddings enhance return predictions for long-only and long-short portfolios.

This study explains RL training dynamics in LLMs, focusing on token-level optimization and reasoning pattern reshaping.

problem Understanding the training dynamics of RL in LLMs to improve their reasoning capabilities.
method Empirical analysis and theoretical modeling of RL training process, focusing on reasoning patterns and token optimization.
result RL primarily optimizes a sparse subset of critical tokens, reshaping reasoning pattern distributions and affecting model performance.

Extends conformal prediction for controlling expected risk of monotone loss functions.

problem Controlling expected risk of monotone loss functions.
method Generalizes split conformal prediction with coverage guarantee, extending to distribution shift, quantile risk, multiple, adversarial, and expectations of U-statistics.
result Tight up to an O(1/n)\mathcal{O}(1/n) factor, with worked examples in computer vision and natural language processing.

New framework improves adversarial robustness in one-stage L2D.

problem Adversarial robustness in one-stage Learning-to-Defer (L2D).
method Formalizes attacks, proposes cost-sensitive adversarial surrogate losses, establishes theoretical guarantees.
result Improves robustness against untargeted and targeted attacks while preserving clean performance.

Study on learning to defer with multiple experts using new surrogate losses.

problem Learning to defer with multiple experts in a machine learning context.
method Introducing a new family of surrogate losses for the multiple-expert setting, proving HH-consistency bounds, and designing learning algorithms.
result Explicit guarantees for new learning to defer algorithms based on minimization of these surrogate losses.

Generating logical form equivalents of human language is a fresh way to employ neural architectures where long short-term memory effectively captures dependencies in both encoder and decoder units. The logical form of the sequence usually preserves information from the natural language side in the form of similar token…

2018-07-19abs ↗pdf ↗

Quantum machine learning uses quantum cross entropy to minimize loss, but measurement loss affects this process.

problem Quantum machine learning's loss minimization through cross entropy is affected by measurement outcomes.
method Defined quantum cross entropy, proved its lower bounds, and investigated its relation to quantum fidelity and likelihood.
result Quantum cross entropy is lower-bounded by negative log-likelihood when derived from quantum data, but measurement outcomes can cause loss.

Existing attention mechanisms are trained to attend to individual items in a collection (the memory) with a predefined, fixed granularity, e.g., a word token or an image grid. We propose area attention: a way to attend to areas in the memory, where each area contains a group of items that are structurally adjacent, e.g…

2018-10-23abs ↗pdf ↗

Framework allows systems to defer difficult decisions to unknown experts.

problem Ensuring safety and robustness in autonomous systems with unknown human experts.
method Meta-learning approach that adapts to new experts at test-time using optimization and model-based attention mechanisms.
result Framework can quickly adapt deferral policies to new experts without re-training.

Through a short sale, a person borrows a share of stock from a lender, sells the borrowed share to a third person at the current price, and purchases an identical share in the market at a future date and at a future price to replace the borrowed share of stock. This only makes sense if the short seller anticipates a do…

2017-12-28abs ↗pdf ↗