On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

count % of corpus

10 results for “multi-expert”

When More Experts Hurt: Underfitting in Multi-Expert Learning to Defercs.LG

Multi-expert L2D underfits more severely, requiring new methods.

problem Underfitting in multi-expert L2D settings.

method PiCCE (Pick the Confident and Correct Expert), a surrogate-based method.

result PiCCE effectively reduces multi-expert L2D to a single-expert-like problem, resolving underfitting.

multi-expert learning underfitting Pick the Confident and Correct Expert surrogate-based method statistical consistency

2026-02-19abs ↗pdf ↗

Beyond Augmented-Action Surrogates for Multi-Expert Learning-to-Deferstat.ML

A new method for multi-expert learning-to-defer avoids optimization issues.

problem Optimization issues in multi-expert learning-to-defer systems.

method A decoupled surrogate with a softmax classifier head and independent sigmoid heads per expert.

result First multi-expert L2D guarantee with a constant not growing with the expert pool.

learning-to-defer multi-expert decoupled surrogate optimization issues CIFAR-10

2026-04-10abs ↗pdf ↗

Theory and Algorithms for Learning with Multi-Class Abstention and Multi-Expert Deferralcs.LG

This thesis tackles learning with multi-class abstention and multi-expert deferral, improving model reliability and efficiency.

problem Improving model reliability and efficiency in large language models (LLMs) by leveraging multiple experts.

method Developed new surrogate losses and consistency guarantees for multi-class classification and regression with deferral.

result Strong consistency guarantees for surrogate losses in multi-class classification and regression with deferral.

Large Language Models Multi-Class Classification Multi-Expert Deferral Surrogate Losses Consistency Guarantees

2025-12-28abs ↗pdf ↗

Simultaneous Long-tailed Recognition and Multi-modal Fusion for Highly Imbalanced Multi-modal Datacs.CV

Framework for handling long-tailed multi-modal data.

problem Class imbalance and long-tailed distributions in multi-modal data.

method Multi-expert architecture with modality-specific networks and dynamic fusion weights.

result Framework outperforms existing methods in long-tailed, class-imbalanced scenarios.

long-tailed recognition multi-modal fusion class imbalance deep learning multi-expert architecture

2026-05-11abs ↗pdf ↗

Why Ask One When You Can Ask

k

? Learning-to-Defer to the Top-

k

Expertscs.LG

Unified framework for deferring queries to top-k experts, improving accuracy-cost trade-offs.

problem Limitation of existing L2D frameworks to single-expert deferral.

method Top-

k

Learning-to-Defer framework, including adaptive Top-

k(x)

variant.

result Superior accuracy-cost trade-offs with multi-expert deferral.

Learning-to-Defer Top-k Experts Multi-Expert Collaboration Surrogate Loss Bayes-consistency

2025-04-17abs ↗pdf ↗

Regression with Multi-Expert Deferralcs.LG

A novel framework for regression with multiple experts, addressing challenges in infinite and continuous label spaces.

problem Challenges in regression with multiple experts due to the infinite and continuous nature of the label space.

method Introduces a novel framework for regression with deferral, analyzing both single-stage and two-stage scenarios with new surrogate loss functions.

result Proves

H

-consistency bounds for both single-stage and two-stage methods, providing stronger guarantees than Bayes consistency.

Regression Multi-Expert Deferral Consistency Bounds Surrogate Loss Functions Infinite Label Space

2024-03-28abs ↗pdf ↗

Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offsstat.ML

This study analyzes communication constraints in MoE architectures using information theory.

problem Communication constraints in Mixture-of-Experts (MoE) architectures.

method Developed a rate-distortion characterization of finite-rate gating in MoE architectures using information theory.

result Yielded capacity-aware limits for communication-constrained MoE systems.

Mixture-of-Experts Finite-Rate Gating Communication-Constraints Information Theory Generalization Bound

2026-02-16abs ↗pdf ↗

A Two-Stage Learning-to-Defer Approach for Multi-Task Learningstat.ML

A new framework integrates classification and regression tasks in multi-task learning.

problem Jointly solving classification and regression tasks in multi-task scenarios.

method Two-Stage Learning-to-Defer (L2D) framework with a unified deferral mechanism.

result Unified deferral mechanism ensures convergence to the Bayes-optimal rejector.

multi-task learning classification regression Bayes-consistency L2D

2024-10-21abs ↗pdf ↗

Step-by-Step Causality: Transparent Causal Discovery with Multi-Agent Tree-Query and Adversarial Confidence Estimationcs.LG

Tree-Query uses LLMs to discover causal relationships in a transparent, interpretable manner.

problem Error propagation in classical causal discovery methods and opaque, confidence-free behavior of recent LLM-based causal oracles.

method Tree-Query is a tree-structured, multi-expert LLM framework that reduces causal discovery to queries about backdoor paths and dependencies.

result Tree-Query provides interpretable judgments with robustness-aware confidence scores and improves structural metrics over LLM baselines.

causal discovery multi-agent tree-query backdoor paths confidence estimation

2026-01-15abs ↗pdf ↗

Generative Stochastic Optimal Transport: Guided Harmonic Path-Integral Diffusioncs.LG

GH-PID uses guided harmonic paths for efficient SOT with interpretable diagnostics.

problem Efficiently solving Stochastic Optimal Transport with hard terminal distributions and soft costs.

method Guided Harmonic Path-Integral Diffusion (GH-PID) framework with low-dimensional guidance.

result GH-PID generates geometry-aware, cost-reducing trajectories that match terminal distributions.

Stochastic Optimal Transport Guided Harmonic Paths Interpretable Diagnostics Low-Dimensional Guidance Geometry-Aware Trajectories

2025-12-05abs ↗pdf ↗