Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

1122 · Dec 201819922001200920172026
12 results for margin-theory

New findings show the large margins theory is insufficient for explaining ensemble methods.

problem Explaining the performance of ensemble methods, especially boosting.
method Illustrated by counterexamples that show how to improve margin distribution without improving test set performance.
result The large margins theory is not sufficient to explain the performance of ensemble methods.

We present a new boosting algorithm, motivated by the large margins theory for boosting. We give experimental evidence that the new algorithm is significantly more robust against label noise than existing boosting algorithm.

2009-05-13abs ↗pdf ↗

The paper improves robust optimization by introducing margin theory.

problem Improving the reliability of solutions in high-dimensional robust optimization.
method Introducing margin theory to improve sample complexity and reliability of solutions.
result The sample complexity of a class of random programs does not depend on the number of variables.

Paper improves forest representation learning by optimizing margin distribution.

problem Improving generalization gap in forest representation learning.
method Reformulated as an additive model, optimizing margin distribution ratio λ.
result Substantially improved upper bound of generalization gap from O(√(ln m / m)) to O((ln m) / m).

Weisfeiler-Leman struggles with graph isomorphism; enhanced architectures improve generalization.

problem Graph isomorphism problem and limited expressivity of 11-WL.
method Augmenting 11-WL and MPNNs with subgraph information, employing margin theory, and introducing provable generalization kernels.
result Increased expressivity of graph neural networks and kernels does not necessarily correlate with improved generalization performance.

We propose a new active learning strategy designed for deep neural networks. The goal is to minimize the number of data annotation queried from an oracle during training. Previous active learning strategies scalable for deep networks were mostly based on uncertain sample selection. In this work, we focus on examples ly…

2018-02-27abs ↗pdf ↗

Ant colonies and boosting algorithms both reduce bias and variance through adaptive mechanisms.

problem Understanding the mathematical principles behind ensemble learning and ant colony behavior.
method Developed a formal mapping between AdaBoost's adaptive reweighting and ant recruitment dynamics.
result Proved that the fundamental theorem of weak learnability has a direct analog in colony decision-making.