Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

4859711,4561,941 · Jun 202019922001200920172026
48 results for Learning from Mistakes

Ahpatron improves online kernel learning with tighter mistake bounds.

problem Improving mistake bounds in online kernel learning with budget constraints.
method Introducing Ahpatron, a new model that uses an aggressive updating rule and a budget maintenance mechanism to approximate AVP.
result Ahpatron achieves tighter mistake bounds compared to previous models.

The paper studies how noisy labels impact decision-making in machine learning.

problem The impact of noisy labels on decision-making in machine learning.
method Introducing a notion of regret, studying standard approaches, and estimating individual-level mistakes.
result Standard approaches can lead to unforeseen mistakes for individuals, revealing the need for anticipation.

A deterministic apple tasting learner is developed, confirming a conjecture and providing tight bounds for mistake bounds.

problem Determining the learnability of hypothesis classes in binary online classification with apple tasting feedback.
method Developed a deterministic apple tasting learner and proved tight bounds for mistake bounds.
result Deterministic apple tasting is feasible and provides tight bounds for mistake bounds.

LEAK learns from mistakes to improve point cloud segmentation.

problem Improving point cloud semantic segmentation performance.
method Coarse-to-fine clustering, class-conditional prototypical feature alignment, fairness weighting.
result State-of-the-art performances on different architectures, datasets, and tasks.

Open problem seeks an online learning algorithm for binary classification.

problem Existence of an online learning algorithm for binary classification with sublinear mistakes.
method Assumption of sequence allowing learning algorithm's existence.
result Specific condition determines sequence's learnability.

Study on tradeoffs between mistakes and ERM oracle calls in online and transductive learning.

problem Analyzing online and transductive learning with limited ERM and weak consistency oracle access.
method Proves lower bounds and upper bounds on mistakes and oracle calls, considering realizable and agnostic cases.
result Achieves optimal mistake bounds with weak consistency queries for certain concept classes.

Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new technique as multiple times weight updating that update the weight iteratively forsame instance. The proposed technique analyzed with popular state-of-art algorithms from …

2018-10-26abs ↗pdf ↗

Study on learning to predict dynamical systems without assuming their structure.

problem Learning to predict the next state of a dynamical system with unknown evolution function.
method Defined new combinatorial measures to quantify mistake and regret bounds in realizable and agnostic settings.
result In the realizable setting, the number of mistakes can grow arbitrarily with time.

We investigate the problem of active learning on a given tree whose nodes are assigned binary labels in an adversarial way. Inspired by recent results by Guillory and Bilmes, we characterize (up to constant factors) the optimal placement of queries so to minimize the mistakes made on the non-queried nodes. Our query se…

2013-01-22abs ↗pdf ↗

Study apple tasting feedback in online binary classification, providing new insights into minimax expected mistakes.

problem Online binary classification with partial feedback (apple tasting).
method Combinatorial analysis, Littlestone dimension, Effective width.
result Established a trichotomy of minimax expected mistakes in the realizable setting.

Modified Perceptron handles strategic agents with limited position changes.

problem Learning linear classifiers in the presence of strategic agents that can manipulate their positions.
method Developed a modified Perceptron algorithm with bounded mistakes under various manipulation costs.
result The modified Perceptron achieves bounded mistakes even when manipulation costs are unknown.

Study the tradeoffs of bandit feedback in multiclass classification.

problem The price of using bandit feedback in multiclass classification.
method Mistake bound model, analysis of variants, and comparison of learners and adversaries.
result The optimal mistake bound under bandit feedback is at most O(k)O(k) times higher than in full information, with a tight bound of O(k)O(k).

New algorithm tackles multiclass transductive online learning with unbounded labels.

problem Characterizing optimal mistake bound for unbounded label spaces.
method Introducing new combinatorial dimensions (Level-constrained Littlestone and Branching dimensions) to characterize online learnability.
result Established trichotomy of possible minimax rates for unbounded label spaces: Θ(T)Θ(T), Θ(logT)Θ(\log T), or Θ(1)Θ(1).

Study selective classification with limited feedback in online learning.

problem Resource-limited and safety-critical domains where feedback is only received on abstentions.
method Versioning-based schemes for minimizing mistakes and abstentions.
result Constructed schemes that make few mistakes and minimal excess abstentions.

We study the multiclass online learning problem where a forecaster makes a sequence of predictions using the advice of nn experts. Our main contribution is to analyze the regime where the best expert makes at most bb mistakes and to show that when b=o(log4n)b = o(\log_4{n}), the expected number of mistakes made by the optima…

2018-07-30abs ↗pdf ↗

Improved Markov models learn from their mistakes and adapt to problem complexity.

problem Limitations of standard masked discrete diffusion models in reasoning tasks.
method Learning a Markov transition kernel trained on its own outputs, allowing remasking and adaptation.
result Significant improvement in solving reasoning problems, especially Sudoku-Extreme and Countdown-4.

Thompson Sampling is at most twice as bad as any other policy in Bayesian bandit models.

problem Optimizing selection of the best arm in Bayesian bandit models with independent latent processes.
method Thompson Sampling approach applied to models with independent latent arm processes.
result Thompson Sampling makes at most twice the expected number of mistakes compared to any other policy.

Adversarial machine learning is a fast growing research area, which considers the scenarios when machine learning systems may face potential adversarial attackers, who intentionally synthesize input data to make a well-trained model to make mistake. It always involves a defending side, usually a classifier, and an atta…

2018-10-16abs ↗pdf ↗

Study online learning of quantum processes, showing feasibility for certain types.

problem Learning quantum processes adaptively, especially for bounded gate complexity and Pauli channels.
method Online learning, mistake-bounded model, multiplicative weights update algorithm, Bell sampling.
result Online learning feasible for quantum channels of bounded gate complexity and Pauli channels.

This note corrects the mistakes in the splicing formulas of the paper "Floer homology and splicing knot complements". The mistakes are the result of the incorrect assumption that for a knot KK inside a homology sphere YY, the involution on the knot Floer homology of KK which corresponds to moving the basepoints by o…

2017-10-28abs ↗pdf ↗

Gaptron algorithm reduces mistakes in online multiclass classification.

problem Online multiclass classification with limited information.
method Randomized first-order algorithm exploiting the gap between zero-one loss and surrogate losses.
result First linear time algorithm with O(KT)O(K\sqrt{T}) expected regret.

New framework models echo chamber learning, proving tight bounds on algorithm performance.

problem Echo chambers in machine learning where systems learn from self-annotated data.
method Online Learning in the Replay Setting, Extended Threshold dimension, closure-based learner.
result Proves tight bounds on algorithm performance against replay adversaries.

Efficient algorithm for online learning with Massart noise achieves near-optimal mistake bound.

problem Online learning with adversarial context and Massart noise.
method Developed an efficient algorithm for γγ-margin linear classifiers in the presence of Massart noise.
result Achieved a mistake bound of ηT+o(T)ηT + o(T) for the online learning model.

Study robust online learning with adversarial perturbations.

problem Learning robust classifiers in the presence of adversarial perturbations.
method Formulated as an online learning problem, considered both realizable and agnostic learnability, defined new dimension controlling mistake/regret bounds.
result Showed new dimension controls mistake/regret bounds, generalized to multiclass hypothesis classes.

New robust algorithms improve learning with feature feedback.

problem Interactive learning with discriminative feature feedback.
method Developed new robust interactive learning algorithms with improved mistake bounds.
result Achieved significantly lower mistake bounds in adversarial and stochastic settings.

New bounds show simple predictors can learn complex concepts online.

problem When can simple predictors learn complex concepts in online learning?
method Characterized optimal mistake bounds for online learning with simple predictors.
result Achieved nearly optimal mistake bounds for online learning using sparse majority-vote of proper predictors.

John Morgan and G,Tian pointed out a mistake in the concluding argument for our paper entitled "C1C_1 in [2] is zero", which was recently published in arXiv:1512.02098. We hereby acknowledge this mistake and correct the computation, leading to the conclusion that C1C_1 is non-zero and that their reference [2] does inde…

2015-12-09abs ↗pdf ↗