Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

169337506674 · Jun 202019922001200920172026
48 results for Online Applications

Most traditional online learning algorithms are based on variants of mirror descent or follow-the-leader. In this paper, we present an online algorithm based on a completely different approach, tailored for transductive settings, which combines "random playout" and randomized rounding of loss subgradients. As an applic…

2011-06-13abs ↗pdf ↗

Transforms offline greedy algorithms to online algorithms for combinatorial problems.

problem Online decision-making in time-varying combinatorial environments.
method General framework using Blackwell approachability and Bandit Blackwell approachability.
result Achieves O(T)O(\sqrt{T}) regret in full information setting and O(T2/3)O(T^{2/3}) regret in bandit setting.

The paper tackles online resource allocation with uncertain coefficients and chance constraints.

problem Online stochastic resource allocation problem with chance constraints.
method Linearization and primal-dual algorithms with heuristic corrections.
result Optimality gap and constraint violation are on the order of √n.

Transforms offline algorithms to online with low regret in random order model.

problem Developing online algorithms with low approximate regret from offline approximation algorithms.
method General reduction theorem and coreset construction method.
result Achieves polylogarithmic ε-approximate regret for various online problems.

In online learning, the dynamic regret metric chooses the reference (optimal) solution that may change over time, while the typical (static) regret metric assumes the reference solution to be constant over the whole time horizon. The dynamic regret metric is particularly interesting for applications such as online reco…

2018-10-08abs ↗pdf ↗

New method uses offline data to improve online bandit learning, even when distributions differ.

problem Improving online bandit learning with different offline and online distributions.
method MIN-UCB policy that adapts to offline data when informative, achieving tight regret bounds.
result MIN-UCB policy outperforms UCB policy with offline data and provides tight regret bounds.

Online method selects candidates from data streams, ensuring irreversible decisions.

problem Conformal selection's incompatibility with irreversible decisions in online scenarios.
method Online Conformal Selection with Accept-to-Reject Changes (OCS-ARC) incorporating online Benjamini-Hochberg procedure.
result OCS-ARC controls FDR at or below nominal level, improving selection power.

As a testament to their success, the theory of random forests has long been outpaced by their application in practice. In this paper, we take a step towards narrowing this gap by providing a consistency result for online random forests.

2013-02-20abs ↗pdf ↗

New framework captures long-term decision dependence in online learning.

problem Long-term dependence on past decisions in online learning.
method Introduces Online Convex Optimization with Unbounded Memory (OCO-UMB) and pp-effective memory capacity.
result Proves O(HpT)O(\sqrt{H_p T}) upper bound on policy regret and matching lower bound.

Current online learning methods suffer issues such as lower convergence rates and limited capability to select important features compared to their offline counterparts. In this paper, a novel framework for online learning based on running averages is proposed. Many popular offline regularized methods such as Lasso, El…

2018-03-30abs ↗pdf ↗

Optimizes sampling from target distributions with applications to online learning.

problem Optimizing the total variation distance between target and sampled distributions.
method Analyzes the sample complexity of approximate rejection sampling and its applications.
result The optimal total variation distance is given by $ ildeΘ( rac{D}{f'(n)})$.

New online method for statistical inference with matrix context in decision-making.

problem Statistical inference in decision-making with matrix context.
method Proposes a fully online procedure to conduct statistical inference with adaptive data collection, handling low-rank structure.
result Establishes asymptotic normality of debiased estimators and proves validity of confidence intervals.

Proposes methods for online conformal prediction with nested prediction sets across multiple confidence levels.

problem Need for uncertainty quantification with multiple confidence levels in diverse applications.
method Online optimization perspective to enforce nestedness of prediction sets while controlling quantile estimation error.
result Achieves stable coverage across all levels, strictly nested prediction sets, and improved efficiency.

New framework for fair online allocation in continuous time with deadlines.

problem Fair allocation under deadlines in continuous-time online learning.
method Continuous-time utility maximization, dual ascent optimization for time averages.
result Achieves ildeO(B1/2) ilde{O}(B^{-1/2}) regret bound in the absence of statistical knowledge.

This work explains why online imitation learning improves faster than theory predicts.

problem Online imitation learning's empirical policy improvement speed exceeds theoretical predictions.
method The authors analyze online imitation learning with a convex, smooth, and non-negative loss function, proving policy improvement in expectation and high probability.
result Adopting a sufficiently expressive policy class in online IL increases both policy improvement speed and performance bias.

New algorithm reduces online decision-making regret with efficient LP re-solving and parallel first-order method.

problem Worse regret guarantees and high computational cost of LP-based OLP algorithms.
method Combines LP-based and first-order OLP methods, re-solving LP subproblems periodically and using parallel first-order method.
result Achieves O(log(T/f)+f)\mathscr{O}(\log (T/f) + \sqrt{f}) regret, balancing computational efficiency and superior regret guarantee.

FLeet improves online FL for mobile apps with better performance and privacy.

problem Federated Learning's offline nature limits its applicability for online updates.
method Combines staleness awareness and performance prediction with adaptive learning.
result 2.3x quality boost with minimal battery consumption.

Paper proposes a novel online transfer learning method to reduce domain discrepancy.

problem Online transfer learning with online distribution discrepancy minimization.
method The method seeks a new feature representation to simultaneously reduce marginal and conditional distribution discrepancies.
result The proposed method outperforms state-of-the-art methods in comprehensive experiments.

Regularized online learning is widely used in machine learning applications. In online learning, performing exact minimization (i.e.,i.e., implicit update) is known to be beneficial to the numerical stability and structure of solution. In this paper we study a class of regularized online algorithms without linearizing the…

2018-09-25abs ↗pdf ↗

Study on online regression with noise, achieving near-optimal regret bounds.

problem Online generalized linear regression with stochastic noise.
method Sharp analysis of FTRL algorithm for stochastic label noise.
result Achieved near-optimal regret bounds for O(σ2dlogT)+o(logT)O(σ^2 d \log T) + o(\log T).

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the observations are incrementally accrued, yet the demands of the application often…

2018-05-21abs ↗pdf ↗

Online detection of instantaneous changes in the generative process of a data sequence generally focuses on retrospective inference of such change points without considering their future occurrences. We extend the Bayesian Online Change Point Detection algorithm to also infer the number of time steps until the next cha…

2019-02-12abs ↗pdf ↗

Unified analysis of online optimization with self-concordant barriers, improving regret bounds.

problem Online convex optimization with specific loss functions.
method Online mirror descent with self-concordant barriers and logarithmic loss.
result Improved regret bounds for online portfolio selection and quantum state learning.

New method optimizes on curved manifolds without curvature dependence.

problem Curvature-dependent regret in online optimization on Hadamard manifolds.
method Riemannian online gradient descent for h-convex functions.
result Established O(T)O(\sqrt{T}) and O(log(T))O(\log(T)) regret guarantees, curvature-independent.

Unified analysis of tree-based methods for online reinforcement learning.

problem Designing efficient algorithms for online reinforcement learning with low sample complexity, storage, and computational burden.
method Unified theoretical analysis of tree-based hierarchical partitioning methods for online reinforcement learning.
result Our algorithms provide guarantees that scale with respect to the 'zooming dimension', improving upon ambient dimension scaling.

High-velocity streams of high-dimensional data pose significant "big data" analysis challenges across a range of applications and settings. Online learning and online convex programming play a significant role in the rapid recovery of important or anomalous information from these large datastreams. While recent advance…

2013-07-23abs ↗pdf ↗

Study online monotone density estimation with expert aggregation and log-optimal calibration.

problem Online monotone density estimation and log-optimal calibration.
method Proposed two online estimators: Grenander estimator and expert aggregation estimator.
result Online estimators achieve O(n1/3)O(n^{1/3}) cumulative log-likelihood gap and nlogn\sqrt{n\log{n}} pathwise regret bound.