Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3496981,0471,396 · Jun 202019922001200920172026
48 results for algorithm improvement

Improved first-order algorithm for entropy regularized OT with faster convergence.

problem Solving entropy regularized optimal transport efficiently.
method Accelerated primal-dual stochastic mirror descent algorithm with variance reduction.
result Improved rate from O~(n2.5/ε)\widetilde{O}({n^{2.5}}/ε) to O~(n2/ε)\widetilde{O}({n^2}/ε).

Efficient algorithms improve learning of large-margin halfspaces.

problem Learning large-margin halfspaces efficiently and reproducibly.
method Design of efficient, dimension-independent, polynomial-time algorithms; SGD-based approach; DP-to-Replicability reduction.
result Improved sample complexity compared to previous algorithms, with optimal sample complexity for one algorithm.

In this paper, we analyze a generic algorithm scheme for sequential global optimization using Gaussian processes. The upper bounds we derive on the cumulative regret for this generic algorithm improve by an exponential factor the previously known bounds for algorithms like GP-UCB. We also introduce the novel Gaussian P…

2013-11-19abs ↗pdf ↗

Improved neural active learning algorithms reduce regret and improve performance.

problem Improving performance and reducing regret in neural active learning for non-parametric streaming data.
method Introducing two new regret metrics and leveraging NNs for both exploitation and exploration. The algorithm uses tailored query decision-makers and full feedback.
result Achieved an instance-dependent regret upper bound improving by a multiplicative factor of O(logT)O(\log T) and removing the curse of dimensionality.

Improves algorithmic recourse to guide towards both acceptance and improvement.

problem Algorithmic recourse recommendations may not lead to improvement.
method Improvement-Focused Causal Recourse (ICR) requires recommendations to guide towards improvement and leverages causal knowledge to design accurate decision systems.
result ICR guides towards both acceptance and improvement given correct causal knowledge.

Unified framework for policy improvement in RL with benefits in data efficiency and computation.

problem Improving data efficiency and computation in reinforcement learning for continuous control.
method Local, regularized policy improvement with tree search for continuous action spaces.
result Improves data efficiency and reduces wall-clock time in high-dimensional domains.

Improves online learning with expert demonstrations, quality matters.

problem Improving online learning through offline demonstration data.
method Thompson sampling applied to a multi-armed bandit model, informed by expert demonstrations and Bayes' rule.
result Substantial empirical regret reduction with expert demonstrations, improving online performance.

SIBRE boosts reinforcement learning convergence by rewarding improvement over past performance.

problem Improving the rate of convergence in reinforcement learning.
method SIBRE is a reward shaping approach that rewards improvement over the agent's own past performance.
result SIBRE converges faster and more stably to the optimal policy compared to baseline RL algorithms.

Improved RL algorithm stabilizes unknown linear systems with polynomial regret.

problem Learning and stabilizing unknown linear dynamical systems.
method Proposes an algorithm with an improved exploration strategy for fast stabilization.
result Achieves ildeO(T) ilde{\mathcal{O}}(\sqrt{T}) regret after TT time steps.

Local Linear embedding (LLE) is a popular dimension reduction method. In this paper, we first show LLE with nonnegative constraint is equivalent to the widely used Laplacian embedding. We further propose to iterate the two steps in LLE repeatedly to improve the results. Thirdly, we relax the kNN constraint of LLE and p…

2012-06-27abs ↗pdf ↗

We improve the efficiency of algorithms for stochastic \emph{combinatorial semi-bandits}. In most interesting problems, state-of-the-art algorithms take advantage of structural properties of rewards, such as \emph{independence}. However, while being optimal in terms of asymptotic regret, these algorithms are inefficien…

2019-02-11abs ↗pdf ↗

The paper proposes calibration to improve algorithm performance using machine learning predictions.

problem Improving real-world performance of online algorithms with machine learning predictions.
method Calibration as a tool to bridge the gap between prediction uncertainty and algorithm design.
result Calibrated advice leads to more effective guidance in high-variance settings and significant performance improvements in real-world data.

The expected improvement (EI) algorithm is a popular strategy for information collection in optimization under uncertainty. The algorithm is widely known to be too greedy, but nevertheless enjoys wide use due to its simplicity and ability to handle uncertainty and noise in a coherent decision theoretic framework. To pr…

2017-05-29abs ↗pdf ↗

Quantum UCB algorithm reduces reinforcement learning regret exponentially.

problem Episodic reinforcement learning with quantum state evolution.
method Upper Confidence Bound (UCB) quantum algorithm with quantum mean estimation.
result Exponential improvement in regret from $\Tilde{\mathcal{O}}(\sqrt{K})$ to $\Tilde{\mathcal{O}}(1)$.

New algorithm improves robustness by more regularization on less robust samples.

problem Improving robustness against adversarial attacks.
method Proposes a new adversarial training algorithm that applies more regularization to data vulnerable to adversarial attacks.
result Empirically superior to other existing algorithms, achieving state-of-the-art performance in generalization and robustness.

We present an accelerated algorithm for hierarchical density based clustering. Our new algorithm improves upon HDBSCAN*, which itself provided a significant qualitative improvement over the popular DBSCAN algorithm. The accelerated HDBSCAN* algorithm provides comparable performance to DBSCAN, while supporting variable …

2017-05-20abs ↗pdf ↗

Compressed Counting (CC) [22] was recently proposed for estimating the ath frequency moments of data streams, where 0 < a <= 2. CC can be used for estimating Shannon entropy, which can be approximated by certain functions of the ath frequency moments as a -> 1. Monitoring Shannon entropy for anomaly detection (e.g., DD…

2012-05-09abs ↗pdf ↗

The famous Policy Iteration algorithm alternates between policy improvement and policy evaluation. Implementations of this algorithm with several variants of the latter evaluation stage, e.g, nn-step and trace-based returns, have been analyzed in previous works. However, the case of multiple-step lookahead policy impr…

2018-02-10abs ↗pdf ↗

A new method for high-dimensional Bayesian optimization.

problem Challenges in extending BO to high dimensions.
method Expected Coordinate Improvement (ECI) criterion for high-dimensional Bayesian optimization.
result Significantly better results than standard BO and competitive results with state-of-the-art methods.

Improved variational inequality algorithms using adaptive step sizes.

problem Solving monotone variational inequalities and convex-concave min-max problems efficiently.
method Adaptive step sizes that eliminate hyperparameters and global Lipschitz continuity requirements.
result Eliminated the need for the golden ratio in the algorithm and improved complexity bounds.

Improved online learning for fuzzy min-max neural networks.

problem Classification performance issues due to expansion and contraction steps.
method Proposes an improved online learning algorithm without contraction for overlapping hyperboxes.
result Significant improvement in classification accuracy and stability.

Improved DP optimization for nonconvex, nonsmooth objectives with reduced sample complexity.

problem Differentially private optimization of nonconvex, nonsmooth objectives.
method Proposes single-pass and multi-pass DP algorithms with improved sample complexity.
result Sample complexity bounds improved by factors of Ω(d)Ω(\sqrt{d}) and Ω(d3/4)Ω(d^{3/4}).

New algorithms improve performance guarantees for multi-armed bandits problems.

problem Allocating effort under uncertainty in scenarios like investing research effort.
method Proposed two new families of bandit algorithms with stronger guarantees.
result Achieved optimal dependence on k with additional properties of arm reward curves.

New algorithms improve privacy-preserving data release using external predictions.

problem Privacy-preserving data release with improved utility using external information.
method Learning-augmented algorithms for multiple quantile release.
result Error guarantees scale with prediction quality, almost recovering state-of-the-art guarantees.

Improved zeroth-order algorithms tackle nonconvex minimax problems with reduced complexity.

problem Nonconvex minimax optimization problems in machine learning.
method Design and analysis of Zeroth-Order Gradient Descent Ascent ( exttt{ZO-GDA}) and Zeroth-Order Gradient Descent Multi-Step Ascent ( exttt{ZO-GDMSA}) algorithms.
result Oracle complexity improvements for minimax optimization problems.

New algorithms improve multi-task bandit performance by transferring reward samples.

problem Sequential multi-task bandit problems with adjacent similar tasks.
method Two UCB-based algorithms that transfer reward samples between tasks.
result Transfer of reward samples reduces overall regret compared to no transfer.