Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

63125188250 · Jun 202019922001200920172026
48 results for Adversarial corruption

Algorithm maximizes total reward in multi-agent bandits with adversarial corruptions.

problem Maximizing total reward in multi-agent bandits with adversarial corruptions.
method Proposes a cooperative learning algorithm robust to adversarial corruptions.
result Demonstrates an additive O((L/Lmin)C)O((L / L_{\min}) C) regret term for an adversary with unknown corruption budget.

We extend the model of stochastic bandits with adversarial corruption (Lykouriset al., 2018) to the stochastic linear optimization problem (Dani et al., 2008). Our algorithm is agnostic to the amount of corruption chosen by the adaptive adversary. The regret of the algorithm only increases linearly in the amount of cor…

2019-09-04abs ↗pdf ↗

Monotone adversarial corruptions degrade optimal learning algorithms.

problem Optimal learning algorithms' reliance on exchangeability and independence is challenged.
method Introduces a monotone adversarial corruption model where an adversary adds monotone corruptions to a clean dataset.
result Optimal learning algorithms achieve suboptimal expected error on new test points.

New method tackles adversarial sign-corrupted isotonic regression, estimating monotonic signals under heavy dependence.

problem Estimating monotonic signals when responses are sign-corrupted and adversarially designed to violate monotonicity.
method Developed ASCIFIT, a three-step estimation procedure using PAVA with pre- and post-processing corrections.
result Theoretical guarantees of sharp high probability upper bounds and minimax lower bounds for ASCIFIT.

New algorithm reduces linear contextual bandit regret with adversarial corruption.

problem Linear contextual bandit with adversarial reward corruption.
method Optimism in the face of uncertainty principle, weighted ridge regression.
result Achieves nearly optimal regret for both corrupted and uncorrupted cases.

Analyzes biased random walks and corrupted intervals in adversarial settings.

problem Learning thresholds and intervals in adversarial conditions.
method Analyzes biased random walks and corrupted intervals under adversarial design.
result Analyzes the expected behavior of biased random walks and corrupted intervals.

We study the stochastic multi-armed bandits problem in the presence of adversarial corruption. We present a new algorithm for this problem whose regret is nearly optimal, substantially improving upon previous work. Our algorithm is agnostic to the level of adversarial contamination and can tolerate a significant amount…

2019-02-22abs ↗pdf ↗

RILA learns HQMMs robustly against adversarial corruption.

problem Robustness of HQMM learning algorithms under adversarial perturbations.
method Adversarially Corrupted HQMM (AC-HQMM) and Robust Iterative Learning Algorithm (RILA).
result RILA outperforms existing algorithms in convergence stability, corruption resilience, and physical validity.

Improved SGD for robust linear and ReLU regression with adversarial corruptions.

problem Robust regression with adversarial corruptions in streaming data.
method Stochastic gradient descent (SGD-exp) with exponentially decaying step size.
result Nearly linear convergence to true parameter with up to 50% Massart corruption rate.

A new algorithm reduces regret in bandit problems with adversarial corruptions.

problem Optimizing decision-making in bandit problems with variable uncertainties and adversarial interference.
method Proposes HCW-GLB-OMD, an OMD-based estimator with Hessian-based confidence weights for robustness.
result Achieves instance-wise minimax optimality with a κκ-factor in the corruption term.

This study tackles adversarial corruption in model-based reinforcement learning.

problem Adversarial corruption in model-based reinforcement learning.
method Maximum likelihood estimation (MLE) approach for learning transition model in both online and offline settings.
result Proves a regret of ildeO(T+C) ilde{\mathcal{O}}(\sqrt{T} + C) for CR-OMLE and a suboptimality of O(C/n)\mathcal{O}(C/n) for CR-PMLE.

The paper shows optimal robustness against adversarial corruption in sequential decision-making problems.

problem Optimal robustness to adversarial corruption in online decision-making problems.
method Investigates prediction with expert advice and multi-armed bandit problems, focusing on algorithms with decreasing learning rates and second-order regret bounds.
result Optimal robustness can be expressed by a square-root dependency on the amount of corruption, achieving O(logNΔ+ClogNΔ)O(\frac{\log N}{\Delta} + \sqrt{\frac{C \log N}{\Delta}})-regret.

New algorithm robust to label corruptions in active learning.

problem Active learning under unknown adversarial label corruptions.
method Proposed a new active learning algorithm that is provably correct without assumptions on corruptions.
result Achieves minimax label complexity in non-corrupted setting and only requires additional labels to achieve desired accuracy in corrupted setting.

We introduce a new model of stochastic bandits with adversarial corruptions which aims to capture settings where most of the input follows a stochastic pattern but some fraction of it can be adversarially changed to trick the algorithm, e.g., click fraud, fake reviews and email spam. The goal of this model is to encour…

2018-03-25abs ↗pdf ↗

Improved regret bounds for Tsallis-INF in adversarial bandits and corruptions.

problem Adversarial bandits and corruptions in multiarmed bandit problems.
method Improved regret bounds for Tsallis-INF algorithm.
result Achieves $\mathcal{O}\left(\left(\sum_{i eq i^*} \frac{1}{Δ_i} ight)\log_+\left(\frac{(K-1)T}{\left(\sum_{i eq i^*} \frac{1}{Δ_i} ight)^2} ight)+\sqrt{C\left(\sum_{i eq i^*}\frac{1}{Δ_i} ight)\log_+\left(\frac{(K-1)T}{C\sum_{i eq i^*}\frac{1}{Δ_i}} ight)} ight)$ regret bound.

New algorithm resists corruption in linear contextual bandits.

problem Adversarial corruption in linear contextual bandits.
method Variance-aware algorithm with multi-level partition and adaptive confidence sets.
result Regret bound of ildeO(C2dt=1Tσt2+C2RdT) ilde{O}(C^2d\sqrt{\sum_{t = 1}^T σ_t^2} + C^2R\sqrt{dT}).

New algorithm detects communities even with corrupted data, reaching Kesten-Stigum threshold.

problem Robust community detection in stochastic block model with node corruptions.
method Polynomial-time algorithm using Grothendieck norm of principal submatrices.
result First algorithm to achieve weak recovery at Kesten-Stigum threshold with node corruptions.

Study improves image classifier robustness to random p-norm corruptions.

problem Improving robustness of image classifiers to real-world imperceptible corruptions.
method Training and testing with random p-norm corruptions, evaluating robustness against different p-norms.
result Training with a combination of p-norm corruptions significantly improves robustness.

Unified framework for corruption-robust linear bandits with optimal gap-dependent misspecification bounds.

problem Effective learning in linear bandits with corrupted rewards across different corruption models.
method Unified framework for analyzing strong and weak corruption, connection to gap-dependent misspecification, and specialized algorithm.
result Optimal bounds for gap-dependent misspecification in linear bandits.

Over the last few years, the phenomenon of adversarial examples --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when the adversary is restricted to small modifications of a correctly handled input. Less surprisingly, image…

2019-01-29abs ↗pdf ↗

Proposes a robust IV estimator using optimal transport for corrupted or adversarial data.

problem Lack of robustness in traditional IV estimators for corrupted or adversarial data.
method Integrates data-derivative information through optimal transport to address geometric aspects of data.
result Improves robustness against data corruption and adversarial attacks.

SGD-trained neural networks generalize well even with adversarial label noise.

problem Generalization of neural networks trained on adversarial label noise.
method Training a one-hidden-layer neural network with SGD on arbitrary width networks.
result SGD-trained networks achieve classification accuracy competitive with the best halfspace over adversarial label noise.

Class selectivity affects robustness to corruptions but not to adversarial attacks.

problem Understanding the relationship between class selectivity and robustness in neural networks.
method Investigated the impact of class selectivity on robustness to natural corruptions and adversarial attacks using Tiny ImageNetC and CIFAR10C datasets.
result Decreasing class selectivity increases robustness to both natural corruptions and adversarial attacks.

Efficient algorithm detects communities in noisy graphs with robustness.

problem Community detection in stochastic block models with adversarial corruptions.
method Efficient algorithm using semidefinite programming for robust clustering.
result Achieves error O(ε)+eC2(1±o(1))O(ε) + e^{-\frac{C}{2} (1 \pm o(1))} for εε-fraction of corruptions.

Adversarial inference on tree models is possible with limited corruption, improving on Kesten-Stigum threshold.

problem Posterior inference on tree-structured graphical models in the presence of adversarial corruption.
method Dynamic programming via belief propagation, constrained adversarial corruption.
result Belief propagation can perform accurate inference with limited adversarial corruption.

New algorithm reduces regret in RL with adversarial corruption.

problem Adversarial corruption in reinforcement learning.
method Uncertainty-weighted least-squares regression and weighted uncertainty estimator.
result Achieves regret of ildeO(T+ζ) ilde{O}(\sqrt{T} + ζ) for contextual bandits.

Improved εε-greedy handles strategic bidding in PPC auctions.

problem Strategic bidding in PPC auctions with personalization and corruptions.
method Extended εε-greedy to handle strategic arms in contextual multi-arm bandit.
result εε-greedy is robust to adversarial corruptions and degrades linearly with corruption.

New method improves neural network robustness without sacrificing generalization.

problem Robustness and generalization are often at odds in neural networks.
method Distributionally robust loss function bridging robustness and generalization.
result Certified robustness against data evasion and poisoning attacks with guaranteed generalization.

New study shows how adversaries can bias fair machine learning models even with corrupted data.

problem Fairness concerns in machine learning models under data corruption.
method Study of fairness-aware learning algorithms under worst-case data manipulations.
result Natural learning algorithms optimizing for both accuracy and fairness are order-optimal in terms of corruption ratio and protected groups frequencies.

We propose a general framework for solving the group synchronization problem, where we focus on the setting of adversarial or uniform corruption and sufficiently small noise. Specifically, we apply a novel message passing procedure that uses cycle consistency information in order to estimate the corruption levels of gr…

2019-12-24abs ↗pdf ↗

New model selects robustly in adversarial reinforcement learning with unknown corruption.

problem Adversarial corruption in reinforcement learning with unknown total corruption amount.
method Model selection approach for finite-horizon tabular and linear MDPs.
result First worst-case optimal bound without knowledge of total corruption.

Study on measuring vulnerability of neural network parameters via corruption.

problem Understanding the robustness and generalization of deep neural networks.
method Proposes an indicator to measure parameter robustness via parameter corruption and provides a gradient-based estimation.
result Demonstrates the effectiveness of the proposed indicator and training method in improving parameter robustness and accuracy.

New algorithm robust to outliers in Bayesian Optimization.

problem Vulnerability of Bayesian Optimization to extreme outliers.
method Introduces a new adversary with a frequency-bounded corruption budget and derives RCGP-UCB algorithm.
result Achieves sublinear regret in the presence of up to O(T1/4)O(T^{1/4}) and O(T1/7)O(T^{1/7}) corruptions with possibly infinite magnitude.

Efficiently learns distributions corrupted by both global and local adversarial modifications.

problem Learning distributions with both global and local adversarial corruptions.
method Develops an efficient algorithm to minimize Wasserstein distance with orthogonal projections.
result Achieves optimal risk bounds with error εk+ρ+ildeO(dkn1/(k2))\sqrt{\varepsilon k} + ρ+ ilde{O}(d\sqrt{k}n^{-1/(k \lor 2)}).

PatchGuard defends against localized adversarial patches with provable robustness.

problem Localized adversarial patches induce misclassification in machine learning models.
method PatchGuard uses CNNs with small receptive fields and robust masking to detect and mask corrupted features.
result PatchGuard achieves state-of-the-art provable robust accuracy and clean accuracy.

Develops a strategy to minimize loss in both stochastic and adversarial environments for linear contextual bandits.

problem Linear contextual bandits with adversarial corruption.
method Proposes a novel strategy called Best-of-Both-Worlds (BoBW) RealFTRL, extending RealLinExp3 and FTRL.
result Regret upper bound of $O\left(\min\left\{\frac{(\log(T))^3}{Δ_{*}} + \sqrt{\frac{C(\log(T))^3}{Δ_{*}}},\ \ \sqrt{T}(\log(T))^2 ight\} ight)$, showing effectiveness in both stochastic and adversarial environments.