Study shows flipping a small subset of labels can severely damage machine learning models.
problem Adversarial attacks on distributed machine learning models.
method Formalized label flipping attacks, proposed a greedy algorithm, demonstrated with logistic regression models.
result A budget of only 0.1% of labels at each training step can reduce model accuracy by 6%, and some models can perform worse than random guessing when up to 25% of labels are flipped.
New method makes machine learning models robust to label flipping attacks.
problem Machine learning models are vulnerable to label flipping attacks.
method Randomized smoothing over arbitrary functions to build certifiably robust classifiers.
result Linear classifiers are robust to label flipping attacks with deterministic bounds.
New insights on robust learning under strong noise models.
problem Challenging label-noise models in robust learning.
method Extending statistical query framework to more general noise models and using evolutionary algorithms.
result First polynomial time algorithm for learning linear threshold functions with arbitrarily small excess error in presence of Tsybakov noise.
Efficiently poisons offline RLHF models by flipping preference labels.
problem Vulnerability of offline RLHF models to preference label flipping attacks.
method Developed two attack methods: BAL-A and BMP-A, solving a structured binary sparse approximation problem.
result Demonstrated that flipping one preference label induces a parameter-independent shift in the DPO gradient, enabling structured binary sparse approximation.
It has been a long-standing problem to efficiently learn a halfspace using as few labels as possible in the presence of noise. In this work, we propose an efficient Perceptron-based algorithm for actively learning homogeneous halfspaces under the uniform distribution over the unit sphere. Under the bounded noise condit…
The paper explores how supervision level affects both statistical accuracy and computational efficiency in weakly supervised binary classification.
problem The impact of label flip probability on statistical and computational efficiency in weakly supervised binary classification.
method Information-theoretic and computational boundaries were established to characterize the relationship between supervision level and performance.
result The gap between statistical and computational boundaries narrows as the supervision level increases, indicating improved computational efficiency with more supervision.
Deep Partition Aggregation defends against poisoning attacks with provable certificates.
problem Adversarial poisoning attacks corrupt classifier test-time behavior.
method Deep Partition Aggregation (DPA) is an ensemble method using hash partitions and base models trained on these partitions.
result DPA can certify >= 50% of test images against over 500 poison image insertions on MNIST, and nine insertions on CIFAR-10.
Many machine learning systems rely on data collected in the wild from untrusted sources, exposing the learning algorithms to data poisoning. Attackers can inject malicious data in the training dataset to subvert the learning process, compromising the performance of the algorithm producing errors in a targeted or an ind…
Instance- and Label-dependent label Noise (ILN) widely exists in real-world datasets but has been rarely studied. In this paper, we focus on Bounded Instance- and Label-dependent label Noise (BILN), a particular case of ILN where the label noise rates -- the probabilities that the true labels of examples flip into the …
In this paper, we study a classification problem in which sample labels are randomly corrupted. In this scenario, there is an unobservable sample with noise-free labels. However, before being observed, the true labels are independently flipped with a probability ρ∈[0,0.5), and the random label noise can be class-co…
In order to model volatile real-world network behavior, we analyze phase-flipping dynamical scale-free network in which nodes and links fail and recover. We investigate how stochasticity in a parameter governing the recovery process affects phase-flipping dynamics, and find the probability that no more than q% of nodes…
In label-noise learning, \textit{noise transition matrix}, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building \textit{statistically consistent classifiers}. Existing theories have shown that the transition matrix can be learned by exploiting \textit{anchor points} (i.e…
A double pants decomposition of a 2-dimensional surface is a collection of two pants decomposition of this surface introduced in arXiv:1005.0073v2. There are two natural operations acting on double pants decompositions: flips and handle twists. It is shown in arXiv:1005.0073v2 that the groupoid generated by flips and h…
Paper defends against malware detection attacks using clustering and deep learning.
problem Label flipping attacks on malware detection systems in IoT environments.
method Developed a Silhouette clustering-based attack mechanism and two CNN-type deep learning algorithms for defense.
result Proposed algorithms LSD and CSD improve malware detection accuracy by up to 19%.
The paper solves pentagon equations using triangulations and edge transformations.
problem Solving pentagon equations with triangulations and edge transformations.
method General data and transformation rule method applied to triangulations.
result Recovery of initial data after transformations.
Algorithm learns halfspaces in noisy data efficiently.
problem Learning halfspaces with Tsybakov noise.
method Novel semi-definite programming and online convex optimization.
result First non-trivial PAC learning algorithm for Tsybakov noise.
Federated learning is protected against adversarial attacks with residual-based reweighting.
problem Adversarial attacks on federated learning's aggregation process.
method Residual-based reweighting combined with iteratively reweighted least squares.
result Our aggregation algorithm outperforms other methods in label-flipping and backdoor attacks.
Identifies minimal training subset to flip a prediction.
problem Flipping predictions in machine learning models.
method Extended influence function for relabeling minimal subset.
result Relabeling fewer than 2% of training points can flip a prediction.
Study shows squared loss is robust for binary classification with noisy features.
problem Learning binary classifiers with noisy features.
method Sy-De and Asy-In attribute noise models, analyzing l0−1 and lsq losses. result Squared loss is robust in Sy-De model but not in Asy-In model.
Conformer encoder reverses sequence in time dimension, affecting decoder training.
problem Reversal of sequence in Conformer encoder impacts decoder training.
method Analyzed initial behavior of decoder cross-attention and proposed methods to avoid flipping.
result Self-attention module of Conformer starts dominating, allowing only reversed information to pass.
In this article, I will present a paradox whose purpose is to draw your attention to an important topic in finance, concerning the non-independence of the financial returns (non-ergodic hypothesis). In this paradox, we have two people sitting at a table separated by a black sheet so that they cannot see each other and …
This paper explores using nonlinear control for robust logarithmic growth in coin flipping games.
problem Tackles the use of nonlinear control in recursive betting games with logarithmic growth.
method Formulates a robust nonlinear control problem for a simple coin flipping game, considering a probability range for the coin's bias.
result Provides a closed-form description of the optimal robust nonlinear controller, which outperforms linear controllers.
Local graph clustering improves with noisy labels, enhancing accuracy and performance.
problem Local graph clustering with noisy labels for node information.
method Constructing a weighted graph with noisy labels and using diffusion-based clustering.
result Diffusion in the weighted graph yields more accurate recovery of target clusters.
Study shows SQ hardness for multiclass linear classification with random noise.
problem Complexity of multiclass linear classification with random noise.
method Proves super-polynomial SQ lower bounds for MLC with RCN.
result Super-polynomial SQ lower bounds for MLC with RCN.
Study flip graphs for surfaces of infinite type, finding uncountably many connected components.
problem Understanding relationships between triangulations of infinite type surfaces via flips.
method Associate triangulations to flip graphs and study sequences of simultaneous flips.
result Flip graphs for infinite type surfaces have uncountably many connected components.
Majority bit estimation in noisy random recursive DAGs.
problem Estimating the majority bit in a noisy random recursive DAG.
method Majority rule among nodes, with bit flipping and noisy channel.
result Identification of the threshold for p at which majority rule yields errors. Efficiently learns sparse halfspaces with noisy labels.
problem Learning sparse halfspaces with arbitrary bounded noise.
method Polynomial time algorithm for active learning with improved label complexity.
result First efficient algorithm with label complexity polynomial in 1−2η1. Proposes a method to increase diversity without sacrificing meritocracy.
problem Systemic bias in datasets affecting diversity and meritocracy.
method Optimally flipping outcome labels and training classification models simultaneously.
result The price of diversity is low and sometimes negative, enhancing diversity without significantly affecting meritocracy.
Two-layer ReLU networks can overfit without harm, study finds.
problem Understanding when and how two-layer ReLU networks can overfit without harming generalization.
method Established algorithm-dependent risk bounds for two-layer ReLU convolutional neural networks with label-flipping noise.
result Gradient descent-trained ReLU networks can achieve near-zero training loss and Bayes optimal test risk.
Finite subgraphs in flip graphs ensure unique surface embeddings.
problem Ensuring unique embeddings of surfaces based on flip graphs.
method Analyzing finite subgraphs within flip graphs of surfaces.
result Injective homomorphisms are uniquely extendable and induced by embeddings.
New algorithm uses conditionally invariant components to improve domain adaptation performance.
problem Improving domain adaptation performance when source and target data distributions differ.
method Conditionally invariant components (CICs) and importance-weighted conditional invariant penalty (IW-CIP) algorithm.
result New algorithm provides target risk guarantees and addresses label-flipping features.
Study of flip graphs and their automorphism groups for infinite-type surfaces.
problem Understanding automorphism groups of flip graphs for infinite-type surfaces.
method Examined the relationship between mapping class groups and flip graphs for infinite-type surfaces.
result Extended mapping class groups are isomorphic to proper subgroups of automorphism groups of flip graphs.
Privacy subsidy found in market trading with noisy direction signals.
problem Analyzing welfare and bid-ask spread in a market with privacy mechanisms.
method Closed-form derivation of bid-ask spread and welfare under flip-noise direction observation.
result Privacy subsidy of μηΔ from liquidity pool to traders, robust across models. Connected flip graphs for triangulations on hyperbolic surfaces.
problem Connecting triangulations on hyperbolic surfaces via flips.
method Proving connectedness of flip graphs and giving bounds on edge flips.
result Flip graphs of geometric triangulations are connected.
DCGANs generate realistic breast masses for mammography.
problem Lack of labelled data and imbalanced datasets in medical imaging.
method DCGANs trained on mammographic images to generate synthetic masses.
result DCGANs improve lesion detection in mammography by ~0.09 F1 score.
Study of skateboard flips as continuous curves in SO(3) group.
problem Characterize skateboard flip tricks as continuous motions.
method Model flips as curves in SO(3), analyze lifts to S3, derive formulas. result There are only four distinct flip tricks up to continuous deformation.
Neural networks have been criticized for their lack of easy interpretation, which undermines confidence in their use for important applications. Here, we introduce a novel technique, interpreting a trained neural network by investigating its flip points. A flip point is any point that lies on the boundary between two o…
Flip symmetry on knot diagrams affects Khovanov homology.
problem Understanding the flip map on Khovanov homology.
method Analyzing the behavior of the flip map on unlinks and using it to determine the involution.
result The flip map is the identity map over \(\mathbb{F}_2\), confirming a conjecture.
The flip graph and arc complex of a surface are shown to have finite rigidity.
problem Finite rigidity of flip graph and arc complex for surfaces.
method Embedding the flip graph in the arc complex and leveraging finite rigidity of the flip graph.
result Finite rigidity of the flip graph implies finite rigidity of the arc complex.
Novel defense algorithm improves SVMs against data poisoning attacks.
problem Vulnerability of SVMs to targeted training data manipulations like poisoning attacks.
method Developed a weighted SVM using K-LID to de-emphasize suspicious data samples.
result Significant reduction in classification error rates (10% on average) with the proposed defense.
Paper tackles robust estimation of tree-structured Ising models without side information.
problem Learning tree-structured Ising models with flipped signs of variables.
method Proves unidentifiability, proposes an algorithm with logarithmic sample complexity and polynomial run-time complexity.
result Empirically demonstrates robustness of proposed algorithm in the flipped signs setting.
New examples show flip distance and polyhedron triangulation numbers differ, with ratio close to 3/2.
problem Understanding the relationship between flip distance and polyhedron triangulation numbers.
method Provided examples to demonstrate the difference between flip distance and polyhedron triangulation numbers.
result Ratio of flip distance to polyhedron triangulation numbers can be arbitrarily close to 3/2.
We prove that every injective simplicial map F(S)→F(S′) between flip graphs is induced by a subsurface inclusion S→S′, except in finitely many cases. This extends a result of Korkmaz--Papadopoulos which asserts that every automorphism of the flip graph of a surface without boundary is ind…
We prove that the binary classifiers of bit strings generated by random wide deep neural networks with ReLU activation function are biased towards simple functions. The simplicity is captured by the following two properties. For any given input bit string, the average Hamming distance of the closest input bit string wi…
Ranking a set of objects involves establishing an order allowing for comparisons between any pair of objects in the set. Oftentimes, due to the unavailability of a ground truth of ranked orders, researchers resort to obtaining judgments from multiple annotators followed by inferring the ground truth based on the collec…
Paper proposes training deep nets on noisy labels without manual annotation.
problem Training deep neural networks on noisy labels without manual annotation.
method Directly train deep neural network on noisy candidate labels, early stopping to avoid overfitting.
result Training on noisy candidate labels yields higher test performance than on clean data.
We prove that for a given flat surface with conical singularities, any pair of geometric triangulations can be connected by a chain of flips.
We introduce a notion of cross-flips: local moves that transform a balanced (i.e., properly (d+1)-colored) triangulation of a combinatorial d-manifold into another balanced triangulation. These moves form a natural analog of bistellar flips (also known as Pachner moves). Specifically, we establish the following the…