This work improves testing of machine learning model modifications using novel statistical methods.
problem Overfitting and conservative Bonferroni correction when testing multiple model modifications.
method Introduces alpha-recycling and SRGPs to control error rate and approve more beneficial modifications.
result Novel statistical methods approve a higher number of beneficial modifications than previous approaches.
Behavior modification improves prediction accuracy by nudging user behavior.
problem Improving prediction accuracy using behavior modification techniques.
method Combining prediction and behavior modification with reinforcement learning algorithms.
result Behavior modification can make predictions more certain but may not generalize.
The perceptron's compression is explored and applied to neural networks.
problem Understanding and improving the perceptron's margin and compression.
method Modifications to the perceptron algorithm and deductions from compression.
result Better guarantees on the margin of the perceptron's hyperplane.
We consider constraint-based methods for causal structure learning, such as the PC-, FCI-, RFCI- and CCD- algorithms (Spirtes et al. (2000, 1993), Richardson (1996), Colombo et al. (2012), Claassen et al. (2013)). The first step of all these algorithms consists of the PC-algorithm. This algorithm is known to be order-d…
Thompson Sampling remains differentially private with minimal modifications.
problem Ensuring privacy in Thompson Sampling for multi-arm bandits.
method Demonstrated differential privacy of original Thompson Sampling, provided per-round guarantees, and introduced modifications for tighter privacy.
result Privacy guarantees can be tuned by modifying the algorithm, and these modifications impact expected regret.
Improved peak detection in ChIP-seq data reduces over-dispersion.
problem Over-dispersion in ChIP-seq data reduces peak detection accuracy.
method Supervised segmentation models with alternative noise assumptions.
result Improved peak detection accuracy compared to natural assumptions.
Improved algorithm for multidimensional scaling reduces stress.
problem Stress in multidimensional scaling.
method Proposed modifications of the smacof algorithm.
result Convergent majorization algorithm for Kruskal's stress formula two.
Deep Boltzmann machines are in principle powerful models for extracting the hierarchical structure of data. Unfortunately, attempts to train layers jointly (without greedy layer-wise pretraining) have been largely unsuccessful. We propose a modification of the learning algorithm that initially recenters the output of t…
New algorithms estimate matrix norms without matrix multiplication.
problem Estimating matrix norms efficiently in a matrix-free setting.
method Randomized algorithms based on Hutchinson's estimator modifications.
result Oracle complexity bounds for two-to-infinity and one-to-two norms.
The Resilient Propagation (Rprop) algorithm has been very popular for backpropagation training of multilayer feed-forward neural networks in various applications. The standard Rprop however encounters difficulties in the context of deep neural networks as typically happens with gradient-based learning algorithms. In th…
Approves updates to machine learning models in healthcare based on accumulating data.
problem Designing policies to autonomously approve updates to machine learning algorithms in non-stationary settings.
method Learning-to-approve (L2A) approach that uses accumulating monitoring data to learn how to approve modifications.
result L2A learns to abstain when performance drops are common and approves beneficial modifications quickly when the distribution is stable.
Algorithm estimates bounds of updated classifier coefficients efficiently.
problem Determining sensitivity of updated classifiers without retraining.
method Proposes an algorithm to estimate upper and lower bounds of updated classifier coefficients.
result Estimates bounds with low computational complexity and tightness.
Paper proposes using pairwise feature comparisons to infer modification costs for user recourse.
problem Learning and inferring user preferences for modifying features in black-box models.
method Bradley-Terry model for inferring feature-wise costs from non-exhaustive human comparison surveys.
result Non-exhaustive human surveys can efficiently learn feature costs, enabling recourse finding.
New algorithm learns unstable, partially observable systems.
problem Learning in unstable and partially observable Gaussian Process State-Space Models.
method Structured variational inference with efficient forward-backward pass and modified conditioning step.
result Good test performance in stable and unstable real systems with hidden states.
ABIForest improves anomaly detection using attention weights.
problem Anomaly detection in datasets.
method Attention mechanism integrated into Isolation Forest.
result ABIForest outperforms standard Isolation Forest on synthetic and real datasets.
In this paper a novel modification of the multilevel Monte Carlo approach, allowing for further significant complexity reduction, is proposed. The idea of the modification is to use the method of control variates to reduce variance at level zero. We show that, under a proper choice of control variates, one can reduce t…
The successive projection algorithm (SPA) can quickly solve a nonnegative matrix factorization problem under a separability assumption. Even if noise is added to the problem, SPA is robust as long as the perturbations caused by the noise are small. In particular, robustness against noise should be high when handling th…
Paper proposes a modified fairness constraint to address shortcomings of counterfactual fairness.
problem Counterfactual fairness is not a necessary condition for algorithmic fairness.
method Analyzed hypothetical scenario and explicated discrimination to develop causal relevance fairness.
result Causal relevance fairness is a modified constraint that circumvents shortcomings of counterfactual fairness.
Learning algorithms for energy based Boltzmann architectures that rely on gradient descent are in general computationally prohibitive, typically due to the exponential number of terms involved in computing the partition function. In this way one has to resort to approximation schemes for the evaluation of the gradient.…
New method detects RNA modifications without prior training, revealing novel sites.
problem Detecting RNA modifications with high accuracy and sensitivity.
method Anomaly detection using nanopore raw ionic current signals and nearest neighbor comparison.
result Detects diverse RNA modifications without prior training, including a novel 2'-O-methylated site in DENV.
We define an operation on homology B4 which we call an n-twist annulus modification. We give a new construction of smoothly slice knots and exotically slice knots via n-twist annulus modifications. As an application, we present a new example of a smoothly slice knot with non-slice derivatives. Such examples we…
The paper addresses statistical issues in high-dimensional financial data.
problem Standard statistical techniques fail in high-dimensional data.
method Exploring modifications and new statistical methods for high-dimensional covariance matrix, regression, PCA, multiple testing, and classification.
result Development of fast algorithms for practical application.
Many proteoforms - arising from alternative splicing, post-translational modifications (PTMs), or paralogous genes - have distinct biological functions, such as histone PTM proteoforms. However, their quantification by existing bottom-up mass-spectrometry (MS) methods is undermined by peptide-specific biases. To avoid …
Residual Networks are shown to be equivalent to boosting feature representation.
problem Improving feature representation in deep learning models.
method Proved ResNet's equivalence to Online Gradient Boosting and proposed decision tree residual modules.
result ResNet can achieve Online Gradient Boosting regret bounds through architectural changes.
A new method improves continual learning by replaying pseudo data and using orthogonal weight modification.
problem Catastrophic forgetting in class incremental learning.
method Generative replay with orthogonal weight modification.
result Our method achieves substantial improvement over conventional generative replay and OWM.
Study shows stability of locally conformally balanced condition under modifications but not under small deformations.
problem Stability of locally conformally balanced condition under small deformations and modifications.
method Proved stability under proper modifications and instability under small deformations using examples and Hilbert-Chow map.
result Stability of locally conformally balanced condition under proper modifications and instability under small deformations.
DeepDiff predicts differential gene expression from histone modifications using deep learning.
problem Predicting differential gene expression from histone modification signals, capturing combinatorial effects.
method Attention-based deep learning architecture with multiple LSTM modules and attention mechanisms.
result DeepDiff significantly outperforms state-of-the-art baselines for differential gene expression prediction.
ABRF uses attention weights to improve RF performance.
problem Improving the performance of random forest models.
method Attention mechanism applied to random forest with optimization and gradient-based methods.
result The proposed ABRF models outperform standard RF models on various datasets.
Pulling back the weight system associated with the exceptional Lie algebra G_2 by a modification of the universal Vassiliev-Kontsevich invariant yields a link invariant; extending it to 3-nets, we derive a recursive algorithm for its evaluation.
Proposes simplified SHAP for faster black-box model explanations.
problem Computational expense of SHAP for models with many features.
method Ensemble of random SHAPs with feature selection and point generation.
result Efficiency and properties demonstrated through numerical experiments.
We study a simple modification to the conventional time of flight mass spectrometry (TOFMS) where a \emph{variable} and (pseudo)-\emph{random} pulsing rate is used which allows for traces from different pulses to overlap. This modification requires little alteration to the currently employed hardware. However, it requi…
GOAT improves graph matching speed and accuracy using optimal transport.
problem Efficiently matching large graphs in various applications.
method Replaces linear assignment with optimal transport methods.
result GOAT provides improvements in speed and accuracy.
The Perona-Malik model has been very successful at restoring images from noisy input. In this paper, we reinterpret the Perona-Malik model in the language of Gaussian scale mixtures and derive some extensions of the model. Specifically, we show that the expectation-maximization (EM) algorithm applied to Gaussian scale …
Paper proposes adversarial modifications for link prediction models to improve robustness and interpretability.
problem Improving accuracy is not enough; robustness and interpretability are also crucial for link prediction models.
method Adversarial modifications to identify influential facts and evaluate model sensitivity and interpretability.
result The approach identifies the most influential facts and evaluates the sensitivity of link prediction models to additional facts.
Study of unimodular Sasaki and Vaisman Lie groups, determining all modifications explicitly.
problem Classifying unimodular Sasaki and Vaisman Lie groups.
method Applying the technique of modification to determine all homogeneous Sasaki and Vaisman manifolds of unimodular Lie groups explicitly.
result Complete classification of unimodular Sasaki and Vaisman Lie groups.
We study large-scale classification problems in changing environments where a small part of the dataset is modified, and the effect of the data modification must be quickly incorporated into the classifier. When the entire dataset is large, even if the amount of the data modification is fairly small, the computational …
Paper corrects GIRP algorithm to ensure isotonic models.
problem GIRP algorithm fails to produce isotonic models.
method Modified GIRP algorithm with binary partitioning.
result Correct solution exists and can be found.
Adaptive weighting improves Deep Forest classifier's performance.
problem Improving Deep Forest classifier's efficiency and accuracy.
method Adaptive weighing of training instances at each cascade level, inspired by AdaBoost.
result The modified Deep Forest classifier performs better than the original.
The Sarkar-Wang algorithm computes the hat version of the Heegaard Floer homology of a closed oriented three manifold. This paper analyzes the computational complexity of the Sarkar-Wang algorithm; then the algorithm is modified to obtain a better bound. Then the computational complexity of calculating HFK hat from a H…
Method explains anomaly detection by generating normal modifications.
problem Complexity of deep learning methods in anomaly detection.
method Generates multiple alternative modifications for anomalies.
result High-quality semantic explanations provided for anomaly detection.
Study proposes a new approval policy for ML-based medical devices to prevent gradual performance degradation.
problem Gradual deterioration in machine learning model performance over time in medical devices.
method Formulated an automatic algorithmic change protocol (aACP) as an online hypothesis testing problem, considering both error-rate guarantees and non-guaranteed policies.
result Controlled the rate of gradual deterioration (biocreep) in machine learning models without significantly impacting approval of beneficial modifications.
ModHiFi identifies critical components for model modification without gradients or loss function.
problem Modifying open weight models without access to training data or loss function.
method Theoretical analysis of Lipschitz-continuous networks, Subset Fidelity metric, and ModHiFi algorithm.
result ModHiFi-P and ModHiFi-U achieve significant performance improvements in model pruning and unlearning.
In this paper, a modification to the training process of the popular SPLICE algorithm has been proposed for noise robust speech recognition. The modification is based on feature correlations, and enables this stereo-based algorithm to improve the performance in all noise conditions, especially in unseen cases. Further,…
Improves decision-making by correcting feature selection bias.
problem Cofounding bias in feature selection affects machine learning predictions.
method Proposes a meta-algorithm using a novel adjustment criterion based on causal sufficiency.
result Corrects cofounding bias to improve prediction performance.
Modified BA algorithm computes RD and DR functions efficiently.
problem Computing rate-distortion and distortion-rate functions.
method A novel modification of the BA algorithm using Newton's method for root-finding.
result The modified algorithm converges to RD and DR function solutions with rate O(1/n) and provides ε-approximations. Guarantees convergence for black-box variational inference without modifications.
problem Convergence guarantees for black-box variational inference.
method Analysis of log-smooth posterior densities, location-scale variational family, and convergence rates of algorithm design choices.
result Proximal stochastic gradient descent fixes suboptimal convergence rates and achieves strongest known guarantees.
We study Khovanov homology classes which have state cycle representatives, and examine how they interact with Jacobsson homomorphisms and Lee's map Φ. As an application, we describe a general procedure, quasipositive modification, for constructing H-thick knots in rational Khovanov homology. Moreover, we show that sp…
Improved algorithm for calculating knot invariants.
problem Efficiently computing knot invariants like s-invariants. method Divide-and-conquer and scanning algorithms on Khovanov cohomology.
result Significant improvement in efficiency of the algorithm.