Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
Improved software flaw detection using NAS on multimodal DL models.
problem Software flaw detection in multimodal deep learning models.
method Adapted NAS framework for multimodal learning, combined with multimodal deep learning models.
result Improved performance on the Juliet Test Suite.
Recent anomaly detection benchmarks are flawed, potentially misleading progress.
problem Flawed benchmark datasets create misleading progress reports.
method Identified four flaws in benchmark datasets and introduced a new archive.
result Published comparisons may be unreliable due to flaws in benchmark datasets.
This paper critiques flawed MVTS anomaly detection evaluation methods and proposes a simple baseline.
problem Flawed evaluation methods in MVTS anomaly detection research.
method Robust evaluation protocols, including PCA-based baseline.
result Simple PCA-based baseline outperforms many DL approaches.
Detects unusual inputs to neural networks to prevent flawed predictions.
problem Erratic predictions from neural networks on unexpected inputs.
method Evaluates input unusualness by comparing its content to learned parameters.
result Simple, effective method for comparing input metrics across different scales.
Flawed groups are shown to include all finitely generated groups isomorphic to free products of nilpotent groups.
problem Characterizing flawed groups and understanding their topological properties.
method Analyzing finitely presented groups and their deformation retracts onto subspaces of character varieties.
result All finitely generated groups isomorphic to free products of nilpotent groups are flawed.
Detects outliers in VAE latent space by identifying vacant holes.
problem Outliers detection in VAE latent space.
method Compactness enforced via Alexandroff extension and fixed Lipschitz continuity.
result Anomalous inputs land on latent holes, enabling successful identification.
This research identifies flaws in drift detection methods and creates adversarial data streams to exploit them.
problem The challenge of detecting data distribution changes (drift) in real-time systems.
method Developed adversarial data streams to show weaknesses in existing drift detection schemes.
result Demonstrated that common drift detection methods can be fooled by adversarial data streams.
Machine learning models for COVID-19 detection and prognosis from chest images are flawed and unreliable.
problem Developing reliable machine learning models for COVID-19 diagnosis and prognosis from chest images.
method Systematic review of machine learning models published in 2020.
result None of the models identified are of clinical use due to methodological flaws and biases.
The paper highlights issues with fixed point claims in digital images.
problem Flaws in published assertions about fixed points in digital images.
method Continues a series of studies examining digital topology.
result Identifies and discusses problems with fixed point claims.
The paper highlights issues in fixed point claims in digital topology.
problem Flaws in published assertions about fixed points in digital metric spaces.
method Continues a series of studies examining these flaws.
result Identifies and discusses problems in fixed point claims.
The F-measure or F-score is one of the most commonly used single number measures in Information Retrieval, Natural Language Processing and Machine Learning, but it is based on a mistake, and the flawed assumptions render it unsuitable for use in most contexts! Fortunately, there are better alternatives.
Study flaws in generative model evaluation metrics, especially for diffusion models.
problem Flaws in existing metrics for evaluating generative models, particularly for diffusion models.
method Systematic study of generative models, human perception experiments, and analysis of feature extractors.
result State-of-the-art perceptual realism of diffusion models is not reflected in commonly reported metrics.
Information extracted from electrohysterography recordings could potentially prove to be an interesting additional source of information to estimate the risk on preterm birth. Recently, a large number of studies have reported near-perfect results to distinguish between recordings of patients that will deliver term or p…
Systematic review of ML models for detecting social media deception.
problem Detecting fake news, spam, and fake accounts on social media.
method 36 studies evaluated using PROBAST tool, identifying biases and limitations.
result Over-reliance on accuracy in imbalanced data settings is a flaw.
Ethereum smart contracts have recently drawn a considerable amount of attention from the media, the financial industry and academia. With the increase in popularity, malicious users found new opportunities to profit by deceiving newcomers. Consequently, attackers started luring other attackers into contracts that seem …
This paper is being withdrawn by the author due a serious flaw.
New flaw found in SAP defense, reducing its effectiveness to 0.1%.
problem Weakness in Stochastic Activation Pruning defense against adversarial attacks.
method Re-examined the implementation of SAP and introduced a new BPDA attack.
result SAP's effectiveness reduced to 0.1% when properly applied.
Study examines flaws in probing LLMs' knowledge and introduces a new method.
problem Flaws in existing methods for probing the veracity of LLMs' internal knowledge.
method sAwMIL (Sparse-Aware Multiple-Instance Learning) combining multiple-instance learning with conformal prediction.
result LLMs encode a third type of signal distinct from true and false.
The paper proves deep learning can be robust with certain loss functions.
problem The robustness of deep learning models under flawed data.
method Empirical-risk minimization with unbounded, Lipschitz-continuous loss functions.
result These loss functions provide efficient prediction under minimal data assumptions.
This paper has been withdrawn by the author due to a serious flaw that needs to be fixed. That is in progress by the author.
The paper tackles auction market design flaws by randomizing closing times and optimizing transaction fees.
problem Strategic traders exploit accumulated information to delay their orders, distorting auction efficiency.
method Randomizing auction closing times and designing optimal transaction fees policies.
result Policies encourage strategic traders to send orders earlier, improving auction market efficiency.
Proposes HSIC-Lasso for selective inference in non-linear data.
problem Detecting influential features in non-linear and high-dimensional data.
method Model-free HSIC-Lasso based on truncated Gaussians and polyhedral lemma.
result Tight control of type-I error even for small sample sizes.
Research shows bias in machine learning can be due to algorithmic flaws, not just data.
problem Underestimation bias in machine learning algorithms.
method Initial research to understand factors contributing to bias in classification algorithms.
result Regularization methods to address overfitting can also accentuate bias.
Benchmark evaluates AI-generated financial QA hallucinations, highlighting system vulnerabilities.
problem Ensuring factual accuracy of AI-generated financial QA outputs.
method Developed a benchmark dataset and evaluated six detection methods under clean and noisy conditions.
result LLM-based judges and embedding methods perform best, but degrade under noisy conditions.
The paper addresses flaws in fixed point assertions for digital images.
problem Deficiencies in previously published works on fixed point assertions for digital images.
method Continues a series of studies to identify and rectify issues in fixed point assertions.
result Identifies and corrects flaws in fixed point assertions for digital images.
IGT learns graph representations without supervision.
problem Building deep unsupervised graph representations.
method Generic complex-valued spectral graph architecture from Fourier transform generalization, greedy concave objective for discriminative and invariant features.
result IGT learns both discriminative and invariant features from graph topology.
We derive a new proof to show that the incremental resparsification algorithm proposed by Kelner and Levin (2013) produces a spectral sparsifier in high probability. We rigorously take into account the dependencies across subsequent resparsifications using martingale inequalities, fixing a flaw in the original analysis…
Coupled entropy corrects flaws in Tsallis entropy for complex systems.
problem Misinterpretation of generalized temperature and entropy.
method Derived from generalized Pareto and Student's t distributions.
result Provides balanced measure of uncertainty for complex systems.
Like all sub-fields of machine learning Bayesian Deep Learning is driven by empirical validation of its theoretical proposals. Given the many aspects of an experiment it is always possible that minor or even major experimental flaws can slip by both authors and reviewers. One of the most popular experiments used to eva…
New methods needed to evaluate uncertainty estimates in neural networks.
problem Evaluating uncertainty estimates in neural networks is flawed and inconsistent.
method Proposes a simulation-based testing approach to address flaws in current methods.
result Current methods for evaluating uncertainty estimates have significant flaws and cannot accurately compare different methods.
New attacks reduce bad queries in black-box classifiers, improving effectiveness.
problem Evasion attacks often issue many bad queries, which are costly.
method Design new attacks that minimize bad queries while increasing non-bad queries.
result Reduces the number of bad queries by 1.5-7.3 times, improving attack effectiveness.
We analyze GANs using neural tangent kernels, revealing flaws and advancing understanding.
problem Flaws in previous GAN analysis models.
method Neural Tangent Kernel framework for infinite-width discriminator.
result New insights into GAN convergence and generated distribution.
We prove that the twisted Reidemeister torsion of a 3-manifold corresponding to a fibered class is monic and we show that it gives lower bounds on the Thurston norm. The former fixes a flawed proof in [FV10], the latter gives a quick alternative argument for the main theorem of [FK06].
New method identifies flawed internal models of the world in animals.
problem How animals make decisions with partial sensory information.
method Generalizes Inverse Rational Control to continuous nonlinear dynamics and noise.
result Identifies the best internal model explaining an agent's actions.
Smart contracts are a digital technology with potential but also flaws.
problem Understanding the potential and limitations of smart contracts.
method Exploratory study combining statistics, IT, and law.
result Smart contracts have both idealistic promises and practical challenges.
PMI-Masking improves MLM pretraining by masking correlated spans efficiently.
problem Uniform token masking leads to inefficient and suboptimal performance in MLMs.
method PMI-Masking uses Pointwise Mutual Information to mask n-grams with high collocation.
result PMI-Masking reaches half the training time and improves performance.
Paper evaluates robustness of NAS against poisoning attacks.
problem Robustness of Neural Architecture Search (NAS) against poisoning attacks.
method Evaluation of Efficient NAS (ENAS) against carefully designed ineffective operations in poisoning attacks.
result Demonstrates how poisoning attacks exploit design flaws in ENAS controller.
Notes a flaw in a proof about embedding graphs.
problem A flaw in proving Sachs' conjecture about graph embeddings.
method Analyzing Stanfield's proof for gaps.
result Identifies a significant error in the proof.
We solve Hilbert's fifth problem for local groups: every locally euclidean local group is locally isomorphic to a Lie group. Jacoby claimed a proof of this in 1957, but this proof is seriously flawed. We use methods from nonstandard analysis and model our solution after a treatment of Hilbert's fifth problem for global…
Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results. Explainability is not only a gateway between AI and society but also a powerful tool t…
Corrects errors in Hans' pseudocovering spaces paper.
problem Mathematical errors and citation issues in Hans' pseudocovering spaces paper.
method Identifies and corrects errors in Hans' previous work.
result Addresses mathematical and citation errors in Hans' pseudocovering spaces paper.
AI bias arises from human-defined goals, not algorithmic flaws.
problem AI bias due to human-defined goals in LLMs.
method Purpose-conditioned cognition and revealing downstream use of LLM outputs.
result AI bias can be reduced by purpose-aware prompting but not fully by regularization.
New method corrects bias in feature importance measures of GBM.
problem Bias in feature importance measures of GBM.
method Cross-validated unbiased base learners.
result Significant improvement in feature importance measures with minimal computational cost.
New methods reduce extrapolation errors in feature importance.
problem Flawed feature importance methods using unrestricted permutations lead to extrapolation errors.
method Three new approaches: conditional model reliance, Knockoffs with Gaussian transformation, and restricted ALE plot designs.
result Theoretical and numerical results show our strategies reduce/eliminate extrapolation.
Machine learning experiments show IID assumption is flawed for bathymetry editing.
problem Flawed IID assumption in machine learning for bathymetry editing.
method Real-world computer-assisted labeling task, IID assumption analysis.
result Common random split leads to poor performance in machine learning.
Corrects a flawed proof of the Kropholler Conjecture.
problem Kropholler Conjecture in relative group theory.
method Explains the flaws and proposes possible ways to correct the proof.
result Provides a clearer understanding of the conjecture's proof difficulties.
The study finds flaws in methods used to estimate foreign exchange option prices.
problem Flaws in estimating foreign exchange option prices.
method Provided counterexamples of popular FX option interpolation methods.
result Popular FX option interpolation methods fail in certain scenarios.