Bayesian Deep Learning experiments often use weak baselines, leading to misleading conclusions.
problem Misleading conclusions in Bayesian Deep Learning due to weak baselines in experiments.
method Used a fixed number of iterations for baselines and compared them with models trained to convergence.
result Monte Carlo dropout baseline outperforms or performs competitively with superior methods.
Machine learning experiments show IID assumption is flawed for bathymetry editing.
problem Flawed IID assumption in machine learning for bathymetry editing.
method Real-world computer-assisted labeling task, IID assumption analysis.
result Common random split leads to poor performance in machine learning.
Flawed groups are shown to include all finitely generated groups isomorphic to free products of nilpotent groups.
problem Characterizing flawed groups and understanding their topological properties.
method Analyzing finitely presented groups and their deformation retracts onto subspaces of character varieties.
result All finitely generated groups isomorphic to free products of nilpotent groups are flawed.
Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
Improved software flaw detection using NAS on multimodal DL models.
problem Software flaw detection in multimodal deep learning models.
method Adapted NAS framework for multimodal learning, combined with multimodal deep learning models.
result Improved performance on the Juliet Test Suite.
PMI-Masking improves MLM pretraining by masking correlated spans efficiently.
problem Uniform token masking leads to inefficient and suboptimal performance in MLMs.
method PMI-Masking uses Pointwise Mutual Information to mask n-grams with high collocation.
result PMI-Masking reaches half the training time and improves performance.
The paper highlights issues with fixed point claims in digital images.
problem Flaws in published assertions about fixed points in digital images.
method Continues a series of studies examining digital topology.
result Identifies and discusses problems with fixed point claims.
The paper highlights issues in fixed point claims in digital topology.
problem Flaws in published assertions about fixed points in digital metric spaces.
method Continues a series of studies examining these flaws.
result Identifies and discusses problems in fixed point claims.
New method identifies flawed internal models of the world in animals.
problem How animals make decisions with partial sensory information.
method Generalizes Inverse Rational Control to continuous nonlinear dynamics and noise.
result Identifies the best internal model explaining an agent's actions.
The abstract warns against flawed empirical research in machine learning.
problem Flawed empirical research in machine learning leading to unreliable results.
method Call for more awareness of experimental knowledge plurality and epistemic limitations.
result Current empirical machine learning research should be exploratory, not confirmatory.
The F-measure or F-score is one of the most commonly used single number measures in Information Retrieval, Natural Language Processing and Machine Learning, but it is based on a mistake, and the flawed assumptions render it unsuitable for use in most contexts! Fortunately, there are better alternatives.
Study shows over-sampling biases prediction results on imbalanced datasets.
problem Over-optimistic prediction results on imbalanced data.
method Applying over-sampling before partitioning training and testing sets.
result Over-sampling causes biased results and reduces predictive performance.
This article focuses on the work of O. Chanel and G. Chichilnisky (2013) on the flaws of expected utility theory while assessing the value of life. Expected utility is a fundamental tool in decision theory. However, it does not fit with the experimental results when it comes to catastrophic outcomes ---see, for example…
Recent anomaly detection benchmarks are flawed, potentially misleading progress.
problem Flawed benchmark datasets create misleading progress reports.
method Identified four flaws in benchmark datasets and introduced a new archive.
result Published comparisons may be unreliable due to flaws in benchmark datasets.
A multi-agent simulator evaluates trading strategies using Market Replay and Interactive Agent-Based Simulation.
problem Evaluate trading strategies using Market Replay and Interactive Agent-Based Simulation.
method Multi-agent simulator for Market Replay and Interactive Agent-Based Simulation.
result IABS provides a more realistic market environment for evaluating trading strategies.
Paper discusses flaws in traditional RL for lifelong learning.
problem Traditional RL fails to model lifelong learning systems.
method Simplified prototype of lifelong RL system.
result Insights into lifelong RL, showing traditional RL's limitations.
This paper is being withdrawn by the author due a serious flaw.
Vision and language tasks often fail to test AI comprehensively.
problem Current vision and language tasks are flawed due to dataset and evaluation issues.
method Review of current state and proposal for improvement.
result State-of-the-art systems perform well due to dataset and evaluation flaws.
New flaw found in SAP defense, reducing its effectiveness to 0.1%.
problem Weakness in Stochastic Activation Pruning defense against adversarial attacks.
method Re-examined the implementation of SAP and introduced a new BPDA attack.
result SAP's effectiveness reduced to 0.1% when properly applied.
This paper critiques flawed MVTS anomaly detection evaluation methods and proposes a simple baseline.
problem Flawed evaluation methods in MVTS anomaly detection research.
method Robust evaluation protocols, including PCA-based baseline.
result Simple PCA-based baseline outperforms many DL approaches.
Study examines flaws in probing LLMs' knowledge and introduces a new method.
problem Flaws in existing methods for probing the veracity of LLMs' internal knowledge.
method sAwMIL (Sparse-Aware Multiple-Instance Learning) combining multiple-instance learning with conformal prediction.
result LLMs encode a third type of signal distinct from true and false.
The paper proves deep learning can be robust with certain loss functions.
problem The robustness of deep learning models under flawed data.
method Empirical-risk minimization with unbounded, Lipschitz-continuous loss functions.
result These loss functions provide efficient prediction under minimal data assumptions.
New research highlights flaws in evaluating clustering algorithms using classification datasets.
problem Flaws in evaluating clustering algorithms using classification datasets.
method Advanced visualization and dimension reduction techniques to expose flaws.
result Current practice of evaluating clustering algorithms may produce misleading results.
This paper has been withdrawn by the author due to a serious flaw that needs to be fixed. That is in progress by the author.
The paper tackles auction market design flaws by randomizing closing times and optimizing transaction fees.
problem Strategic traders exploit accumulated information to delay their orders, distorting auction efficiency.
method Randomizing auction closing times and designing optimal transaction fees policies.
result Policies encourage strategic traders to send orders earlier, improving auction market efficiency.
Research shows bias in machine learning can be due to algorithmic flaws, not just data.
problem Underestimation bias in machine learning algorithms.
method Initial research to understand factors contributing to bias in classification algorithms.
result Regularization methods to address overfitting can also accentuate bias.
Detects unusual inputs to neural networks to prevent flawed predictions.
problem Erratic predictions from neural networks on unexpected inputs.
method Evaluates input unusualness by comparing its content to learned parameters.
result Simple, effective method for comparing input metrics across different scales.
The paper addresses flaws in fixed point assertions for digital images.
problem Deficiencies in previously published works on fixed point assertions for digital images.
method Continues a series of studies to identify and rectify issues in fixed point assertions.
result Identifies and corrects flaws in fixed point assertions for digital images.
Paper introduces a benchmark for predicting bankruptcy from text data.
problem Lack of a common benchmark dataset and evaluation strategy for unstructured data in bankruptcy prediction.
method Describes and evaluates several baseline models, including a bag-of-words model.
result A lightweight bag-of-words model performs surprisingly well, especially when considering data from multiple years.
We derive a new proof to show that the incremental resparsification algorithm proposed by Kelner and Levin (2013) produces a spectral sparsifier in high probability. We rigorously take into account the dependencies across subsequent resparsifications using martingale inequalities, fixing a flaw in the original analysis…
Coupled entropy corrects flaws in Tsallis entropy for complex systems.
problem Misinterpretation of generalized temperature and entropy.
method Derived from generalized Pareto and Student's t distributions.
result Provides balanced measure of uncertainty for complex systems.
New methods needed to evaluate uncertainty estimates in neural networks.
problem Evaluating uncertainty estimates in neural networks is flawed and inconsistent.
method Proposes a simulation-based testing approach to address flaws in current methods.
result Current methods for evaluating uncertainty estimates have significant flaws and cannot accurately compare different methods.
We analyze GANs using neural tangent kernels, revealing flaws and advancing understanding.
problem Flaws in previous GAN analysis models.
method Neural Tangent Kernel framework for infinite-width discriminator.
result New insights into GAN convergence and generated distribution.
We prove that the twisted Reidemeister torsion of a 3-manifold corresponding to a fibered class is monic and we show that it gives lower bounds on the Thurston norm. The former fixes a flawed proof in [FV10], the latter gives a quick alternative argument for the main theorem of [FK06].
Smart contracts are a digital technology with potential but also flaws.
problem Understanding the potential and limitations of smart contracts.
method Exploratory study combining statistics, IT, and law.
result Smart contracts have both idealistic promises and practical challenges.
Quantized neural networks are vulnerable to adversarial attacks.
problem Adversarial robustness of quantized neural networks.
method Investigated adversarial robustness of quantized neural networks under different threat models.
result Quantization does not offer robust protection and results in gradient masking.
Notes a flaw in a proof about embedding graphs.
problem A flaw in proving Sachs' conjecture about graph embeddings.
method Analyzing Stanfield's proof for gaps.
result Identifies a significant error in the proof.
We solve Hilbert's fifth problem for local groups: every locally euclidean local group is locally isomorphic to a Lie group. Jacoby claimed a proof of this in 1957, but this proof is seriously flawed. We use methods from nonstandard analysis and model our solution after a treatment of Hilbert's fifth problem for global…
Study flaws in generative model evaluation metrics, especially for diffusion models.
problem Flaws in existing metrics for evaluating generative models, particularly for diffusion models.
method Systematic study of generative models, human perception experiments, and analysis of feature extractors.
result State-of-the-art perceptual realism of diffusion models is not reflected in commonly reported metrics.
New bounds for unsupervised domain adaptation account for non-invertibility and support coverage.
problem Theoretical arguments for domain-invariant representations are flawed and do not account for non-invertibility and support coverage.
method Generalization bounds for any representation function acknowledging the cost of non-invertibility and penalizing distance between densities.
result Proposed bounds based on support coverage provide better generalization than current standard practice.
Corrects errors in Hans' pseudocovering spaces paper.
problem Mathematical errors and citation issues in Hans' pseudocovering spaces paper.
method Identifies and corrects errors in Hans' previous work.
result Addresses mathematical and citation errors in Hans' pseudocovering spaces paper.
AI bias arises from human-defined goals, not algorithmic flaws.
problem AI bias due to human-defined goals in LLMs.
method Purpose-conditioned cognition and revealing downstream use of LLM outputs.
result AI bias can be reduced by purpose-aware prompting but not fully by regularization.
New method corrects bias in feature importance measures of GBM.
problem Bias in feature importance measures of GBM.
method Cross-validated unbiased base learners.
result Significant improvement in feature importance measures with minimal computational cost.
New methods reduce extrapolation errors in feature importance.
problem Flawed feature importance methods using unrestricted permutations lead to extrapolation errors.
method Three new approaches: conditional model reliance, Knockoffs with Gaussian transformation, and restricted ALE plot designs.
result Theoretical and numerical results show our strategies reduce/eliminate extrapolation.
Corrects a flawed proof of the Kropholler Conjecture.
problem Kropholler Conjecture in relative group theory.
method Explains the flaws and proposes possible ways to correct the proof.
result Provides a clearer understanding of the conjecture's proof difficulties.
This paper analyzes stablecoins to address cryptocurrency volatility.
problem Cryptocurrency price volatility hinders adoption.
method Survey of 24 stablecoin projects, combined with monetary policy insights.
result Stablecoin designs often prioritize 1-to-1 stabilization, but literature suggests smoothing volatility is more sustainable.
The study finds flaws in methods used to estimate foreign exchange option prices.
problem Flaws in estimating foreign exchange option prices.
method Provided counterexamples of popular FX option interpolation methods.
result Popular FX option interpolation methods fail in certain scenarios.
Neural networks and linear systems linked, revealing training loss and kernel limitations.
problem Exploring the training loss and limitations of neural networks and their kernels.
method Drawing connections between neural networks and under-determined linear systems, providing lower bounds, and analyzing gradient descent.
result Zero training loss achievable for neural networks under certain conditions, but not for ReLU kernels.