Benchmark study evaluates 8 clustering methods on 99 UCR time series datasets.
problem Assessing the performance of clustering methods on time series data.
method Examines 8 clustering methods across 3 categories and 3 distance measures on 99 UCR datasets.
result Provides a comprehensive dataset-level assessment of clustering methods.
Dida learns meta-features invariant to feature permutations.
problem Learning invariant meta-features from dataset samples.
method Distribution-based deep architecture inheriting universal approximation and robustness.
result Dida outperforms state-of-the-art methods on dataset-level tasks.
The safety and robustness of learning-based decision-making systems are under threats from adversarial examples, as imperceptible perturbations can mislead neural networks to completely different outputs. In this paper, we present an adaptive view of the issue via evaluating various test-time smoothing defense against …
New local MDI variable importances derived from global scores match Shapley values.
problem Local feature relevance in tree-based models.
method Deriving local MDI importance measure from global scores and linking it to Shapley values.
result Local MDI importances have a natural connection with Shapley values.
BBCI uses meta prediction to estimate causal effects from datasets.
problem Estimating causal effects from observed data.
method Meta prediction to learn causal effect estimation.
result BBCI accurately estimates ATEs and CATEs across various causal inference problems.
Modern instance-based model-agnostic explanation methods (LIME, SHAP, L2X) are of great use in data-heavy industries for model diagnostics, and for end-user explanations. These methods generally return either a weighting or subset of input features as an explanation of the classification of an instance. An alternative …
Selective clustering annotated using modes of projections (SCAMP) is a new clustering algorithm for data in Rp. SCAMP is motivated from the point of view of non-parametric mixture modeling. Rather than maximizing a classification likelihood to determine cluster assignments, SCAMP casts clustering as a searc…
Study finds simple model-agreement scores perform well in various error estimation scenarios.
problem Evaluating model performance on unseen distributions using disparate scoring functions.
method Rigorously studied popular scoring functions (confidence, local manifold smoothness, model agreement) independently of mechanism choice.
result Simple model-agreement scores outperform confidence- and smoothness-based scores in realistic settings with compromised training data.
Combines geometry and topology for analyzing hierarchical datasets.
problem Analyzing complex, hierarchical datasets with irregular structures.
method Combines manifold learning and topological data analysis.
result Superior classification results compared to state-of-the-art methods.
PACE explains ViTs by modeling patch-level concept distributions, surpassing existing methods.
problem Lack of trustworthy post-hoc explanations for Vision Transformers (ViTs)
method Variational Bayesian explanation framework (PACE)
result PACE surpasses state-of-the-art methods in meeting desiderata for ViT explanations.
TabPFN's internal geometry topology correlates with dataset reliability.
problem Understanding TabPFN's behavior on structurally difficult tabular geometries.
method Using zigzag persistent homology, studying TabPFN's internal representations on synthetic tabular tasks with known topology.
result Topology of TabPFN's internal representation geometry is strongly associated with dataset-level reliability.
RCAV quantifies model sensitivity to semantic concepts, improving interpretability methods.
problem Lack of semantic interpretability in image classification models.
method RCAV calculates concept gradients and ascent steps to assess model sensitivity to semantic concepts.
result RCAV yields more accurate and robust interpretations of model behavior.
Measures faithfulness of LLM explanations to reveal hidden biases and misleading claims.
problem LLM explanations can misrepresent the model's reasoning process, leading to over-trust and misuse.
method Defines faithfulness in terms of concept influence and uses counterfactuals and Bayesian models to estimate it.
result Can quantify and discover interpretable patterns of unfaithfulness in LLM explanations.
LLMs struggle with zero-shot annotation tasks due to model-internalized priors.
problem Impact of model-internalized priors on LLM performance in zero-shot annotation tasks.
method Investigated three dimensions: familiarity, decision stickiness, and susceptibility to misaligned task definitions.
result Nearly two-thirds of zero-shot errors are resistant to correction, with a rescue rate of 34.8%. Definition-Specific Familiarity (DSF) shows a positive association with model performance.
New framework assesses neural sensitivity to small perturbations.
problem Comparing neural representations' sensitivity to small changes.
method Local decodable information, Fisher information, and projected pullback/Fisher metric.
result Reveals differences in neural sensitivity not captured by activation alignment.
Proposes a method for multilevel explanations of black-box models.
problem Need for explanations at intermediate or group levels, especially for GDPR compliance.
method Meta-method that builds a multilevel explanation tree using local explainability methods.
result Effective multilevel explanations for groups of data points, including novel test points.
This review compares GAMs and neural networks on real-world tabular data.
problem Comparing the performance and characteristics of GAMs and neural networks in tabular data applications.
method Systematic review following PRISMA guidelines, extracting and analysing key attributes from 143 papers and 430 datasets.
result No consistent evidence of superiority for either GAMs or neural networks, with performance trade-offs depending on dataset characteristics.