Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

95190285380 · Jun 202019922001200920172026
48 results for concept activation vectors

RCAV quantifies model sensitivity to semantic concepts, improving interpretability methods.

problem Lack of semantic interpretability in image classification models.
method RCAV calculates concept gradients and ascent steps to assess model sensitivity to semantic concepts.
result RCAV yields more accurate and robust interpretations of model behavior.

In this paper we study a symmetry group of vector space. Basis manifold is a homogeneous space of a symmetry group. This concept leads us to the definition of active and passive transformations on basis manifold. Active transformation can be expressed as a transformation of vector space. Passive transformation gives ab…

2004-12-20abs ↗pdf ↗

Unified framework for testing deep learning models with concept activation vectors.

problem Statistical instability and discontinuity in testing with concept activation vectors.
method Introducing α-TCAV, a generalized framework that replaces the indicator function with a parameterized smooth function.
result Unified probabilistic formulation that subsumes TCAV and Multi-TCAV, providing principled guidance on tuning the parameter.

Deep learning skin lesion classifier explained using CAVs.

problem Limited acceptance of deep learning CAD systems due to opaque decision-making.
method Mapped human understandable concepts to RECOD model using CAVs.
result Classifier learns and encodes disease-related concepts in its latent representation.

Researchers apply concept-based explainability to EEG data.

problem Understanding the internal states of complex EEG transformer models.
method Concept Activation Vectors (CAVs) adapted for EEG data, using externally labeled datasets and anatomically defined concepts.
result Both approaches to concept formation yield valuable insights into EEG model representations.

New neural operators learn structured patterns efficiently.

problem Learning and representing complex, structured patterns in data.
method Sparse autoencoder neural operators (SAE-NOs) parameterize concepts as functions, enabling efficient and structured representation.
result SAE-FNOs learn localized patterns and generalize across different scales and discretizations.

Label space expansion for multi-label classification (MLC) is a methodology that encodes the original label vectors to higher dimensional codes before training and decodes the predicted codes back to the label vectors during testing. The methodology has been demonstrated to improve the performance of MLC algorithms whe…

2016-11-29abs ↗pdf ↗

Active management is a term that has many meanings and we have found the defining characteristics needed for success as an "active manager" elusive within the literature. In this paper we offer a set of criteria that defines an active manager and his success. In order to facilitate this, we introduce several definition…

2019-03-22abs ↗pdf ↗

MCD offers a complete model understanding for high-stake decisions.

problem Local model understanding in XAI methods is not sufficient for high-stake decisions.
method MCD extends concept-based methods to ensure global model understanding via multi-dimensional subspaces.
result MCD provides a complete model understanding, ensuring the model reasoning is related to the actual model.

Abstract framework for no-arbitrage concepts in topological vector lattices.

problem Generalization of no-arbitrage concepts in topological vector lattices.
method Imposing a structural condition on trading strategies and deriving abstract FTAP.
result NUPBR, NAA1_1, and NA1_1 may not be equivalent in general setting.

New method uses weighting vectors for efficient boundary and outlier detection.

problem Boundary and outlier detection in machine learning.
method Recast metric space magnitude as weighting vector, solve kernelized SVM, apply nearest neighbor methods.
result Weighting vector can be efficiently approximated in linear time, outperforming state-of-the-art techniques.

DeepStreamCE detects new classes in streaming deep neural networks.

problem Detecting new classes in deep neural networks in a streaming environment.
method Uses autoencoder and MCOD stream-based clustering for real-time concept evolution detection.
result DeepStreamCE outperforms OpenMax in identifying concept evolution.

In an attempt to gather a deeper understanding of how convolutional neural networks (CNNs) reason about human-understandable concepts, we present a method to infer labeled concept data from hidden layer activations and interpret the concepts through a shallow decision tree. The decision tree can provide information abo…

2019-06-11abs ↗pdf ↗

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts with exponentially fewer labeled samples. While previous results show that active…

2019-07-08abs ↗pdf ↗

FedMAX tackles activation divergence in FL, improving accuracy and efficiency.

problem Activation divergence in Federated Learning due to non-IID data.
method Introduced a prior based on maximum entropy to minimize information about per-device activation vectors and make similar classes more alike.
result Significantly more similar activation vectors across multiple devices, leading to better accuracy and efficiency.

DORA analyzes deep neural networks' internal representations to detect spurious correlations.

problem Detecting spurious correlations in deep neural networks' internal representations.
method DORA uses Extreme-Activation (EA) distance measure to assess representation similarities.
result Identifies internal representations capable of detecting spurious correlations.

The aim of the present paper is to investigate intrinsically the notion of a concircular ππ-vector field in Finsler geometry. This generalizes the concept of a concircular vector field in Riemannian geometry and the concept of a concurrent vector field in Finsler geometry. Some properties of concircular ππ-vector fie…

2012-08-14abs ↗pdf ↗

Classifiers operating in a dynamic, real world environment, are vulnerable to adversarial activity, which causes the data distribution to change over time. These changes are traditionally referred to as concept drift, and several approaches have been developed in literature to deal with the problem of drift handling an…

2018-03-24abs ↗pdf ↗

The paper proposes methods to find a shared active subspace for multivariate vector-valued functions.

problem Minimizing the deviation between function evaluations in the original and reconstructed spaces.
method Manipulating gradients or SPD matrices to identify a shared structure.
result Summing SPD matrices often identifies the best shared active subspace.

Study uses neural networks to improve option pricing accuracy.

problem Reducing variance in Monte Carlo estimators for option pricing.
method Characterizes neural networks' universal approximation property and applies it to sampling measures.
result Sampling measures generated by neural networks can approximate optimal measures arbitrarily well.

Universal approximation for ODENet and ResNet with a single activation function.

problem Approximating complex dynamical systems with limited vector fields.
method Examined ODENet and ResNet with vector fields composed of a single activation function and affine mapping.
result ODENet and ResNet with restricted vector fields can uniformly approximate those with general vector fields.

To date, the tightest upper and lower-bounds for the active learning of general concept classes have been in terms of a parameter of the learning problem called the splitting index. We provide, for the first time, an efficient algorithm that is able to realize this upper bound, and we empirically demonstrate its good p…

2017-02-27abs ↗pdf ↗

A framework monitors and diagnoses concept drift in supervised learning models.

problem Changes in predictive relationships over time render models suboptimal.
method Score vector monitoring using exponentially weighted moving average.
result Score-based approach detects concept drift more effectively than error-based methods.

Unified Bayesian model explains in-context learning and activation steering in LLMs.

problem Understanding and controlling the behavior of large language models (LLMs) through prompts and activations.
method Developed a Bayesian model to explain and predict the effects of in-context learning and activation steering.
result Unified model predicts distinct phases and sudden shifts in LLM behavior, explaining prior empirical phenomena.

BALLAST optimizes Lagrangian observer placement for ocean vector fields.

problem Optimizing Lagrangian observer placement for time-dependent ocean vector fields.
method Bayesian active learning with look-ahead amendment for sea-drifter trajectories using a physics-informed spatio-temporal Gaussian process surrogate model.
result Noticeable benefits of BALLAST-aided observer placement strategies on synthetic and high-fidelity ocean models.

This research integrates attention into XAI frameworks for better model explanations.

problem Improving the interpretability of transformer models.
method Developed two novel explanation methods: Shapley value decomposition and token-level directional derivatives.
result Attention weights can be meaningfully incorporated into XAI frameworks, enhancing transformer explainability.

VICE embeds concepts in a vector space using human data.

problem Developing numerical models for mental representations of object concepts.
method Variational Interpretable Concept Embeddings (VICE) using variational inference and triplet odd-one-out task data.
result VICE outperforms SPoSE at predicting human behavior and provides more reproducible object representations.

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on self-supervision which leverages the concept of disentanglement. Instead of requesting labels from human oracle, our method automatically labels the majority of the datapoints, thus drastically reducing the human labeling b…

2019-12-15abs ↗pdf ↗

We study covariance matrix estimation for the case of partially observed random vectors, where different samples contain different subsets of vector coordinates. Each observation is the product of the variable of interest with a 010-1 Bernoulli random variable. We analyze an unbiased covariance estimator under this mod…

2018-04-04abs ↗pdf ↗