Improves interpretability of neural network intermediate layers by making concept activations more robust and effective.
problem Challenges in interpreting neural network decisions and learning in intermediate layers due to opacity and shared interactions.
method Proposes A-CAV to increase effectiveness and employs Gram-Schmidt process to improve robustness.
result Significant improvement in recall rate of concept images from 18.35% to 76.83% for VGG16, with reduced variance in recall across different random seeds.
The Riemannian geometry is one of the main theoretical pieces in Modern Mathematics and Physics. The study of Riemann Geometry in the relevant literature is performed by using a well defined analytical path. Usually it starts from the concept of metric as the primary concept and by using the connections as an intermedi…
This paper generalizes the envelope of mid-lines to intermediate lines for a plane curve.
problem Understanding the envelope of intermediate lines for a plane curve.
method Using singularity theory techniques to analyze the local behavior of the envelope of intermediate lines.
result The envelope of intermediate lines (EIL) is formed by three disconnected sets: AEIL, the curve itself, and IPTL. Algorithm improves model performance on shifted concepts without retraining.
problem Improving model performance on shifted concepts with limited source data.
method Model consolidation of intermediate internal distributions after adaptation.
result Effective improvement in model performance on shifted concepts.
New curvature concept shows certain manifolds can't have positive curvature.
problem Understanding manifolds that can't have positive curvature metrics.
method Introducing m-intermediate curvature and using stable weighted slicings. result Manifolds Nn=Mn−mimesTm do not admit positive m-intermediate curvature for n≤7. In this paper, we introduce a new concept so called harmonic complex structure by using harmonic theory for vector bundle-valued differential forms. It is a new structure intermediates between complex structure and Kähler structure. From differential geometric viewpoint, it is a natural generalization of Kähler structu…
New framework quantifies and reduces concept-based models' leakage.
problem Information leakage in concept-based models reduces interpretability.
method Information-theoretic framework with CTL and ICL measures.
result Measures predict model behaviour and identify leakage causes.
The paper explains knowledge distillation by analyzing visual concepts in DNNs.
problem Understanding how knowledge distillation affects the learning of visual concepts in deep neural networks.
method The paper proposes three hypotheses and designs mathematical metrics to evaluate feature representations of DNNs.
result The hypotheses were verified through experiments on various DNNs.
Concept bottleneck models enable concept manipulation for model interpretation.
problem Training models to directly predict labels without intermediate concepts.
method Train models to predict intermediate concepts at training time, then use these concepts to predict labels.
result Concept bottleneck models achieve competitive accuracy with standard models while enabling concept manipulation.
PCBM improves neural network generalization by partially observing concepts.
problem Decreased generalization performance due to observing all concepts in CBM.
method Developed a theoretical analysis of PCBM's Bayesian generalization error.
result PCBM's generalization error is lower than CBM's due to partial concept observation.
The study constructs metrics with positive 2nd Ricci curvature on various manifolds.
problem Constructing metrics with positive 2nd Ricci curvature on closed manifolds.
method Generalization of the concept of fatness to ensure the existence of metrics with positive 2nd Ricci curvature on certain homogeneous bundles.
result Infinitely many examples of manifolds with positive 2nd Ricci curvature, including non-simply connected spaces.
In an effort to understand the meaning of the intermediate representations captured by deep networks, recent papers have tried to associate specific semantic concepts to individual neural network filter responses, where interesting correlations are often found, largely by focusing on extremal filter responses. In this …
Introduces pseudo-codecomposition of transformation groups.
problem Understanding and categorizing transformation groups.
method Introduces pseudo-codecomposition and analyzes properties of transformation groups.
result The class of pseudo-codecomposable transformation groups is a proper intermediate class.
Geometric framework detects concept frustration between human concepts and machine representations.
problem Aligning human concepts with machine learning representations.
method Geometric framework and similarity measures for detecting concept frustration.
result Concept frustration affects machine learning model performance and reorganizes learned concept representations.
This paper reviews quantum machine learning from NISQ to fault tolerance.
problem The challenges and opportunities in quantum machine learning.
method Comprehensive review of quantum machine learning concepts.
result Coverage of NISQ and fault-tolerant quantum computing approaches.
CBMs improve interpretability in RUL prediction for aircraft engines.
problem Lack of interpretability in deep learning models for asset prognostics.
method Concept Bottleneck Models (CBMs) for RUL prediction.
result CBMs achieve comparable or superior performance to black-box models while being more interpretable.
Study clarifies Bayesian generalization error in CBM for 3-layered linear neural networks.
problem Understanding the generalization error in concept bottleneck models.
method Mathematical analysis of Bayesian generalization error and free energy in CBM for 3-layered linear neural networks.
result CBM significantly alters the parameter region and Bayesian generalization error compared to standard models.
Although deep convolutional networks have achieved improved performance in many natural language tasks, they have been treated as black boxes because they are difficult to interpret. Especially, little is known about how they represent language in their intermediate layers. In an attempt to understand the representatio…
We review the current state of automatic differentiation (AD) for array programming in machine learning (ML), including the different approaches such as operator overloading (OO) and source transformation (ST) used for AD, graph-based intermediate representations for programs, and source languages. Based on these insig…
We explore the effect of introducing prior information into the intermediate level of neural networks for a learning task on which all the state-of-the-art machine learning algorithms tested failed to learn. We motivate our work from the hypothesis that humans learn such intermediate concepts from other individuals via…
A framework visualizes embedding spaces of neural survival analysis models using anchor directions.
problem Visualizing complex embeddings in neural survival analysis models.
method Estimating anchor directions through clustering or user-supplied concepts, revealing relationships with raw inputs and survival times.
result Visualization strategies reveal how anchor directions relate to raw clinical features and survival time distributions.
Study on rigidity with non-negative intermediate curvature on low-dimensional manifolds.
problem Extending non-existence theorem of positive scalar curvature to product manifolds.
method Introduced intermediate curvature and studied rigidity conditions.
result Rigidity when intermediate curvature is non-negative in low dimensions.
Preserves positive intermediate curvature on manifolds.
problem Obstructs positive intermediate curvature on partial tori.
method Shows smooth interpolation of metrics with positive intermediate curvature.
result Proves non-existence of certain manifolds with positive intermediate curvature.
The study connects manifold topology to metrics with positive intermediate curvature.
problem Understanding the relationship between manifold topology and metrics with positive intermediate curvature.
method Formulated a conjecture and proved it for specific dimensions and conditions.
result Closed, aspherical 6-manifolds cannot admit metrics with positive 4-intermediate curvature.
Transfer learning adapted for hybrid classical-quantum neural networks.
problem Optimizing data preprocessing and feature embedding for quantum processors.
method Adapting transfer learning to hybrid networks, using a pre-trained classical network augmented by a quantum circuit.
result Demonstrated the effectiveness of quantum transfer learning for image recognition and quantum state classification.
New rigidity results for manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
problem Understanding the structure of manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
method Recovering stronger topological rigidity results using higher intermediate Ricci curvatures and nontrivial fundamental groups.
result Stronger topological rigidity results for manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
We analyze social and economic systems with a hierarchical structure and show that for such systems, it is possible to construct thermostatistics, based on the intermediate Gentile statistics. We show that in social and economic hierarchical systems there are elements that obey the Fermi-Dirac statistics and can be cal…
Study on spaces of metrics with intermediate curvature bounds.
problem Understanding spaces of metrics with lower bounds on intermediate curvatures.
method Analyzing spaces of Riemannian metrics with specific curvature bounds on high-dimensional Spin-manifolds.
result Spaces of metrics with positive p-curvature and k-positive Ricci curvature have non-trivial homotopy groups.
Proves metrics with positive intermediate Ricci curvature on complex manifolds.
problem Establishing metrics with positive intermediate Ricci curvature on complex manifolds.
method Canonical variation and surgery techniques.
result Existence of metrics with positive intermediate Ricci curvature on various examples.
Extends Perelman's theorem to positive intermediate curvature conditions.
problem Positive intermediate curvature conditions and their implications.
method Generalization of Perelman's gluing theorem to positive intermediate curvature conditions.
result Observer moduli space can have non-trivial higher homotopy groups.
The study proves that certain manifolds with boundary cannot have metrics with positive intermediate curvatures.
problem Proving the nonexistence of metrics with positive intermediate curvatures on manifolds with boundary.
method Curvature obstruction theorems for manifolds with boundary.
result Topologically nontrivial compact manifolds with boundary cannot have metrics of positive m-intermediate curvature if the boundary is m-convex. Study finds metrics with positive intermediate Ricci curvature on specific low-dimensional manifolds.
problem Existence of invariant metrics with positive intermediate Ricci curvature on low-dimensional cohomogeneity one manifolds.
method Construction of invariant metrics with positive intermediate Ricci curvature on specific manifolds.
result Invariant metrics with positive 4th-intermediate Ricci curvature exist but not for 3rd-intermediate Ricci curvature on certain manifolds.
This paper improves fraud prevention rule sets in fintech by generating diverse rules and finding Pareto-optimal subsets.
problem Improving the quality and flexibility of fraud prevention rule sets in fintech.
method Introducing SpectralRules for generating diverse rules, and PORS for finding Pareto-optimal subsets.
result SpectralRules generates diverse rules that improve the quality of final rule subsets.
Sharp dimension constraints for positive intermediate curvature metrics are established.
problem Proving sharp dimension constraints for metrics with positive intermediate curvature.
method Constructing counterexamples and extending rigidity results.
result Sharp dimension constraints for positive intermediate curvature metrics are established.
This paper introduces a novel approach to measuring privacy risks in deep computer vision models based on intermediate outputs.
problem The exposure of intermediate results in hidden layers of deep computer vision models poses significant privacy concerns.
method The approach leverages Degrees of Freedom (DoF) to evaluate the amount of information retained in each layer and combines this with the rank of the Jacobian matrix to assess sensitivity to input variations.
result The proposed framework provides deeper insights into privacy risks associated with intermediate representations without requiring adversarial attack simulations.
The paper proves manifold splitting theorems with nonnegative intermediate curvature.
problem Proving rigidity results for manifolds with nonnegative intermediate curvatures.
method New recursion theorem for spectral intermediate curvatures and cylindrical splitting theorems.
result Smooth metrics with uniformly positive intermediate curvature constructed.
A framework to explain decoder-only sequence classification models using intermediate predictions.
problem Explaining predictions of decoder-only sequence classification models.
method Progressive Inference framework with Single Pass-Progressive Inference and Multi Pass-Progressive Inference methods.
result Significantly better attributions compared to prior work on text classification tasks.
Polyhedral semantics for intermediate logics; Nerve Criterion ensures completeness.
problem Characterize polyhedrally-complete intermediate logics.
method Developed Nerve Criterion to characterize polyhedrally-complete logics combinatorially.
result Nerve Criterion provides a necessary and sufficient condition for polyhedrally-completeness.
We use a local argument to prove if an r-dimensional torus acts isometrically and effectively on a connected n-dimensional manifold which has positive kth-intermediate Ricci curvature at some point, then r≤⌊2n+k⌋. This symmetry rank bound generalizes those established by Gr…
We give a homological construction of aperiodic tiles for certain open Riemannian surfaces admitting actions of Grigorchuk groups of intermediate growth.
Knowledge distillation (KD) is a popular method for reducing the computational overhead of deep network inference, in which the output of a teacher model is used to train a smaller, faster student model. Hint training (i.e., FitNets) extends KD by regressing a student model's intermediate representation to a teacher mo…
A cost-effective framework for gradual domain adaptation using multifidelity.
problem Degrading prediction performance due to large domain distance.
method Combines multifidelity and active domain adaptation.
result Improves prediction performance with reduced sample cost.
Gradual domain adaptation improves model transfer between domains with intermediate training.
problem Challenges in unsupervised domain adaptation when distribution shifts are large.
method Gradual self-training using intermediate domains along the Wasserstein geodesic.
result GOAT framework generates intermediate domains for improved adaptation.
Study geometric inequalities for CR-submanifolds using curvature invariants.
problem Geometric inequalities for CR-submanifolds in almost Hermitian spaces.
method Comparing mutual curvature invariants with Chen-type invariants and proving geometric inequalities.
result Proved geometric inequalities with intermediate mean curvature squared for CR-submanifolds.
Study shows Gromov's Betti number bound fails for certain intermediate Ricci curvatures.
problem Gromov's Betti number bound for sectional curvature bounded below does not hold for intermediate Ricci curvatures.
method Established a surgery result for Riemannian metrics with Rick>0 and showed failure of Gromov's bound for specific ranges of k. result Gromov's Betti number bound fails for Rick>0 when ⌊n/2floor+2≤k≤n−1. Study analyzes financial intermediation costs in decentralized lending protocols.
problem Understanding the cost of financial intermediation in decentralized lending protocols.
method Analysis of publicly available data on rates, supply, borrow activity, and accounts.
result Ex-post margins are 1% and lower for stablecoin markets.
Improved U-Nets with various intermediate blocks enhance singing voice separation.
problem Improving singing voice separation accuracy using U-Net architectures.
method Implemented and compared U-Nets with different intermediate spectrogram transformation blocks.
result A specific block type achieves state-of-the-art SDR by 0.9 dB.
Intermediate logic of all convex polyhedra is axiomatized.
problem Defining and axiomatizing intermediate logic for convex polyhedra.
method Using Jankov-Fine formulas, classical polyhedral geometry, and p-morphic images to establish completeness.
result A finite axiomatisation of PL for all convex polyhedra.