Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

8.3%16.7%25.0%33.3% · Jan 199319922001200920172026
48 results for attentional graph capsule

Proposes a novel framework for multi-label text classification.

problem Lack of coherent consideration of non-consecutive and long-distance semantics and hierarchical relations among labels.
method Hierarchical taxonomy-aware and attentional graph capsule recurrent CNNs framework.
result Significantly improves multi-label text classification performance.

Capsule networks improve performance on image classification tasks with fewer parameters.

problem Improving performance of capsule networks with fewer parameters.
method Inverted dot-product attention routing, Layer Normalization, concurrent iterative routing.
result Improves performance on benchmark datasets CIFAR-10 and CIFAR-100, and performs at-par with ResNet-18.

Paper proposes a capsule attention mechanism for EEG-EOG vigilance estimation.

problem Driver vigilance estimation for safer transportation.
method Capsule attention mechanism following LSTM network for multimodal EEG-EOG analysis.
result Capsule attention improves vigilance estimation robustness and accuracy.

Graph Convolutional Neural Networks (GCNNs) are the most recent exciting advancement in deep learning field and their applications are quickly spreading in multi-cross-domains including bioinformatics, chemoinformatics, social networks, natural language processing and computer vision. In this paper, we expose and tackl…

2018-05-21abs ↗pdf ↗

Capsule Networks have great potential to tackle problems in structural biology because of their attention to hierarchical relationships. This paper describes the implementation and application of a Capsule Network architecture to the classification of RAS protein family structures on GPU-based computational resources. …

2018-08-22abs ↗pdf ↗

With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem about the induced networks of connected directed acyclic graphs. Then, we set up a …

2018-05-09abs ↗pdf ↗

An unsupervised learning algorithm trains capsule networks for generating realistic images.

problem Training capsule networks for generating realistic images without labeled data.
method Developed an unsupervised learning algorithm using dynamic routing and an energy function for capsule networks.
result The algorithm successfully generates realistic looking images from a learned distribution.

A recently proposed method in deep learning groups multiple neurons to capsules such that each capsule represents an object or part of an object. Routing algorithms route the output of capsules from lower-level layers to upper-level layers. In this paper, we prove that state-of-the-art routing procedures decrease the e…

2019-05-21abs ↗pdf ↗

A new capsule routing algorithm derived from Variational Bayes improves performance in neural networks.

problem Improving performance of capsule networks in recognizing objects and their parts.
method Proposed a new capsule routing algorithm derived from Variational Bayes to fit a mixture of transforming gaussians.
result Significant improvement in MNIST to affNIST generalization over previous works.

Capsule networks improve on traditional neural networks by using vector activations.

problem Comparing capsule networks to traditional neural networks to validate their benefits.
method Deep visualization analysis, feature encoding across vector components, and instantiation parameter encoding.
result Capsule features encode information differently and provide benefits in computer vision applications.

Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.

problem Vulnerability of capsule networks to adversarial attacks.
method Compared capsule networks to convolutional neural networks using various adversarial attacks.
result Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.

Researchers share pitfalls and improvements in implementing Hinton's capsule network.

problem Implementation pitfalls in Hinton's capsule network hindered progress in the field.
method Identifying and addressing common mistakes in capsule network implementations.
result Improved implementation of Hinton's capsule network outperforms existing open-source implementations.

A new capsule network framework that preserves input transformations.

problem Inefficiency in learning part-whole relationships and lack of equivariance guarantees in capsule networks.
method Proposes a new capsule network framework that learns to projectively encode pose-variations for every capsule-type of each layer using a trainable, equivariant function over a grid of group-transformations.
result The proposed framework is equivariant and preserves the compositional representation of an input under transformations.

Capsule networks improve temporal data understanding, achieving 96.21% ECG accuracy.

problem Improving temporal data understanding with capsule networks.
method Generated capsules along temporal and channel dimensions, learning contrasting relationships.
result Achieved 96.21% accuracy on ECG signal beat categories, surpassing state-of-the-art.

Stacked Capsule Autoencoders reconstruct objects from images using part relationships.

problem Reconstructing objects from images with robustness to viewpoint changes.
method Two-stage unsupervised capsule autoencoder that predicts part templates and object capsules.
result State-of-the-art results for unsupervised classification on SVHN and MNIST.

A capsule is a collection of neurons which represents different variants of a pattern in the network. The routing scheme ensures only certain capsules which resemble lower counterparts in the higher layer should be activated. However, the computational complexity becomes a bottleneck for scaling up to larger networks, …

2018-08-11abs ↗pdf ↗

Project learns to model Capsule Networks' routing procedures for better expressiveness.

problem Limited expressiveness of Capsule Networks' inner routing procedures.
method Proposes two ways to learn the routing procedure as a network parameter.
result Improved expressiveness of Capsule Networks through learned routing procedures.

Convolutional neural networks (CNNs) have shown remarkable results over the last several years for a wide range of computer vision tasks. A new architecture recently introduced by Sabour et al., referred to as a capsule networks with dynamic routing, has shown great initial results for digit recognition and small image…

2018-04-11abs ↗pdf ↗

Capsule models enforce object pose relationships for robustness, explored with probabilistic generative and variational methods.

problem Enforcing object pose relationships for robustness to viewpoint changes.
method Probabilistic generative model with variational bound, exploring capsule assumptions and inference mechanisms.
result Unified objective and test time optimisation demonstrated for capsule models.

X-Caps improves medical diagnosis explainability by encoding visual attributes in capsules.

problem Uninterpretable predictions from deep neural networks in healthcare.
method Teaches a novel multi-task capsule network to encode high-level visual attributes and malignancy scores.
result X-Caps outperforms state-of-the-art deep dense 3D CNNs in capturing visually interpretable attributes and malignancy prediction.

Capsule networks improve at detecting changes in compositionality with routing.

problem Capsule networks struggle with detecting changes in compositionality.
method Introduced a loss function based on routing entropy to improve compositionality.
result Capsule networks with the new loss function better detect changes in compositionality.

Method screens similar capsule endoscopic images, reducing doctor workload and improving accuracy.

problem Time-consuming and high error rate in manual inspection of large numbers of similar capsule endoscopic images.
method Structural similarity analysis of visually salient areas and hierarchical clustering.
result 76% reduction in similar images, 100% lesion recall, 18-minute average play time.

Capsule Networks have shown encouraging results on \textit{defacto} benchmark computer vision datasets such as MNIST, CIFAR and smallNORB. Although, they are yet to be tested on tasks where (1) the entities detected inherently have more complex internal representations and (2) there are very few instances per class to …

2018-05-18abs ↗pdf ↗

Capsule network (CapsNet) was introduced as an enhancement over convolutional neural networks, supplementing the latter's invariance properties with equivariance through pose estimation. CapsNet achieved a very decent performance with a shallow architecture and a significant reduction in parameters count. However, the …

2019-02-11abs ↗pdf ↗

TreeCaps improves code comprehension for software developers.

problem Processing code efficiently for software developers.
method Tree-based capsule networks for capturing code syntactical structures and dependencies.
result TreeCaps outperforms other approaches in classifying program functionalities.

We present Generative Adversarial Capsule Network (CapsuleGAN), a framework that uses capsule networks (CapsNets) instead of the standard convolutional neural networks (CNNs) as discriminators within the generative adversarial network (GAN) setting, while modeling image data. We provide guidelines for designing CapsNet…

2018-02-17abs ↗pdf ↗

A novel capsule network model improves surrogate modeling and uncertainty quantification from sparse data.

problem Surrogate modeling and uncertainty quantification of systems from sparse data.
method Adapted Capsule Network (CapsNet) architecture into image-to-image regression encoder-decoder network.
result The proposed approach accurately, efficiently, and robustly predicts responses for arbitrary diffusion fields.