Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

51103154205 · Jun 202019922001200920172026
48 results for capsule layers

Capsule networks improve performance on image classification tasks with fewer parameters.

problem Improving performance of capsule networks with fewer parameters.
method Inverted dot-product attention routing, Layer Normalization, concurrent iterative routing.
result Improves performance on benchmark datasets CIFAR-10 and CIFAR-100, and performs at-par with ResNet-18.

Capsule networks can only represent symmetric functions due to routing limitations.

problem Capsule networks' expressivity is limited to symmetric functions.
method Proved and empirically demonstrated that EM-routing and routing-by-agreement prevent capsule networks from distinguishing inputs and their negative counterpart.
result Capsule networks are not universal approximators due to the limitation of expressivity.

An unsupervised learning algorithm trains capsule networks for generating realistic images.

problem Training capsule networks for generating realistic images without labeled data.
method Developed an unsupervised learning algorithm using dynamic routing and an energy function for capsule networks.
result The algorithm successfully generates realistic looking images from a learned distribution.

A new capsule network framework that preserves input transformations.

problem Inefficiency in learning part-whole relationships and lack of equivariance guarantees in capsule networks.
method Proposes a new capsule network framework that learns to projectively encode pose-variations for every capsule-type of each layer using a trainable, equivariant function over a grid of group-transformations.
result The proposed framework is equivariant and preserves the compositional representation of an input under transformations.

A capsule is a collection of neurons which represents different variants of a pattern in the network. The routing scheme ensures only certain capsules which resemble lower counterparts in the higher layer should be activated. However, the computational complexity becomes a bottleneck for scaling up to larger networks, …

2018-08-11abs ↗pdf ↗

In this paper, we propose a capsule-based neural network model to solve the semantic segmentation problem. By taking advantage of the extractable part-whole dependencies available in capsule layers, we derive the probabilities of the class labels for individual capsules through a recursive, layer-by-layer procedure. We…

2019-01-09abs ↗pdf ↗

A new capsule routing algorithm derived from Variational Bayes improves performance in neural networks.

problem Improving performance of capsule networks in recognizing objects and their parts.
method Proposed a new capsule routing algorithm derived from Variational Bayes to fit a mixture of transforming gaussians.
result Significant improvement in MNIST to affNIST generalization over previous works.

Deep CapsNet improves sign language recognition from wearable IMUs.

problem Continuous recognition of sign language from wearable devices.
method Custom CapsNet architecture using deep capsule networks and game theory.
result Improved accuracy of 94% and 92.50% for 3 and 5 routings respectively, compared to 87.99% for CNN.

Capsule network (CapsNet) was introduced as an enhancement over convolutional neural networks, supplementing the latter's invariance properties with equivariance through pose estimation. CapsNet achieved a very decent performance with a shallow architecture and a significant reduction in parameters count. However, the …

2019-02-11abs ↗pdf ↗

Convolutional neural networks (CNNs) have shown remarkable results over the last several years for a wide range of computer vision tasks. A new architecture recently introduced by Sabour et al., referred to as a capsule networks with dynamic routing, has shown great initial results for digit recognition and small image…

2018-04-11abs ↗pdf ↗

Paper proposes a capsule attention mechanism for EEG-EOG vigilance estimation.

problem Driver vigilance estimation for safer transportation.
method Capsule attention mechanism following LSTM network for multimodal EEG-EOG analysis.
result Capsule attention improves vigilance estimation robustness and accuracy.

MKCapsnet improves schizophrenia identification using multi-kernels and dropout.

problem Identifying schizophrenia using existing methods requires two steps and large amounts of data.
method Developed a multi-kernel capsule network (MKCapsnet) inspired by brain anatomy.
result Outperformed state-of-the-art methods in schizophrenia identification.

NASCaps automates CapsNet design for better accuracy and hardware efficiency.

problem Designing Capsule Networks is laborious and inefficient.
method Automated Neural Architecture Search (NAS) with Genetic Algorithm optimization.
result Jointly optimizes network accuracy and hardware efficiency.

Capsule Networks (CN) offer new architectures for Deep Learning (DL) community. Though its effectiveness has been demonstrated in MNIST and smallNORB datasets, the networks still face challenges in other datasets for images with distinct contexts. In this research, we improve the design of CN (Vector version) namely we…

2019-03-18abs ↗pdf ↗

FasTrCaps reduces CapsNet training time by 58.6% while maintaining accuracy.

problem The high training time of Capsule Networks (CapsNets).
method Integrating multiple lightweight optimizations and a novel learning rate policy (WarmAdaBatch) into FasTrCaps framework.
result FasTrCaps framework can reduce CapsNet training time by 58.6% while preserving accuracy.

Capsule networks improve on traditional neural networks by using vector activations.

problem Comparing capsule networks to traditional neural networks to validate their benefits.
method Deep visualization analysis, feature encoding across vector components, and instantiation parameter encoding.
result Capsule features encode information differently and provide benefits in computer vision applications.

Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.

problem Vulnerability of capsule networks to adversarial attacks.
method Compared capsule networks to convolutional neural networks using various adversarial attacks.
result Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.

Researchers share pitfalls and improvements in implementing Hinton's capsule network.

problem Implementation pitfalls in Hinton's capsule network hindered progress in the field.
method Identifying and addressing common mistakes in capsule network implementations.
result Improved implementation of Hinton's capsule network outperforms existing open-source implementations.

Capsule networks improve temporal data understanding, achieving 96.21% ECG accuracy.

problem Improving temporal data understanding with capsule networks.
method Generated capsules along temporal and channel dimensions, learning contrasting relationships.
result Achieved 96.21% accuracy on ECG signal beat categories, surpassing state-of-the-art.

Stacked Capsule Autoencoders reconstruct objects from images using part relationships.

problem Reconstructing objects from images with robustness to viewpoint changes.
method Two-stage unsupervised capsule autoencoder that predicts part templates and object capsules.
result State-of-the-art results for unsupervised classification on SVHN and MNIST.

Project learns to model Capsule Networks' routing procedures for better expressiveness.

problem Limited expressiveness of Capsule Networks' inner routing procedures.
method Proposes two ways to learn the routing procedure as a network parameter.
result Improved expressiveness of Capsule Networks through learned routing procedures.

Capsule Networks have great potential to tackle problems in structural biology because of their attention to hierarchical relationships. This paper describes the implementation and application of a Capsule Network architecture to the classification of RAS protein family structures on GPU-based computational resources. …

2018-08-22abs ↗pdf ↗

Capsule models enforce object pose relationships for robustness, explored with probabilistic generative and variational methods.

problem Enforcing object pose relationships for robustness to viewpoint changes.
method Probabilistic generative model with variational bound, exploring capsule assumptions and inference mechanisms.
result Unified objective and test time optimisation demonstrated for capsule models.

X-Caps improves medical diagnosis explainability by encoding visual attributes in capsules.

problem Uninterpretable predictions from deep neural networks in healthcare.
method Teaches a novel multi-task capsule network to encode high-level visual attributes and malignancy scores.
result X-Caps outperforms state-of-the-art deep dense 3D CNNs in capturing visually interpretable attributes and malignancy prediction.

Capsule networks improve at detecting changes in compositionality with routing.

problem Capsule networks struggle with detecting changes in compositionality.
method Introduced a loss function based on routing entropy to improve compositionality.
result Capsule networks with the new loss function better detect changes in compositionality.

Method screens similar capsule endoscopic images, reducing doctor workload and improving accuracy.

problem Time-consuming and high error rate in manual inspection of large numbers of similar capsule endoscopic images.
method Structural similarity analysis of visually salient areas and hierarchical clustering.
result 76% reduction in similar images, 100% lesion recall, 18-minute average play time.

Capsule Networks have shown encouraging results on \textit{defacto} benchmark computer vision datasets such as MNIST, CIFAR and smallNORB. Although, they are yet to be tested on tasks where (1) the entities detected inherently have more complex internal representations and (2) there are very few instances per class to …

2018-05-18abs ↗pdf ↗

Graph Convolutional Neural Networks (GCNNs) are the most recent exciting advancement in deep learning field and their applications are quickly spreading in multi-cross-domains including bioinformatics, chemoinformatics, social networks, natural language processing and computer vision. In this paper, we expose and tackl…

2018-05-21abs ↗pdf ↗

We present Generative Adversarial Capsule Network (CapsuleGAN), a framework that uses capsule networks (CapsNets) instead of the standard convolutional neural networks (CNNs) as discriminators within the generative adversarial network (GAN) setting, while modeling image data. We provide guidelines for designing CapsNet…

2018-02-17abs ↗pdf ↗