New method transplants specific neural networks to generic ones without training samples.
problem Learning massive tasks and categories requires collecting samples for all at once.
method Designs a functionally interpretable generic network and uses back-distillation for transplanting.
result Method without training samples outperforms with 100 samples.
This paper focuses on a new task, i.e., transplanting a category-and-task-specific neural network to a generic, modular network without strong supervision. We design an functionally interpretable structure for the generic network. Like building LEGO blocks, we teach the generic network a new category by directly transp…
Category theory enhances understanding of group-equivariant neural networks.
problem Understanding and working with group-equivariant neural networks.
method Application of category theory to tensor power spaces of Rn for groups Sn, O(n), Sp(n), and SO(n). result New insights and an algorithm for computing equivariant linear layers.
We symmetrise neural networks for groups using Markov categories.
problem Convert H-equivariant networks to G-equivariant networks. method Formulate in Markov categories, abstracting measure-theoretic details.
result Flexible and compositional framework for symmetrisation.
To the best of our knowledge, this paper presents the first large-scale study that tests whether network categories (e.g., social networks vs. web graphs) are distinguishable from one another (using both categories of real-world networks and synthetic graphs). A classification accuracy of 94.2% was achieved using a …
In image classification, visual separability between different object categories is highly uneven, and some categories are more difficult to distinguish than others. Such difficult categories demand more dedicated classifiers. However, existing deep convolutional neural networks (CNN) are trained as flat N-way classifi…
Two-stage neural network for few-shot image recognition.
problem Few-shot image recognition for novel categories.
method Multi-layer neural network with feature extraction and classification stages.
result Competitive performance on four standard datasets.
Lie groupoid equivariant neural networks are a new type of neural network.
problem Designing neural networks that respect the structure of Lie groupoids.
method Introducing Lie groupoid equivariant convolutions and layers, and showing their equivalence to Lie algebroid-equivariant networks.
result Lie groupoid equivariant neural networks are equivalent to certain Lie algebroid-equivariant networks.
Neural networks classify OOD images by their nearest neighbor in training data.
problem Understanding out-of-distribution prediction behavior of neural networks.
method Nearest category generalization (NCG) measure to assess OOD prediction accuracy.
result Adversarially robust networks have higher NCG accuracy than natural training, indicating local regularization impacts decision regions.
Deep Neural Networks, and specifically fully-connected convolutional neural networks are achieving remarkable results across a wide variety of domains. They have been trained to achieve state-of-the-art performance when applied to problems such as speech recognition, image classification, natural language processing an…
Paper proposes CNE-net to tackle incremental learning in (T)ACSA tasks.
problem Catastrophic forgetting in multi-task incremental learning for (T)ACSA.
method Category Name Embedding network (CNE-net) with shared encoder and decoder.
result State-of-the-art performance on (T)ACSA benchmark datasets.
GRU-PFG model extracts inter-stock correlations from stock factors using graph neural networks.
problem Limited effectiveness of models relying solely on stock factors for capturing stock correlations.
method Project stock factors into a graph and use graph neural networks to extract inter-stock correlations.
result Achieves better prediction results than models relying solely on stock factors and comparable to second category models.
We propose using category theory to unify deep learning architectures.
problem Lack of a coherent bridge between model constraints and implementations.
method Apply category theory to unify neural network design.
result Theory recovers constraints from geometric deep learning and encodes standard constructs.
Framework orders categories and measures differences from real data.
problem Inferring orders and differences between categories.
method Nonparametric Estimation statistics framework.
result Scalable framework for large datasets.
Verification determines whether two samples belong to the same class or not, and has important applications such as face and fingerprint verification, where thousands or millions of categories are present but each category has scarce labeled examples, presenting two major challenges for existing deep learning models. W…
JD.com uses a new CNN model to improve ad click prediction.
problem Improving CTR prediction for ads with visual content.
method Proposes Category-specific CNN (CSCNN) to incorporate category knowledge early in the feature extraction process.
result CSCNN outperforms existing methods in CTR prediction.
Constructs dg categories from surfaces using Khovanov homology.
problem Categorify quantum topology using surfaces and Khovanov homology.
method Constructs dg categories from surfaces using structures in Khovanov homology.
result Unified perspective on various categorified quantum topology constructions.
Adversarial MoE learns category-specific models for product search.
problem Variations in product features and importance across categories.
method Mixture of Experts with adversarial regularization and soft gating constraints.
result Improved clustering of gate output vectors and shared experts among similar categories.
A new neural network model enhances adversarial robustness without sacrificing task performance.
problem Adversarial attacks on neural networks deployed in real-world scenarios.
method Proposes a novel neural network paradigm where each parameter is modeled as a statistical distribution with learnable parameters.
result Demonstrates highly robust performance to various adversarial attacks while maintaining task-specific performance.
PC-GAIN improves GAIN's imputation by incorporating category information.
problem Missing data in incomplete datasets.
method Pre-training with pseudo-labels and incorporating an auxiliary classifier into GAIN.
result Significantly improved imputation quality compared to GAIN.
SessionPath improves category suggestions in type-ahead search.
problem Improving precision and recall in eCommerce type-ahead suggestions.
method SessionPath uses session embeddings and a probability distribution model to predict facets.
result SessionPath outperforms count-based and neural models in eCommerce shops.
New approach uses neural networks to learn program structure and parameters.
problem Learning programs and their structure efficiently.
method Free category prior over programs, end-to-end learning of structure and parameters.
result Neural networks can serve as primitives in probabilistic programs.
Researchers develop a neural network that learns like humans, overcoming forgetting and structure issues.
problem Catastrophic forgetting and structure limitations in neural networks.
method Memory playback strategy and dynamic structure extension using conditional variational autoencoder (CVAE).
result The method effectively prevents forgetting and allows for dynamic network growth.
Many systems of interest in science and engineering are made up of interacting subsystems. These subsystems, in turn, could be made up of collections of smaller interacting subsystems and so on. In a series of papers David Spivak with collaborators formalized these kinds of structures (systems of systems) as algebras o…
Model reconstructs novel 3D shapes with a single prior image.
problem Generalizing single-view 3D reconstruction to new classes with limited data.
method Reframes reconstruction as refinement of a provided prior shape.
result Model reconstructs novel classes with limited training data.
The interdependent nature of the global economy has become stronger with increases in international trade and investment. We propose a new model to reconstruct the international trade network and associated cost network by maximizing entropy based on local information about inward and outward trade. We show that the tr…
Researchers create a probabilistic model for Bitcoin transactions.
problem Understanding the structure and behavior of Bitcoin transactions.
method Formulated a probabilistic model of Bitcoin transactions, derived graphical models, and evaluated performance.
result Derived asymptotic bounds on privacy properties and presented a discriminative model of agent categories.
Deep learning system classifies phonological categories from EEG data.
problem Speech-related BCI for people with speaking disabilities.
method Hierarchical deep learning approach using CNN, LSTM, and autoencoder.
result Average accuracy of 77.9% across five binary classification tasks.
We consider the task of one-shot learning of visual categories. In this paper we explore a Bayesian procedure for updating a pretrained convnet to classify a novel image category for which data is limited. We decompose this convnet into a fixed feature extractor and softmax classifier. We assume that the target weights…
An algorithm for efficient computation of equivariant neural network layers.
problem Efficiently computing with Brauer's group equivariant neural network layers.
method Category theoretic constructions and Kronecker product matrices.
result Significant reduction in computational cost compared to naive implementation.
In human cognition, the expansion of perceived between-category distances and compression of within-category distances is known as categorical perception (CP). There are several hypotheses about the causes of CP (e.g., language, learning, evolution) but no functional model. Whether CP is essential to categorisation or …
XTNet estimates complex cross-treatment effects in multi-category, multi-valued settings.
problem Challenges in estimating causal effects for multi-category, multi-valued treatments.
method Dynamic Neural Masking for capturing treatment interactions without restrictive assumptions.
result XTNet consistently outperforms state-of-the-art baselines in multi-category, multi-valued treatment effect estimation.
ConvMFiT classifies client utterances in counseling dialogues.
problem Classifying client utterances for better counseling outcomes.
method Fine-tuning a pre-trained conversation model on counselor-client dialogues.
result ConvMFiT outperforms state-of-the-art models in classification.
This paper has been withdrawn from arXiv.org due to a disagreement among the authors related to several peer-review comments received prior to submission on arXiv.org. Even though the current version of this paper is withdrawn, there was no disagreement between authors on the novel work in this paper. One specific issu…
The paper develops spectral networks in symplectic topology and their relation to Lagrangian fillings.
problem Understanding spectral networks in symplectic topology and their role in Lagrangian fillings.
method Analytic results on adiabatic degeneration of Floer trajectories and explicit computation of continuation strips.
result Established equivalence between Family Floer functor and non-abelianization functor for Lagrangian fillings with spectral networks.
Project extends emotion recognition database and trains neural networks for categorical and dimensional emotions.
problem Understanding and recognizing emotions for human-computer interaction, safety, and medical research.
method Training CNN + RNN models with emotion category and valence/arousal representations, comparing three model types.
result Categorical emotion recognition performance improves with combined model training.
Proposes a new neural network approach to credit assignment.
problem Credit assignment problem in deep neural networks.
method Contrastive similarity matching objective function.
result Deep networks learn to match similarity between layers.
Deep learning methods improve subsurface flow modeling efficiency.
problem Efficiently modeling subsurface flow with uncertain parameters.
method Two categories of deep-learning based inverse modeling methods: surrogate-based and direct.
result Deep-learning methods significantly accelerate subsurface flow modeling.
Studies amenable category's monotonicity and its relation to topological complexity.
problem Monotonicity of amenable category for degree-one maps.
method Uses amenable covers and compares with topological complexity.
result Establishes a relation between amenable category and topological complexity.
To each oriented surface S, we associate a differential graded category Ko(S). The homotopy category Ho(Ko(S)) is a triangulated category which satisfies properties akin to those of the contact categories studied by K. Honda. These categories are also related to the algebraic contact categories of Y. Tian and to the bo…
The output scores of a neural network classifier are converted to probabilities via normalizing over the scores of all competing categories. Computing this partition function, Z, is then linear in the number of categories, which is problematic as real-world problem sets continue to grow in categorical types, such as …
Survey visual analytics methods for detecting anomalous user behaviors.
problem Understanding and detecting anomalous user behaviors in various domains.
method Survey and classification of visual analytics methods in four categories.
result Discussion of findings and potential research directions.
Prototype-based memory network learns visual categories from unlabeled data.
problem Learning from nonstationary, unlabeled data with sequential dependencies.
method Online prototype-based memory network with contrastive loss.
result Significantly better category recognition compared to state-of-the-art methods.
Innovative 2-categories create 4-manifold invariants.
problem Constructing invariants for 4-manifolds.
method Semisimple 2-categories, fusion 2-categories, and state-sum construction.
result Construct a state-sum invariant for 4-manifolds.
A new method for clearing liability networks using sheaves on directed hypergraphs.
problem Clearing in liability networks using a novel mathematical approach.
method Associate a liability sheaf on a directed hypergraph to a liability network, identifying clearing configurations as global sections of this sheaf.
result Clearing configurations are precisely the global sections of the sheaf, and the sheaf construction is functorial under change of coefficient category.
Formulates a new connection between topological and geometric categories.
problem No specific problem stated; focuses on category formulation.
method Formulates a connection between a topological and geometric category.
result Provides a more precise and improved version of a previous proposal.
Model predicts personality traits from Facebook Likes.
problem Predicting personality traits from social media data.
method Mapped Facebook Likes to page categories, used machine learning.
result 83% accuracy distinguishing religious vs non-religious.
Unified understanding of neural representation similarity measures.
problem Fragmented research landscape of neural network similarity measures.
method Observation and exploration of connections between shape distances and normalized Bures similarity.
result Cosine of the Riemannian shape distance equals normalized Bures similarity.