CTM uses conjunctive clauses for image recognition, achieving high accuracy.
problem High computational complexity and lack of interpretability in CNNs.
method Introduces Convolutional Tsetlin Machine (CTM) using conjunctive clauses in propositional logic.
result CTM achieves competitive accuracy on various benchmarks, including MNIST and Fashion-MNIST.
RTM extends TM for continuous output problems using conjunctive clauses.
problem Continuous output problems in machine learning.
method Modified inner inference mechanism to produce a single continuous output.
result RTM achieves better regression accuracy with fewer clauses.
Improved Tsetlin Machine reduces hyperparameter complexity.
problem Complex hyperparameter search in Tsetlin Machines.
method Introduces Multigranular Tsetlin Machine (MTM) with varying specificity clauses.
result MTM achieves similar performance with reduced hyperparameter tuning.
Medical applications challenge today's text categorization techniques by demanding both high accuracy and ease-of-interpretation. Although deep learning has provided a leap ahead in accuracy, this leap comes at the sacrifice of interpretability. To address this accuracy-interpretability challenge, we here introduce, fo…
A fast model estimates future prices from orderbook data.
problem Estimating future prices from orderbook data.
method Hyperdimensional vector Tsetlin machine framework for fast estimation.
result Demonstrated robust estimate of future prices.
Faster Tsetlin Machines use clause indexing to speed inference and learning.
problem Overfitting and slow inference in Tsetlin Machines.
method Introduced a look-up table that indexes clauses based on feature falsification, enabling faster evaluation of clauses.
result Up to 15 times faster classification and three times faster learning on MNIST and Fashion-MNIST.
The paper introduces closed-form expressions for interpreting Tsetlin Machines.
problem Interpreting complex Tsetlin Machines with a large number of clauses.
method Developed closed-form expressions for local and global interpretability of Tsetlin Machines.
result The expressions enable real-time feature importance assessment and data clustering.
WTM reduces clause usage and computation time for pattern recognition.
problem High computation time and memory usage in Tsetlin Machine.
method Weighting clauses and using binomial sampling to reduce complexity.
result WTM achieves similar accuracy with fewer clauses and faster training.
Improved RTM uses integer weights to reduce computation and increase interpretability.
problem Lack of interpretability in nonlinear regression models.
method Integer weighted RTM clauses, combined with a novel learning scheme.
result Significantly reduced computation cost with improved accuracy.
This paper is devoted to an elementary new construction of 1-singular Gelfand-Tsetlin modules using complex geometry. We introduce a universal ring Do together with the vector space S=S(Do) with basis Bo=B(Do) formed from some local distributi…
The purpose of this note is to give a simple description of a (complete) family of functions in involution on certain hermitian symmetric spaces. This family, obtained via bi-hamiltonian approach using the Bruhat Poisson structure, is especially simple for the projective spaces, where the formulas in terms of the momen…
We study a class of Poisson-Nijenhuis systems defined on compact hermitian symmetric spaces, where the Nijenhuis tensor is defined as the composition of Kirillov-Konstant-Souriau symplectic form with the so called Bruhat-Poisson structure. We determine its spectrum. In the case of Grassmannians the eigenvalues are the …
Graph convolutional Gaussian processes learn functions on graphs.
problem Learning translation-invariant relationships on non-Euclidean domains.
method Bayesian nonparametric method using graph convolutional neural networks.
result Graph convolutional Gaussian processes outperform existing methods on images and triangular meshes.
New unsupervised learning technique learns independent kernels for better machine learning tasks.
problem Improving unsupervised representation learning for machine learning tasks.
method Stacking convolutional transforms using alternating proximal minimization scheme.
result DCTL outperforms shallow version CTL on benchmark datasets.
New mechanism discovered for feature learning in CNNs.
problem Understanding how CNNs learn features from images.
method Proposed Convolutional Neural Feature Ansatz linking filter covariances to patch-based AGOPs.
result Deep ConvRFM algorithm learns features similar to deep CNNs, improving performance.
L-CNNs learn gauge invariant quantities on lattices.
problem Learning gauge invariant quantities on lattices.
method Novel convolutional layer preserving gauge equivariance and forming Wilson loops.
result L-CNNs can approximate any gauge covariant function on the lattice.
Quantum CNNs improve on multi-channel data processing.
problem Lack of efficient processing for multi-channel data in QCNNs.
method Developed hardware-adaptable quantum circuit ansatzes for convolutional kernels.
result Quantum CNNs outperform existing QCNNs on multi-channel data classification tasks.
TaLK Convolutions improve sequence modeling efficiency.
problem Efficiently modeling sequences with limited time complexity.
method Adaptive convolution operation that learns kernel size.
result Time complexity reduced to O(n), making sequence encoding linear. Molecular "fingerprints" encoding structural information are the workhorse of cheminformatics and machine learning in drug discovery applications. However, fingerprint representations necessarily emphasize particular aspects of the molecular structure while ignoring others, rather than allowing the model to make data-d…
Combines BERT and graph CNN for improved text classification.
problem Text classification problems
method Combining BERT embedding and graph convolutional neural network
result Graph CNN model performs better than classical models combined with BERT
End-to-end graph SVM with graph convolutions and RKHS.
problem Graph classification with complex feature spaces.
method End-to-end training of graph convolutions, kernel function, and SVM parameters.
result Outperforms existing deep learning models on graph classification tasks.
New method learns convolution-like structures from scratch.
problem Learning convolution-like structures from data.
method Minimum description length principle and β-LASSO algorithm. result Learned architectures achieve state-of-the-art accuracies.
This paper tackles spatio-temporal information preservation in machine learning.
problem Conventional machine learning assumes orthogonal data attributes, disrupting spatio-temporal information.
method Shift-invariant k-means, convolutional dictionary learning, and spatio-temporal hypercomplex encoding schemes are proposed.
result Gabor feature extraction outperforms convolutional dictionary learning in spatio-temporal information preservation.
CCR-CNN uses CNN to predict corporate credit ratings from financial data.
problem Lack of data and limited model performance in predicting corporate credit ratings.
method Transform corporations into images and use CNN to analyze complex feature interactions.
result CCR-CNN outperforms state-of-the-art methods in predicting corporate credit ratings.
Graph Convolutional Networks improve performance on complex data.
problem Processing high-dimensional, graph-based data for automation.
method Enhanced existing Graph Convolutional Network models with four improvements.
result Significant performance improvements on four benchmark datasets.
This review explores Convolutional Neural Networks in machine fault diagnosis.
problem Machine fault diagnosis is crucial for safe equipment operation and production.
method Comprehensive review of Convolutional Neural Network (CNN) applications in fault diagnosis.
result A systematic review of CNN-based fault diagnosis methods, covering data collection, model construction, and feature learning.
Machine learning detects building damage in satellite images.
problem Extracting damage information from satellite imagery is slow and labor-intensive.
method Used four convolutional neural network models to detect damaged buildings.
result Models performed well in detecting damaged buildings in the 2010 Haiti earthquake.
Machine learning methods such as convolutional neural networks (CNNs) are becoming an integral part of scientific research in many disciplines, spatial vector data often fail to be analyzed using these powerful learning methods because of its irregularities. With the aid of graph Fourier transform and convolution theor…
RFN improves GCNs for road networks, outperforming state-of-the-art by 21%-40%.
problem Leveraging the structure of road networks effectively in machine learning tasks.
method Introducing RFN, a novel GCN specifically designed for road networks.
result RFN outperforms state-of-the-art GCNs by 21%-40% on road network tasks.
STConvS2S improves weather forecasting using only convolutional layers.
problem Predicting future weather conditions more accurately.
method Proposes a deep learning architecture combining spatiotemporal convolutional layers.
result Outperforms state-of-the-art architectures for forecasting tasks.
L-CNNs preserve gauge symmetry in neural networks.
problem Applying machine learning to lattice gauge theory while preserving gauge symmetry.
method L-CNNs use gauge equivariance to construct a gauge equivariant convolutional layer and bilinear layer.
result L-CNNs achieve higher accuracy in non-linear regression tasks compared to non-equivariant CNNs.
We consider the moduli space M_r of polygons with fixed side lengths in five-dimensional eucledian space. We analyze the local structure of its singularities and exhibit a real-analytic equivalence between M_r and a weighted quotient of the n-fold product of the quaternionic projective line HP^1 by the diagonal PSL(2,H…
Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks. The neural machine translation models often consist of an encoder and a decoder. The encoder extracts a fixed-length representation from a variable-length input sentence, and the decoder generates…
Modern machine learning techniques, such as convolutional, recurrent and recursive neural networks, have shown promise for jet substructure at the Large Hadron Collider. For example, they have demonstrated effectiveness at boosted top or W boson identification or for quark/gluon discrimination. We explore these methods…
In this article, we extend the conventional framework of convolutional-Restricted-Boltzmann-Machine to learn highly abstract features among abitrary number of time related input maps by constructing a layer of multiplicative units, which capture the relations among inputs. In many cases, more than two maps are strongly…
Convolutional DKMs improve kernel methods on MNIST, CIFAR-10, and CIFAR-100.
problem Improving kernel methods for image classification.
method Developed a novel inter-domain inducing point approximation and introduced various techniques to extend DKMs to convolutional networks.
result Achieved state-of-the-art performance on image classification benchmarks.
The paper proposes an ensemble of convolution-based methods for fault detection in gearboxes.
problem Fault detection in planetary gearboxes using vibration signals.
method Ensemble of three convolution kernel-based methods (ROCKET, 1D CNN with ResNet, FCN).
result Outperforms other approaches with over 98.8% accuracy.
Overview of structured data representation methods.
problem Structured data lacks vectorial form, complicating machine learning.
method Various approaches including kernel, distance, neural networks, and graph convolutional networks.
result New approaches like metric learning and recurrent decoder networks have emerged.
PICN learns physical fields from shallow neural networks, improving AI in multi-physical systems.
problem Challenges in modeling and forecasting multi-physical systems due to data scarcity and noise.
method Physics-informed convolutional network (PICN) combining CNN and physical laws, using deconvolution and convolution layers.
result PICN effectively solves and estimates nonlinear physical operator equations and recovers physical information from noisy observations.
Machine learning finds a compact fixed point action for SU(3) gauge theory.
problem Finding accurate and compact parametrizations of fixed point actions for SU(3) gauge theory.
method Used machine learning, specifically a gauge equivariant convolutional neural network.
result Obtained a superior parametrization of a fixed point action for SU(3) gauge theory.
Machine learning methods have found many applications in Raman spectroscopy, especially for the identification of chemical species. However, almost all of these methods require non-trivial preprocessing such as baseline correction and/or PCA as an essential step. Here we describe our unified solution for the identifica…
Convolutional neural networks show promise for flagging potential gravitational-wave signals.
problem Detecting gravitational waves from merging black holes in long data stretches.
method Convolutional neural networks applied to gravitational-wave detection.
result Convolutional neural networks can flag potential signals for follow-up analysis.
Two ML approaches compare in recognizing tables from historical records.
problem Recognizing rows and columns in hand-written registry books.
method Comparison of Conditional Random Field and Graph Convolutional Network.
result Both ML methods achieve an 89 F1 score for table detection.
GCNs improve regression tasks by aggregating neighbor signals.
problem GCNs' statistical properties in regression tasks are poorly understood.
method Examined two GCN convolutions and their impact on learning error.
result GCNs have a bias-variance trade-off that depends on neighborhood size and topology.
Graph ConvNet improves ncRNA classification accuracy.
problem Classifying non-coding RNA sequences into families.
method Graph Convolutional Network model trained on raw RNA graphs.
result 85.73% accuracy and 85.61% F1-score over 13 classes.
Graph convolutional deep kernel machine learns representations for graph tasks.
problem Limited representation learning in infinite-width neural networks.
method Developed a graph convolutional deep kernel machine as an infinite-width limit.
result Representation learning improves performance for heterophilous node classification tasks.
Graph convolutional networks fail to use eigenvectors beyond the first, unlike spectral embedding.
problem Understanding when graph convolutional networks fail compared to spectral embedding.
method Presented a simple generative model to illustrate failure.
result Graph convolutional networks fail to use eigenvectors beyond the first in certain graphs.
Convolutional LSTM improves missing data imputation in spatio-temporal data.
problem Missing data in spatio-temporal data affects analysis performance.
method Proposes a convolutional bidirectional-LSTM for spatio-temporal missing data imputation.
result The proposed model outperforms state-of-the-art methods for missing data imputation.