New multi-layer transform models improve image denoising.
problem Improving image denoising techniques.
method Developed multi-layer transform learning algorithms.
result Multi-layer models outperform single-layer schemes in image denoising.
New model for multi-layer categorical data improves latent class analysis.
problem Traditional latent class analysis for single-layer categorical data is insufficient for multi-layer data.
method Developed a multi-layer latent class model (multi-layer LCM) and three spectral methods for estimation.
result The debiased sum of Gram matrices method performs best in estimating latent classes.
New model improves community detection in multi-relational data.
problem Community detection in multi-relational data with multiple types of relations.
method Developed a restricted multi-layer stochastic blockmodel (RMLSBM) and compared it with the multi-layer stochastic blockmodel (MLSBM).
result RMLSBM outperforms MLSBM in certain conditions, improving community detection.
Combines multi-layer graphs to infer global network structure.
problem Leveraging domain knowledge in structure inference for multi-layer graphs.
method Mask combination of multi-layer graphs using optimization.
result Enhanced structure inference through multi-layer graph integration.
Paper proposes a method to predict disk failures using multi-layer domain adaptive learning.
problem Traditional machine learning models struggle to predict disk failures due to limited data.
method Multi-layer domain adaptive learning with source and target domains.
result The proposed method improves failure prediction accuracy on disk data with few failure samples.
Proposes a method for multi-layered network embeddings that improves performance.
problem Mapping multi-layered network nodes into a vector space while preserving relationships.
method Jointly embed nodes in all layers via DeepWalk on a supra graph, then fine-tune embeddings for cohesive structure.
result Outperforms existing single- and multi-layered network embedding algorithms on benchmarks.
Paper presents ML-VAMP for efficient multi-layer inference with exact performance analysis.
problem Inference in multi-layer deep neural networks with non-convex optimization.
method ML-VAMP algorithm for MAP and MMSE estimates, with performance predictions in high dimensions.
result ML-VAMP achieves Bayes-optimal MSE under certain conditions, providing exact performance characterization.
Proposes GrAMME for semi-supervised learning with multi-layered graphs.
problem Semi-supervised learning with multi-layered graphs.
method Uses attention models for feature learning in multi-layered graphs.
result Significant performance improvements over state-of-the-art network embedding strategies.
Paper analyzes convergence of SGD in RNNs, proving linear convergence rate.
problem Analyzing convergence of SGD in multi-layer recurrent neural networks.
method Developed tools to analyze multi-layer networks with ReLU activations.
result SGD achieves linear convergence rate in training RNNs with sufficient neurons.
GCNs improve multi-layer network classification by expanding the distance between means.
problem Improving multi-layer network classification with graphical information.
method Theoretical and empirical study of graph convolutions in multi-layer networks.
result Graph convolutions expand the classification regime by a factor of 1 / E m d e g 4 1/\sqrt[4]{\mathbb{E}{
m deg}} 1/ 4 E m d e g . Two spectral clustering methods for multi-layer networks are analyzed and compared.
problem Community detection in multi-layer networks.
method Sum and debiased sum of squared adjacency matrices for spectral clustering.
result Debiased sum of squared adjacency matrices outperforms sum of adjacency matrices.
Paper optimizes clustering for multi-layer networks and discrete mixtures.
problem Optimizing clustering in multi-layer networks and discrete mixtures.
method Two-stage method: tensor-based initialization and likelihood-based refinement.
result Achieves minimax optimal error rate for multi-layer networks and discrete mixtures.
Framework for integrating multi-layered data from multiple sources.
problem Integrating data from multiple layers and sources.
method Decompose multi-layer problem into two-layer problems, use neighborhood selection and group-penalized regression for sparse estimates, develop debiasing technique and testing procedures.
result Established global and simultaneous testing procedures for inter-layer directed edge weights.
MGCN improves multi-layer graph classification using node attributes and relations.
problem Lack of comprehensive multi-layer graph embedding methods considering node attributes and different types of edges.
method Proposes MGCN, a method that combines GCN for multi-layer graphs, incorporating node attributes and both within and between layer relations.
result MGCN outperforms other multi-layer and single-layer methods in semi-supervised node classification tasks.
New methods estimate mixed memberships in multi-layer networks.
problem Complex community structure in multi-layer networks.
method Spectral methods using eigen-decomposition of aggregate matrices.
result Theoretical guarantees and empirical validation for mixed membership estimation.
Paper introduces MLKM for multi-sensor data association in target localization.
problem Data-target association for efficient multi-target localization.
method Multi-layer K-means approach leveraging K-means++, deep neural networks, and backpropagation.
result MLKM outperforms K-means, K-means++, and deep neural networks in data association.
New algorithm for signal reconstruction from multi-layered measurements.
problem Reconstructing signals from multi-layered non-linear measurements.
method Multi-Layer Approximate Message Passing (ML-AMP) algorithm and state evolution equations.
result Asymptotic free energy and minimal achievable error derived.
TWIST algorithm detects communities in multi-layer networks with tensor decomposition.
problem Community detection in multi-layer networks with multiple node-modality relationships.
method Tensor-based TWIST algorithm for global/local node and layer memberships.
result Accurate community detection with small misclassification error as network size increases.
This work tackles asymmetric community estimation in multi-layer directed networks.
problem Estimating different numbers of sender and receiver communities in multi-layer directed networks.
method Proposes a goodness-of-fit test based on the largest singular value of an aggregated normalized residual matrix.
result Develops sequential and ratio-based testing procedures to consistently determine true sender and receiver community numbers.
Proposes a balanced multi-component and multi-layer neural network for efficient function approximation.
problem Accurately and efficiently approximating complex functions with high degrees of freedom and computational cost.
method Inspired by a multi-component approach, MMNN combines single-layer networks with a multi-layer decomposition strategy.
result Significant reduction in training parameters, more efficient training process, and improved accuracy compared to FCNNs or MLPs.
New AMP algorithms improve multi-layer signal reconstruction.
problem Reconstructing signals and hidden variables from multi-layer networks with rotationally invariant weights.
method Developed multi-layer rotationally invariant generalized AMP (ML-RI-GAMP) algorithms and state evolution recursion.
result ML-RI-GAMP outperforms existing methods in terms of lower complexity and similar performance.
This paper optimizes multi-layer reinsurance policies to minimize risk measures.
problem Minimizing risk for insurance companies with multiple layers of reinsurance.
method Generalizes optimal stop-loss reinsurance to multi-layer policies using conditional tail expectation (CTE) risk measure.
result An optimal multi-layer reinsurance policy can be derived and estimated.
Develops G-MLKM for better data-target association in constrained spaces.
problem Data-target association problem in constrained spaces with limited sensor information.
method Graph-based multi-layer k-means++ (G-MLKM) method, including MLKM for local space and G-MLKM for general constrained space.
result Improves data-target association accuracy through error correction mechanisms.
New methods for community detection in multi-layer networks improve upon existing techniques.
problem Estimating a consensus community structure in multi-layer networks.
method Spectral clustering and matrix factorization methods for low-rank matrix optimization.
result Consistency properties of intermediate fusion techniques under multi-layer stochastic blockmodel.
Enhances relational reasoning with multi-layer architecture.
problem Limited relational reasoning with shallow architectures.
method Multi-layer relation network architecture.
result Solved all 20 tasks in bAbI 20 QA dataset.
New AI algorithm improves multi-layer optical film design efficiency.
problem Traditional algorithms converge to local optima, limiting global optimal solutions.
method Deep Q-learning for global optimal multi-layer optical film design.
result Deep Q-learning model converges global optimum of optical thin film structure.
Proposes mGBDTs for learning hierarchical representations in gradient boosting decision trees.
problem Inability of gradient boosting decision trees to learn hierarchical representations.
method Introduces multi-layered GBDT forest (mGBDTs) with explicit emphasis on hierarchical learning.
result Jointly trained mGBDTs can learn hierarchical representations effectively without backpropagation.
Algorithm predicts performance of learning in multi-layer networks with matrix-valued hidden variables.
problem Signal recovery and learning in multi-layer neural networks with matrix-valued hidden variables.
method Unified approximation algorithm for MAP and MMSE inference, extending ML-VAMP to handle matrix-valued unknowns.
result Performance of ML-Mat-VAMP algorithm can be predicted in a random large-system limit.
New spectral clustering method for multi-layer networks improves accuracy.
problem Detecting community structure in multi-layer networks.
method Integrative spectral clustering based on adaptive layer aggregation.
result Our methods minimize mis-clustering error and outperform existing methods.
Generative model learns multi-layer features from images.
problem Learning multi-layer features from images.
method Probabilistic pooling operation integrated into deep convolutional learning.
result Excellent classification results on MNIST and Caltech 101 datasets.
Paper trains multi-layer SNNs using NormAD for spatio-temporal error backpropagation.
problem Training multi-layer SNNs with non-linear integrate-and-fire dynamics.
method Formulates training as optimization, uses NormAD for iterative synaptic weight update.
result Validated on 2- and 3-layer SNNs solving spike-based XOR and generic problems.
New multi-layer algorithm improves CNN performance.
problem Efficiently modeling and processing information with parsimonious representations.
method Generalized Basis Pursuit to multi-layer setting, proposing ML-ISTA and ML-FISTA algorithms.
result Nested first order algorithms converge to solve the multi-layer problem.
FMMNN combines sine activations with multi-component, multi-layer structure for high-frequency function approximation.
problem Effective representation and learning of high-frequency features in neural networks.
method Introduces FMMNN with sine-type activations and multi-component, multi-layer structure.
result FMMNN achieves strong accuracy and favorable convergence on oscillatory function-approximation benchmarks.
New method provides exact performance guarantees for MAP inference in deep networks.
problem Analyzing MAP inference in deep networks with complex data.
method Multi-layer vector approximate message passing (ML-VAMP) method.
result Mean squared error of ML-VAMP estimate can be exactly characterized in high-dimensional random limit.
Observational data usually comes with a multimodal nature, which means that it can be naturally represented by a multi-layer graph whose layers share the same set of vertices (users) with different edges (pairwise relationships). In this paper, we address the problem of combining different layers of the multi-layer gra…
A model of multi-layer flow network explores international trade dynamics.
problem Analyzing multi-layer flow networks of international trade.
method Flow distances and symmetric minimum flow distance introduced; multi-layer flow network model proposed.
result Clustering patterns in trading 'trophic levels' are similar for different commodities; centrality stratification observed.
Study explores different network frameworks to understand global trade complexity.
problem Understanding the complexity of global trade networks.
method Investigated single-layer, multiplex, and multi-layer international trade networks using World Input-Output Database.
result Multi-layer networks reveal distinct roles of intra- and cross-industry transactions in entropy evolution.
A generative Bayesian model is developed for deep (multi-layer) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up and top-down probabilistic learning. After learning the deep convolutional dictionary, testing is implemented via dec…
This work defines a new function space for multi-layer neural networks.
problem Characterizing the function space of multi-layer neural networks.
method Defining a neural Hilbert ladder (NHL) as an infinite union of reproducing kernel Hilbert spaces (RKHSs).
result Established theoretical properties of the new function space, including generalization guarantees and dynamics of random fields.
Transformed SEER data for better survival curve predictions.
problem Improving survival curve predictions for cancer patients.
method Applied a data transformation to SEER data, used machine learning models (Random Forest and Multi-Layer Perceptron).
result Models predict survival curves with AUC values from .765 to .885.
A novel multi-layer architecture for one-class classification using graph-embedded kernel ridge regression.
problem Outlier detection in one-class classification using only normal samples.
method Stacking various Graph-Embedded Kernel Ridge Regression (KRR) based Auto-Encoders in a hierarchical fashion.
result The proposed method outperforms existing one-class classifiers on 21 benchmark datasets.
Nestedness in global trade network revealed using multi-layer approach.
problem Understanding nested structures in international trade networks.
method Constructed a multi-layer network with countries, industries, and transactions; computed nestedness based on buyers' and sellers' involvement.
result Identified variations of nestedness over time and contributing countries and industries.
Method infers multi-layer networks from gene expression data.
problem Inference of multi-level networks from gene expression data.
method Extension of latent graphical lasso method leveraging group structure.
result Efficacy in retrieving multi-layer network structure from synthetic data.
A new multi-layer attention mechanism improves speech keyword recognition accuracy.
problem Inaccurate attention weights in LSTM networks for speech keyword recognition.
method Introducing information from layers prior to feature extraction into attention weights calculations.
result The proposed multi-layer attention mechanism leads to more accurate attention weights and improved keyword spotting performance.
New method preserves privacy while detecting communities in distributed networks.
problem Privacy-preserving community detection in locally distributed multi-layer networks.
method Privacy-preserving Distributed Spectral Clustering (ppDSC) using randomized response mechanism.
result Developed a novel algorithm that maintains community structure while protecting privacy.
Model financial contagion in a multi-layered network with obligations in illiquid assets.
problem Model financial contagion in a multi-layered network with obligations in illiquid assets.
method Developed a multi-layered financial network model with fire sales, utility maximization, and tâtonnement process.
result Existence and uniqueness of equilibrium portfolio holdings and market prices in a multi-layered financial system.
FPGA-based multi-layer equalizer adapts to changing channels.
problem Real-time adaptation to time-varying channel impairments.
method Multi-layer machine learning on FPGA with on-chip gradient backpropagation training.
result Real-time adaptation to changing channel conditions achieved.
Predicts cellular functions in human tissues using multi-layer networks.
problem Challenges in predicting tissue-specific cellular function.
method Hierarchy-aware unsupervised node feature learning for multi-layer networks.
result Improves prediction accuracy of cellular functions in 48 tissues.