Neural networks can separate non-separable data using feature maps.
problem Non-separable data in neural networks.
method Characterization of feedforward neural networks and use of feature maps.
result ReLU neural networks can separate concentric data.
Neural network classifies liver cancer patients based on genomic data.
problem Classifying liver cancer patients into high-risk and low-risk groups.
method Data expansion using wavelet analysis, compression of wavelet coefficients, training a neural network model.
result The neural network model accurately classifies patients without survival time information.
Convolutional Neural Processes improve data efficiency in neural processes.
problem Improving data efficiency in neural processes for small datasets.
method Convolutional Neural Processes (ConvNPs) improve data efficiency by leveraging translation equivariance and convolutional neural networks.
result ConvNPs enhance the performance of neural processes in small-data problems.
New bound for neural nets on non-iid data.
problem Generalization of deep nets for dependent data.
method Establishes a generalization bound for feed-forward neural networks on φ-mixing data. result Proves neural nets can generalize well on non-iid data.
Survey on graph neural networks for non-Euclidean data.
problem Challenges in processing graph data.
method Taxonomy of graph neural networks.
result Comprehensive overview and taxonomy of GNNs.
COIN++ compresses multiple data types efficiently.
problem Handling diverse data modalities in neural compression.
method Implicit neural representations and modulations quantization.
result Significant compression gains with reduced encoding time.
Proposes TRNN for tensorial time series data analysis.
problem Lack of suitable models for tensorial time series data.
method Introduces Tensorial Recurrent Neural Network (TRNN) based on tensor Tucker decomposition.
result TRNN preserves the spatial or longitudinal dimensions of tensorial time series data.
Survey of data augmentation techniques for time series classification with neural networks.
problem Small datasets in time series recognition.
method Four families of data augmentation: transformation-based, pattern mixing, generative models, and decomposition methods.
result Empirical evaluation of 12 data augmentation methods on 128 datasets.
Simplicial neural networks extend graph neural networks to handle higher-order interactions.
problem Handling higher-order interactions in complex data structures.
method Define a convolution operation for simplicial complexes and use it to construct convolutional neural networks.
result SNNs effectively impute missing data in coauthorship complexes.
Synthetic data training improves neural networks for captcha breaking.
problem Training neural networks with synthetic data for improved performance.
method Connecting synthetic data training to model-based Bayesian inference.
result Demonstrated state-of-the-art performance and posterior uncertainty in captcha breaking.
Graph neural networks extend neural Bayes estimators to irregular spatial data.
problem Estimating parameters from irregular spatial data with computational efficiency.
method Employing graph neural networks to approximate Bayes estimators for irregular spatial data.
result Extending neural Bayes estimation to irregular spatial data with computational benefits.
Proposes a deep neural network for spatial data regression.
problem Regression of spatial data using deep neural networks.
method Localized two-layer deep neural network for spatial data, proving consistency and asymptotic convergence.
result Asymptotic convergence rate is faster than existing methods, demonstrating effectiveness on temperature estimation.
FNNs detect EEG signals without position dependence.
problem Detecting EEG signals without position dependence.
method Shift invariant functional neural networks (FNNs) using FDA methods.
result FNNs outperform FDA benchmarks in EEG classification.
New neural network models for functional data.
problem Handling non-linear functional data.
method Functional Direct Neural Network (FDNN) and Functional Basis Neural Network (FBNN) with gradient-based optimization.
result Demonstrated effectiveness in complex functional models.
Neural networks improve solving inverse PDE problems with noisy data.
problem Solving inverse problems for partial differential equations (PDEs) with noisy and incomplete data.
method Augment classical inverse problem methods with neural networks as a prior.
result Neural networks enhance robustness and accuracy in solving PDE inverse problems.
A hybrid neural network improves robustness in estimating vehicle parameters from noisy data.
problem Estimating parameters of a mechanical vehicle model from noisy acceleration data.
method Introduced a convolutional neural network with two objective functions: naive and hybrid.
result The hybrid objective function outperforms the naive one in robustness on noisy input data.
Study measures impact of data and neural net similarity on transferability in restaurant sales data.
problem Identify indicators for successful transferability of neural nets across different data sets.
method Empirical study on sales data from six restaurants, calculating indicators based on data and neural net similarities.
result Negative correlations between transferability and indicators, allowing better model performance and fewer transfers.
Neural NMF discovers hierarchical topics in multilayer data.
problem Detecting latent hierarchical structure in multilayer data.
method Recursive application of nonnegative matrix factorization (NMF) in layers with backpropagation optimization.
result Neural NMF outperforms other hierarchical NMF methods in synthetic and real-world datasets.
RANP improves neural processes for sequential data.
problem Capturing temporal order and recurrent structure from sequential data.
method Incorporated ANP into a recurrent neural network.
result RANP outperforms NPs and LSTMs in 1D regression and autonomous-driving tasks.
Decodes neural activity to detect context effects in natural settings.
problem Detecting context-dependent changes in neural encoding.
method Decoding-based approach controlling for confounding factors.
result Demonstrates context-dependent changes in neural encoding.
DNDT combines neural networks and decision trees for tabular data.
problem Tabular data processing with interpretability and efficiency.
method Deep Neural Decision Trees (DNDT) using neural networks to model decision trees.
result DNDT achieves both interpretability and efficiency in tabular data processing.
Distributed training of deep neural networks over multiple agents.
problem Scarcity of labeled data and computational resources in training neural networks.
method Distributed learning of deep neural networks over multiple agents using semi-supervised learning.
result Performance similar to a regular neural network trained on a single machine.
Deep neural nets can estimate regression with dependent data without the curse of dimensionality.
problem Regression with dependent data and structural assumptions on the regression function.
method Deep recurrent neural network estimate under suitable structural assumptions.
result Deep neural nets can circumvent the curse of dimensionality for regression with dependent data.
Study uses neural networks to predict stock prices and tests market efficiency.
problem Predicting stock prices from historical data.
method Used Recurrent Neural Networks and Multilayer Perceptrons, compared normalization techniques.
result Found that neural networks can predict stock prices accurately and challenged the efficient-market hypothesis.
Improved neural PDEs trained on augmented data enhance model accuracy and efficiency.
problem Training neural PDEs on limited data to accurately represent complex systems.
method Space-filling sampling of local states to generate augmented training data.
result Data-augmented neural PDEs outperform traditional emulators in accuracy and stability.
New method reconstructs significant parts of training data from neural networks.
problem Understanding and reconstructing training data from neural networks.
method Proposes a novel reconstruction scheme based on recent theoretical results about neural network training.
result Shows that a significant fraction of training data can be reconstructed from neural network parameters.
Deep neural networks automate statistical analysis for big data.
problem Challenges in applying statistical analysis to big data.
method Constructing CNNs for automatic model selection and parameter estimation.
result CNNs demonstrate excellent performance in automatic model selection and estimation.
Paper benchmarks quantum neural networks against classical ones for binary classification tasks.
problem Comparing quantum neural networks with classical ones for binary classification.
method Evaluated with two toy examples, focusing on model complexity and training data size.
result EQNN and QNN outperform ENN and DNN for smaller parameter sets and training data samples.
New method sparsifies hybrid neural ODEs for better performance and stability.
problem Excessive latent states and interactions from mechanistic models lead to training inefficiency and over-fitting.
method Automatic state selection and structure optimization combining domain-informed graph modifications with data-driven regularization.
result Improved predictive performance and robustness with desired sparsity.
Neural Bloom Filters learn set membership in one shot.
problem Efficient set membership for high-throughput data.
method Meta-learning approach to train neural networks for set membership.
result Neural Bloom Filters achieve significant compression gains.
CupNet prunes neural nets for cup-shaped data.
problem Pruning neural networks for cup-shaped data.
method Used simulated cup drawing data to prune a neural network.
result Pruning effectively reduces network size for cup-shaped data.
SSNAS finds neural architectures without labeled data.
problem Limited labeled data for NAS.
method Self-supervised learning for NAS.
result Comparable results to supervised NAS with labeled data.
New method uses unlabelled data to improve Bayesian Neural Networks.
problem Lack of ability to use unlabelled data in conventional Bayesian Neural Networks.
method Self-supervised Bayesian Neural Networks using contrastive pretraining and variational lower bound optimization.
result Prior predictive distributions capture problem semantics better and improve predictive performance.
CNNs encode data augmentation transformations, especially in early layers.
problem Whether neural network features encode data augmentation transformations.
method Systematic approach using pre-trained vision models to predict augmentation transformations.
result Neural network features encode data augmentation transformations, especially in early layers.
The paper uses neural networks to learn system dynamics from data with Lipschitz regularization.
problem Learning governing equations from time-sampled data.
method Lipschitz regularized deep neural networks for ODE system identification.
result Lipschitz regularization improves the smoothness and generalization of the learned function.
Neural networks improve geospatial data analysis by relaxing linearity assumptions.
problem Traditional geospatial analysis assumes linear models, limiting flexibility.
method Embedding neural networks within traditional geostatistical models for non-linear mean functions.
result NN-GLS algorithm provides consistent and scalable predictions for irregular spatial data.
Complex-valued neural networks improve seismic data analysis by preserving phase information.
problem Low-frequency aliasing in seismic data due to discarded phase information.
method Developed complex-valued deep convolutional networks to leverage phase information in deterministic physical data.
result Complex-valued networks outperform real-valued networks in training and inference from deterministic physical data.
The FAIRnets Ontology makes neural networks findable, accessible, interoperable, and reusable.
problem The resource-intensive training of neural networks and the lack of training data availability.
method Development of FAIRnets Ontology to model neural networks on a meta-level and creation of a knowledge graph (FAIRnets) of over 18,400 neural networks.
result The FAIRnets Ontology and knowledge graph enable the reuse and recommendation of neural networks to data scientists.
Proposes a deep neural network for multi-dimensional functional data classification.
problem Classifying multi-dimensional functional data with non-Gaussian distributions.
method Trains a deep neural network on the principle components of the training data.
result FDNN achieves minimax optimality when log density ratio has a locally connected modular structure.
PE-GQNN improves spatial data prediction and uncertainty quantification.
problem Poor calibration of predictive distributions in spatial data models.
method Combines PE-GNNs with Quantile Neural Networks and recalibration techniques.
result PE-GQNN outperforms existing methods in predictive accuracy and uncertainty quantification.
BNP extends Neural Processes using bootstrap to better model uncertainty.
problem Limitation of NP in modeling stochastic processes with a single latent variable.
method Introduces BNP by incorporating bootstrap to estimate uncertainty without assuming a specific form.
result Demonstrates improved flexibility and robustness of BNP on various data types.
The study characterizes neural network capacity using algebraic topology.
problem Characterizing the capacity of neural networks based on data complexity.
method Reframing architecture selection as data complexity understanding, using algebraic topology.
result Neural networks exhibit topological phase transitions at different levels of dataset complexity.
Nonparametric neural-network estimation of current-status data
problem Estimation of conditional cumulative distribution function with current-status data
method Neural-network sieve maximum likelihood estimator
result Explicit convergence rate for Hölder smoothness
Study the effects of data parallelism and sparsity on neural network training.
problem Understanding the effects of data parallelism and sparsity on neural network training.
method Conducted extensive experiments and developed a theoretical analysis.
result Found a general scaling trend between batch size and number of training steps to convergence for the effect of data parallelism, and difficulty of training under sparsity.
A neural network visualizes data structure and concepts.
problem Data visualization and concept understanding.
method Mixing autoencoder and classifier for multi-perspective visualization.
result The network produces different topological maps based on training as autoencoder or classifier.
Automatically mined rules from dependency parsing help neural models learn from less labeled data.
problem Lack of labeled data for aspect and opinion term extraction.
method Automatically mined rules from dependency parsing, applied to auxiliary data, combined with human-annotated data.
result Neural models achieve better performance than state-of-the-art with mined rules and auxiliary data.
Deep neural networks can memorize training data even with just a few more parameters than samples.
problem Deep neural networks memorizing training data in mildly overparametrized regimes.
method Training neural networks with a number of parameters just a constant factor more than training samples.
result Neural networks can achieve 100% accuracy on training data in mildly overparametrized regimes.
Bayesian framework for federated learning of neural networks without data pooling.
problem Scattered data across servers in federated learning problems.
method Bayesian nonparametric framework for neural networks, inference approach.
result Synthesize a more expressive global network with a single communication round.