In this study, an efficient stochastic gradient-free method, the ensemble neural networks (ENN), is developed. In the ENN, the optimization process relies on covariance matrices rather than derivatives. The covariance matrices are calculated by the ensemble randomized maximum likelihood algorithm (EnRML), which is an i…
ENN neural network learns logical syllogisms using Euler diagrams.
problem Traditional neural networks struggle with logical reasoning, especially syllogisms.
method ENN represents logical relations as Euler diagrams, optimizing syllogism structures with a novel back-propagation algorithm.
result ENN can precisely represent and reason with all 24 syllogism structures.
A new method reduces the time needed for Bayesian optimization by a factor of 10-100.
problem Efficiently scaling Bayesian optimization to many observations.
method Epistemic Nearest Neighbors (ENN) for hyperparameter fitting and UCB acquisition.
result TuRBO-ENN reduces proposal time by one to two orders of magnitude compared to TuRBO.
Novel approach uses ENN for UQ in gust predictions, reducing RMSE and improving confidence.
problem Reducing bias and uncertainty in wind gust predictions.
method Evidential Neural Network (ENN) with Explainable AI.
result 47% reduction in RMSE, 95% coverage of observed gusts at 179 out of 266 stations.
This paper evaluates t-SNE and MDS for reducing dimensions in datasets and classifying them with KNN, ENN, and SVM.
problem Reducing dimensions in datasets for better classification performance.
method t-SNE and MDS applied to nine datasets, followed by KNN, ENN, and SVM classification.
result Performance comparison of t-SNE and MDS with KNN, ENN, and SVM.
Heat demand prediction is a prominent research topic in the area of intelligent energy networks. It has been well recognized that periodicity is one of the important characteristics of heat demand. Seasonal-trend decomposition based on LOESS (STL) algorithm can analyze the periodicity of a heat demand series, and decom…
Machine learning qualifies computers to assimilate with data, without being solely programmed [1, 2]. Machine learning can be classified as supervised and unsupervised learning. In supervised learning, computers learn an objective that portrays an input to an output hinged on training input-output pairs [3]. Most effic…
ENN method uses expectile regression for genetic data analysis of complex diseases.
problem Discover additional genetic variants contributing to complex diseases.
method Developed an expectile neural network (ENN) method integrating expectile regression and neural networks.
result ENN method outperforms existing expectile regression in discovering genetic variants predisposing to sub-populations.
Rotationally equivariant convolutions improve molecular property prediction.
problem Predicting molecular properties using graph neural networks.
method Ablation study with rotationally equivariant and invariant convolutions on QM9 data set.
result Rotationally equivariant layers decrease test error by an average of 23%.
Paper benchmarks quantum neural networks against classical ones for binary classification tasks.
problem Comparing quantum neural networks with classical ones for binary classification.
method Evaluated with two toy examples, focusing on model complexity and training data size.
result EQNN and QNN outperform ENN and DNN for smaller parameter sets and training data samples.
Using artificial neural network for the prediction of heat demand has attracted more and more attention. Weather conditions, such as ambient temperature, wind speed and direct solar irradiance, have been identified as key input parameters. In order to further improve the model accuracy, it is of great importance to und…
EPINET improves neural networks with less computation.
problem Efficiently estimating uncertainty in neural networks.
method Introduces EPINET architecture that augments any neural network with minimal additional training.
result EPINET outperforms large ensembles with significantly less computation.
Enhanced nearest neighbor improves accuracy in crowdsourced data.
problem Noise in crowdsourced labels degrades classification accuracy.
method Developed two algorithms to estimate worker quality and an enhanced nearest neighbor classifier.
result Proposed methods achieve the same regret as oracle version based on expert data.
EnLSTM network improves log generation from small datasets.
problem Generating well logs from small datasets with high accuracy.
method Combining ENN and C-LSTM networks with perturbation methods.
result 34% reduction in mean-square-error compared to existing models.
Study evaluates machine learning methods for uncertainty quantification in complex systems.
problem Accurately quantify epistemic and aleatoric uncertainties in complex dynamical systems.
method Examined Gaussian processes, UQ-augmented neural networks (ENN, BNN, D-NN, G-NN) on two model data sets.
result Concluded on model architecture and hyperparameter tuning for improved UQ accuracy.
This paper surveys various data balancing methods for imbalanced datasets.
problem Imbalanced datasets bias predictions and degrade classifier performance.
method Extensive review of oversampling, undersampling, adaptive, generative, combination, and ensemble methods.
result No single method universally outperforms others; selection depends on dataset characteristics.