System identifies and responds to help queries in personal assistants.
problem Difficulty in remembering command structures for various tasks in personal assistants.
method Proposes a C-BiLSTM based classifier and semantic ANN module to detect and respond to help queries.
result System outperforms other approaches in returning relevant responses for help queries.
Bayesian EnKF improves sentence comprehension uncertainty modeling.
problem Uncertainty in human language comprehension, especially with ambiguous inputs.
method Bayesian framework using ensemble Kalman filter (EnKF) for uncertainty quantification.
result Enhanced model's ability to approximate human cognitive processing with linguistic ambiguities.
Activities in reinforcement learning (RL) revolve around learning the Markov decision process (MDP) model, in particular, the following parameters: state values, V; state-action values, Q; and policy, pi. These parameters are commonly implemented as an array. Scaling up the problem means scaling up the size of the arra…
Paper simplifies ANN structure into a functional form.
problem Current ANN structure is complex and difficult to analyze.
method Uses activation integral concept to represent ANN structure as a function.
result Simplified mathematical representation of ANN structure.
Artificial neural networks (ANNs) may not be worth their computational/memory costs when used in mobile phones or embedded devices. Parameter-pruning algorithms combat these costs, with some algorithms capable of removing over 90% of an ANN's weights without harming the ANN's performance. Removing weights from an ANN i…
Paper tackles adversarial attacks on ANN state estimation in smart grids.
problem Adversarial attacks degrade ANN state estimation accuracy without detection.
method Proposes population-based and gradient-based algorithms to generate attack vectors.
result DE algorithm is more effective than SLSQP in generating attack vectors.
Book introduces deep learning methods with math, theory, and applications.
problem Understanding deep learning algorithms and their mathematical foundations.
method Reviews various ANN architectures and optimization methods, covers theoretical aspects.
result Provides a solid mathematical foundation for deep learning.
Transform ANNs into interpretable decision trees.
problem Lack of interpretability in ANNs.
method Developed two MDT algorithms: EC-DT and Extended C-Net.
result Extended C-Net generates the most compact and effective trees.
Study proposes hybrid machine learning models for crop yield prediction.
problem Crop yield prediction for food security.
method Hybrid machine learning models (ANN-ICA and ANN-GWO).
result ANN-GWO model outperformed ANN-ICA in crop yield prediction.
Study compares ANN and GARCH models for volatility prediction across sectors.
problem Comparing ANN and GARCH models for volatility prediction.
method Examined five sectors with low, medium, and high volatility, using three GARCH specifications and three ANN architectures.
result ANN model performs better for low volatility, GARCH for medium and high.
Artificial neural network (ANN) is a very useful tool in solving learning problems. Boosting the performances of ANN can be mainly concluded from two aspects: optimizing the architecture of ANN and normalizing the raw data for ANN. In this paper, a novel method which improves the effects of ANN by preprocessing the raw…
Study examines adversarial robustness of ANN variants, revealing differences in black-box settings.
problem Adversarial robustness of alternative neural network architectures.
method Analysis of conventional, stochastic ANNs, and SNNs across three datasets; experiments in white-box and black-box settings.
result Stochastic ANNs are more robust than conventional ANNs in black-box settings, especially with surrogate attacks.
New method converts ANN gates to SNNs with AMOS neurons for improved image classification.
problem Efficiently converting ANN gates to SNNs for neuromorphic hardware.
method Introducing AMOS conversion for gates in ANNs, improving accuracy and throughput.
result Improved accuracy of SNNs for ImageNet from 74.60% to 80.97%.
Study helps identify which ANN parameters cause forgetting.
problem Catastrophic forgetting in neural networks.
method Determines individual parameter contributions to forgetting.
result Identifies specific ANN parameters causing forgetting.
GPEX interprets deep neural networks without strict assumptions.
problem Interpreting deep neural networks without strict assumptions.
method Derive an evidence lower-bound that encourages GP's posterior to match ANN's output.
result GPs can closely match ANN's outputs without strict assumptions.
Systems based on artificial neural networks (ANNs) have achieved state-of-the-art results in many natural language processing tasks. Although ANNs do not require manually engineered features, ANNs have many hyperparameters to be optimized. The choice of hyperparameters significantly impacts models' performances. Howeve…
New method speeds up image denoising models without sacrificing performance.
problem Efficiently training models for image denoising tasks.
method Introduces superkernel techniques for fast training of dense prediction models.
result Demonstrates effectiveness on SIDD+ benchmark with 6-8 RTX2080 GPU hours.
This paper proposes a data-driven approach, by means of an Artificial Neural Network (ANN), to value financial options and to calculate implied volatilities with the aim of accelerating the corresponding numerical methods. With ANNs being universal function approximators, this method trains an optimized ANN on a data s…
Improved ANN-based Monte Carlo simulation for Higgs decay events.
problem Accurate simulation of Higgs boson decay events.
method Monte Carlo simulation using an Artificial Neural Network (ANN) with improved training algorithm.
result The ANN simulation of Higgs decay is within 0.7% of the true value and achieves 26% unweighting efficiency.
Artificial neural networks (ANNs) have very successfully been used in numerical simulations for a series of computational problems ranging from image classification/image recognition, speech recognition, time series analysis, game intelligence, and computational advertising to numerical approximations of partial differ…
ANNs solve financial option valuation problems without numerical methods.
problem Valuation of European and American financial options.
method Unsupervised learning with artificial neural networks (ANNs) for solving PDEs.
result ANNs accurately compute option values for various stock scenarios.
ANN improves option pricing models by calibrating parameters faster and more accurately.
problem Calibration of GARCH-type option pricing models is computationally intensive and model-dependent.
method Trained ANN models on Monte Carlo simulation data to calibrate GARCH parameters.
result ANN outperforms traditional methods in calibration speed and accuracy.
New ADANNs improve PDE approximations.
problem Approximating operators for parametric PDEs.
method Custom ANN architectures and initialization schemes.
result ADANNs significantly outperform existing methods.
Named-entity recognition (NER) aims at identifying entities of interest in a text. Artificial neural networks (ANNs) have recently been shown to outperform existing NER systems. However, ANNs remain challenging to use for non-expert users. In this paper, we present NeuroNER, an easy-to-use named-entity recognition tool…
New method converts conventional ANNs to SNNs with minimal loss and efficiency.
problem Difficulty in training SNNs directly from conventional ANNs due to discreteness.
method Proposes a novel pipeline combining threshold balance and soft-reset mechanisms for efficient conversion.
result Achieves almost no accuracy loss with only 1/10 of typical SNN simulation time.
Efficient ANN search for sparse embeddings in ads targeting.
problem Efficiently searching near neighbors in sparse data for applications like ads targeting.
method Graph-based ANN algorithms (HNSW, chi-square two-tower model, Sign Cauchy Projections).
result Sparse embeddings and ANN algorithms improve efficiency in EBR applications.
Add expert knowledge to resolve ambiguities in ANN models.
problem Non-unique parameter fitting in material science.
method Augment a black-box ANN model with expert knowledge at two levels.
result Expert knowledge resolves ambiguities in parameter space.
Artificial neural networks (ANNs) have gained a well-deserved popularity among machine learning tools upon their recent successful applications in image- and sound processing and classification problems. ANNs have also been applied for predicting the family or function of a protein, knowing its residue sequence. Here w…
A new multilabel classification framework improves ANN search performance.
problem Efficiently finding approximate nearest neighbors in large datasets.
method Formulated ANN search as a multilabel classification problem, using partitioning classifiers.
result Natural classifier leads to strictly improved performance in ANN search.
ANN model predicts zinc leaching filter cake moisture accurately.
problem Modeling cake moisture in zinc leaching pressure filtration.
method Developed ANN model using 7 parameters.
result High accuracy in predicting cake moisture (R2 > 0.8, MSE < 1e-6).
ANN clusters multi-view data by agglomerating subviews and avoiding postprocessing.
problem Challenges in multi-view clustering, especially subview agglomeration.
method Agglomerative Neural Network (ANN) using Constrained Laplacian Rank.
result ANN outperforms state-of-the-art methods in multi-view clustering.
In this paper, we propose the exponential Levy neural network (ELNN) for option pricing, which is a new non-parametric exponential Levy model using artificial neural networks (ANN). The ELNN fully integrates the ANNs with the exponential Levy model, a conventional pricing model. So, the ELNN can improve ANN-based model…
Novel PairNet speeds up ANN training with fast hyperparameter optimization.
problem Slow training of traditional ANNs with many hyperparameters.
method Partition inputs into subspaces, optimize hyperparameters via linear equations, train local PairNets in subspaces.
result PairNet achieves higher speeds and lower MSEs than traditional ANNs.
Study compares LSTM and ANN architectures for forex prediction, finding ANN more efficient.
problem Forex time series prediction efficiency and resource usage.
method Comparison of Long Short-Term Memory (LSTM) and specialized ANN architectures.
result Specialized ANN architecture performs better with fewer resources and faster execution.
ANN learner finds sparse needles in nonlinear haystacks with high probability.
problem Finding sparse features in nonlinear data.
method Generalized LASSO penalty with stochastic gradient descent, warm-start algorithm.
result Phase transition in ANN learner's ability to find needles, better than other learners.
Proposes a spiking neural network for efficient classification.
problem High computational and power costs of ANNs.
method Random Neural Network (RNN) with spiking neurons.
result Matches classification power of ANNs but with lower energy consumption.
Study compares classification techniques to predict customer churn in banking.
problem Predicting customer churn in banking industry.
method Comparison of six supervised classification techniques (ANN and random forest) on 10000 European bank customers.
result ANN structure with five nodes in a single hidden layer is the best performing classifier.
Abstract Neural Networks (ANNs) improve DNN verification efficiency.
problem Efficiently verify safety-critical DNNs without slowing exponentially.
method Introduces ANNs that use abstract domains and activation functions to overapproximate DNNs.
result ANNs can soundly overapproximate DNNs with fewer nodes, improving verification efficiency.
ANNs overcome curse of dimensionality for heat equation uniform errors.
problem Approximating high-dimensional heat equations with neural networks.
method Developed techniques to estimate uniform L∞-error. result ANNs' parameters grow polynomially with dimension and precision.
ANNs speed up radiation transport solving by 4x with minimal error.
problem Solving large-scale radiation transport problems efficiently.
method Artificial Neural Networks (ANNs) replacing Gaussian Elimination.
result ANNs reduce solution time by at least 4x with 1-3% error.
Existing models based on artificial neural networks (ANNs) for sentence classification often do not incorporate the context in which sentences appear, and classify sentences individually. However, traditional sentence classification approaches have been shown to greatly benefit from jointly classifying subsequent sente…
Study compares forecasting models for European financial markets and cryptocurrencies, finding hybrid ETS-ANN model best.
problem Challenges in predicting financial market fluctuations and cryptocurrency prices.
method Comparative analysis of ARIMA, hybrid ETS-ANN, and kNN models on European financial markets and cryptocurrency data.
result Hybrid ETS-ANN model performs best over extended periods, with moderate accuracy.
ANNs predict SAFARI-1 neutron fluxes with uncertainties.
problem Uncertainty quantification in ANN predictions for SAFARI-1.
method Deep Neural Networks (DNNs) with Monte Carlo Dropout (MCD) and Bayesian Neural Networks (BNN VI) for uncertainty quantification.
result Uncertainty bands envelop noisy measurement data points, indicating good prediction and generalization.
Deep learning models predict chaotic Lorenz 96 system accurately.
problem Predicting short-term and long-term statistics of a multi-scale chaotic system.
method Reservoir computing (RC-ESN), ANN, RNN-LSTM.
result RC-ESN outperforms ANN and RNN-LSTM for short-term prediction.
This study evaluates methods for constructing prediction intervals with neural networks.
problem Lack of confidence measures in neural network predictions limits their applicability.
method Two-step experiment using bootstrapping and conformal inference methods.
result Cross-conformal method provides best performance with reasonable computational burden.
Enhanced Particle Swarm Optimization improves ANN classification accuracy and stability.
problem Improving classification accuracy of ANN models.
method Proposes an enhanced Particle Swarm Optimization for ANN training.
result Significant improvement in classification accuracy through stability analysis.
LIIT uses large deviations to train neural networks faster.
problem Training neural networks requires large amounts of data, leading to inefficiencies.
method LIIT uses large deviations principle to generate and update training samples.
result LIIT achieves similar classification performance with smaller, more representative samples.
The paper monitors artificial neural networks using embeddings and multivariate control charts.
problem Ensuring the stability of artificial neural networks during deployment.
method Monitoring the latent feature representation (embedding) of ANN outputs using multivariate control charts based on data depth and ranks.
result The proposed method effectively detects nonstationary data streams in ANN outputs.