The paper discusses regularization properties of artificial data for deep learning. Artificial datasets allow to train neural networks in the case of a real data shortage. It is demonstrated that the artificial data generation process, described as injecting noise to high-level features, bears several similarities to e…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “artificial networks”
Survey on AI math foundations, focusing on neural networks.
problem Lack of rigorous mathematical foundation for AI.
method Survey and discussion of theoretical directions in AI.
result Discussion of open problems in AI math.
In this work, we propose a generalized likelihood ratio method capable of training the artificial neural networks with some biological brain-like mechanisms,.e.g., (a) learning by the loss value, (b) learning via neurons with discontinuous activation and loss functions. The traditional back propagation method cannot tr…
The paper monitors artificial neural networks using embeddings and multivariate control charts.
problem Ensuring the stability of artificial neural networks during deployment.
method Monitoring the latent feature representation (embedding) of ANN outputs using multivariate control charts based on data depth and ranks.
result The proposed method effectively detects nonstationary data streams in ANN outputs.
We extend the empirical results published in article "Empirical Evidence on Arbitrage by Changing the Stock Exchange" by means of machine learning and advanced econometric methodologies based on Smooth Transition Regression models and Artificial Neural Networks.
Asymptotic properties of one-layer artificial neural networks with sparse connectivitycond-mat.dis-nn
Law derived for neural networks with sparse connections.
problem Understanding the behavior of neural networks with sparse connections.
method Law of large numbers for empirical distribution of parameters derived.
result Law for neural networks with sparse connections derived.
The validity of the Efficient Market Hypothesis has been under severe scrutiny since several decades. However, the evidence against it is not conclusive. Artificial Neural Networks provide a model-free means to analize the prediction power of past returns on current returns. This chapter analizes the predictability in …
Neural network solves inverse problem in multiscale mechanics.
problem Identifying elastic properties of random materials.
method Artificial neural networks trained on processed databases.
result Robust identification method validated with synthetic and real data.
We propose and systematically evaluate three strategies for training dynamically-routed artificial neural networks: graphs of learned transformations through which different input signals may take different paths. Though some approaches have advantages over others, the resulting networks are often qualitatively similar…
In recent years, China, the United States and other countries, Google and other high-tech companies have increased investment in artificial intelligence. Deep learning is one of the current artificial intelligence research's key areas. This paper analyzes and summarizes the latest progress and future research direction…
Recent work suggests goal-driven training of neural networks can be used to model neural activity in the brain. While response properties of neurons in artificial neural networks bear similarities to those in the brain, the network architectures are often constrained to be different. Here we ask if a neural network can…
Bayesian ANN method predicts chaotic systems with uncertainty.
problem Estimating chaotic dynamical systems from noisy data.
method Bayesian Artificial Neural Networks for ODE inverse problems.
result Accurate time predictions and uncertainty bounds.
In this paper, we propose generating artificial data that retain statistical properties of real data as the means of providing privacy with respect to the original dataset. We use generative adversarial network to draw privacy-preserving artificial data samples and derive an empirical method to assess the risk of infor…
In order to study the application of artificial intelligence (AI) to dental imaging, we applied AI technology to classify a set of panoramic radiographs using (a) a convolutional neural network (CNN) which is a form of an artificial neural network (ANN), (b) representative image cognition algorithms that implement scal…
Artificial Neural Network (ANN) based model is a computational approach commonly used for modeling the complex relationships between input and output parameters. Prediction of the flow rate of a river is a requisite for any successful water resource management and river basin planning. In the current survey, the effect…
New learning algorithm mimics biological neural networks.
problem Biologically implausible backpropagation for directed neural networks.
method Introduces new neuronal dynamics and learning rule for arbitrary architectures, sparsity-inducing pruning method, and dynamical-systems characterization.
result Prunes irrelevant connections and improves learning efficiency.
Critical learning periods found in deep linear networks too.
problem Understanding why critical learning periods emerge in both biological and artificial networks.
method Focused on deep linear network models, analyzed depth and data distribution, and examined multi-task learning.
result Critical periods depend on model depth and data distribution structure, and pre-training can affect transfer performance.
The paper argues that machine learning is a falsificationist process.
problem The role of falsification in machine learning is underexplored.
method The paper presents a falsificationist account of artificial neural networks, emphasizing empirical risk minimization and implicit regularization.
result Artificial neural networks can be seen as a falsificationist process, rejecting inadequate prediction rules.
This paper presents the application of a newly developed nature-inspired metaheuristic optimization method, namely the Adaptive Wind Driven Optimization (AWDO), to the training of feedforward artificial neural networks (NN) and presents a discussion into the future research of AWDO implementation in Deep Learning (DL).…
One of the big restrictions in brain computer interface field is the very limited training samples, it is difficult to build a reliable and usable system with such limited data. Inspired by generative adversarial networks, we propose a conditional Deep Convolutional Generative Adversarial (cDCGAN) Networks method to ge…
This paper expresses the structure of artificial neural network (ANN) as a functional form, using the activation integral concept derived from the activation function. In this way, the structure of ANN can be represented by a simple function, and it is possible to find the mathematical solutions of ANN. Thus, it can be…
In this note we propose a method based on artificial neural network to study the transition between states governed by stochastic processes. In particular, we aim for numerical schemes for the committor function, the central object of transition path theory, which satisfies a high-dimensional Fokker-Planck equation. By…
Deep Calibration With Artificial Neural Network: A Performance Comparison on Option Pricing Modelsq-fin.MF
ANN improves option pricing models by calibrating parameters faster and more accurately.
problem Calibration of GARCH-type option pricing models is computationally intensive and model-dependent.
method Trained ANN models on Monte Carlo simulation data to calibrate GARCH parameters.
result ANN outperforms traditional methods in calibration speed and accuracy.
Our objective is to estimate the unknown compositional input from its output response through an unknown system after estimating the inverse of the original system with a training set. The proposed methods using artificial neural networks (ANNs) can compete with the optimal bounds for linear systems, where convex optim…
This paper provides an overview of activation functions in neural networks.
problem Confusion in activation function selection and properties in deep learning.
method Analytic review of popular activation functions.
result Clarification of activation function properties and selection.
This paper explores deep learning in music generation, from history to current techniques.
problem Creating music automatically using deep learning.
method Analysis of historical and recent deep learning music generation systems.
result Deep learning can learn musical styles and generate music samples.
TANNs integrate thermodynamics into ANN models for accurate, consistent predictions.
problem Lack of rigorous physics-based approach in ANN constitutive modeling.
method TANNs encode thermodynamics principles in neural network architecture using automatic differentiation.
result TANNs produce thermodynamically consistent predictions without requiring large datasets.
Paper proposes a DRL-based controller for networked AP systems that reduces communication frequency.
problem Reduce communication frequency in networked AP systems while maintaining control performance.
method Develops a DRL-based controller that avoids explicit update timing learning, using a semi-Markov decision process (SMDP).
result Improves communication efficiency without sacrificing control performance.
An artificial agent for financial risk and returns' prediction is built with a modular cognitive system comprised of interconnected recurrent neural networks, such that the agent learns to predict the financial returns, and learns to predict the squared deviation around these predicted returns. These two expectations a…
Study enhances neural network interpretability through statistical methods.
problem Complexity and interpretability challenges in neural networks.
method Theoretical framework, statistical tests, dimensionality reduction algorithms.
result Developed bootstrapping technique and statistical tests for ANN performance.
Graphs represent natural and artificial systems; ML can learn from them.
problem Representing and analyzing complex systems using graphs.
method Graph Neural Networks (GNNs) for learning from graph data.
result GNNs enable learning from diverse graph-based data.
Artificial Neural Networks (ANNs) have received increasing attention in recent years with applications that span a wide range of disciplines including vital domains such as medicine, network security and autonomous transportation. However, neural network architectures are becoming increasingly complex and with an incre…
New ADANNs improve PDE approximations.
problem Approximating operators for parametric PDEs.
method Custom ANN architectures and initialization schemes.
result ADANNs significantly outperform existing methods.
A current research trend in neurocomputing involves the design of novel artificial neural networks incorporating the concept of time into their operating model. In this paper, a novel architecture that employs stigmergy is proposed. Computational stigmergy is used to dynamically increase (or decrease) the strength of a…
Musical Instrument Recognition Using Their Distinctive Characteristics in Artificial Neural Networkscs.SD
In this study an Artificial Neural Network was trained to classify musical instruments, using audio samples transformed to the frequency domain. Different features of the sound, in both time and frequency domain, were analyzed and compared in relation to how much information that could be derived from that limited data…
We analyse the effectiveness of modern deep learning techniques in predicting credit ratings over a universe of thousands of global corporate entities obligations when compared to most popular, traditional machine-learning approaches such as linear models and tree-based classifiers. Our results show a adequate accuracy…
Perceptual capabilities of artificial systems have come a long way since the advent of deep learning. These methods have proven to be effective, however they are not as efficient as their biological counterparts. Visual attention is a set of mechanisms that are employed in biological visual systems to ease computationa…
Predictive coding networks use inference learning for efficient AI modeling.
problem Traditional AI methods struggle with complex neural patterns.
method Inference learning for hierarchical Bayesian inference models.
result PCNs outperform traditional BP methods in efficiency and flexibility.
Proposes BGNN for tumor heterogeneity prediction using graph neural networks.
problem Tumor classification limitations and heterogeneity assessment challenges.
method Artificial data generation, tumor heterogeneity estimation, and BGNN model development.
result BGNN achieves accuracy in predicting tumor heterogeneity.
Novel 'strong neuron' improves deep learning efficiency and robustness.
problem Improving deep learning efficiency and robustness against adversarial attacks.
method Introducing a novel 'strong neuron' model and a constructive training algorithm.
result Achieved 10x-100x reduction in operations count and hardware requirements.
In this paper we use deep feedforward artificial neural networks to approximate solutions to partial differential equations in complex geometries. We show how to modify the backpropagation algorithm to compute the partial derivatives of the network output with respect to the space variables which is needed to approxima…
Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of the primary obstacles for their wide acceptance in mission-critical applications s…
Enhances neural network dynamics to boost computational capacity.
problem Improving computational capacity of neural networks.
method Introducing Phase Transition Adaptation to drive system dynamics towards edge of stability.
result Consistently achieves enhancement in computational capacity over multiple datasets.
This study ranks feature-block importance in multiblock neural networks.
problem Understanding feature contributions in multiblock neural networks.
method Three methods: composite, knock-in, and knock-out strategies.
result Each strategy has its merits for specific application scenarios.
Although artificial neural networks have occasionally been used for Quantitative Structure-Activity/Property Relationship (QSAR/QSPR) studies in the past, the literature has of late been dominated by other machine learning techniques such as random forests. However, a variety of new neural net techniques along with suc…
Research examines how strategic latency manipulation impacts Ethereum's network efficiency and decentralization.
problem Impact of artificial latency on Ethereum's network efficiency and decentralization.
method Comprehensive analysis of MEV-Boost auction system and empirical validation with a pilot.
result Increased profitability for node operators and significant systemic challenges like heightened network inefficiencies and centralization risks.
Study compares ANN and GARCH models for volatility prediction across sectors.
problem Comparing ANN and GARCH models for volatility prediction.
method Examined five sectors with low, medium, and high volatility, using three GARCH specifications and three ANN architectures.
result ANN model performs better for low volatility, GARCH for medium and high.
Deep neural networks near edge of chaos show universal scaling laws.
problem Understanding the behavior of deep neural networks near critical points.
method Analogy to absorbing phase transitions in statistical mechanics, deterministic propagation dynamics, mean-field and directed percolation universality classes.
result Deep neural networks exhibit universal scaling laws near the edge of chaos.