There has been significant recent interest towards achieving highly efficient deep neural network architectures. A promising paradigm for achieving this is the concept of evolutionary deep intelligence, which attempts to mimic biological evolution processes to synthesize highly-efficient deep neural networks over succe…
This paper proposes AI-based solutions for optimizing semiconductor manufacturing processes.
problem Optimizing semiconductor manufacturing processes with advanced analytics.
method Evolutionary Computing and Deep Learning algorithms for feature selection and neural networks.
result Advanced algorithm for intelligent feature selection in semiconductor manufacturing.
Synaptic cluster-driven evolution improves deep neural networks by reducing synapses and clusters.
problem Efficiently synthesizing deep neural networks with fewer synapses and clusters.
method Synaptic cluster-driven genetic encoding scheme.
result Significantly smaller number of synapses and clusters in offspring networks.
A hybrid method improves Convolutional Neural Networks training.
problem Training Convolutional Neural Networks efficiently and avoiding local minima.
method Combines backpropagation with evolutionary strategies.
result Improves accuracy by 0.61% on CIFAR-10 image classification.
This study compares transfer learning and multi-agent learning for AI-driven traffic agents.
problem Improving traffic flow in mixed-intelligence highway scenarios.
method Online MIT DeepTraffic simulation, deep reinforcement learning, elitist evolutionary algorithm, hyperparameter search, transfer learning, multi-agent learning.
result Transfer learning and multi-agent learning yield different average speeds for AI-driven traffic agents.
Deep learning improves evolutionary algorithms' adaptability.
problem Improving evolutionary algorithms' adaptability to various circumstances.
method Using deep reinforcement learning to dynamically adjust evolutionary algorithms' strategies.
result Deep learning enhances evolutionary algorithms' fitness increase and attainable fitness.
A method uses evolutionary algorithm to supervise unsupervised learning in deep neural networks.
problem Controlling unsupervised learning in deep neural networks.
method Evolutionary algorithm applied to deep neural networks for supervised unsupervised learning.
result Better accuracy in document classification compared to traditional methods.
Robotic grasping improved using evolutionary computing and deep reinforcement learning.
problem Developing a robot capable of grasping objects as skillfully as humans.
method Position estimation using Genetic Algorithm and regression, orientation learning using deep reinforcement learning.
result Deep reinforcement learning model outperforms traditional methods for orientation learning.
ESGD optimizes deep neural networks using evolutionary and stochastic gradient descent methods.
problem Optimizing deep neural networks efficiently and effectively.
method Combines SGD and evolutionary algorithms, alternating between steps to improve population fitness.
result Guarantees that the best fitness in the population never degrades and optimizes across various deep architectures.
Improves sample efficiency in evolutionary policy search methods.
problem Worse sample efficiency in evolutionary policy search methods.
method Importance mixing to reuse more samples.
result Improves sample efficiency but still less than deep reinforcement learning.
Paper withdrawn; AI game behavior needs diversity.
problem Creating varied human-like playing styles in games.
method Evolutionary multi-objective deep reinforcement learning.
result Generated diverse AI behaviors for games.
New algorithm improves game learning with randomised optimism.
problem Learning in matrix games with unknown payoffs and bandit feedback.
method Integrates evolutionary algorithms into bandit framework for randomised optimism.
result Achieves sublinear regret, outperforming classical methods.
Evo-NAS combines neural and evolutionary methods for efficient neural architecture search.
problem Efficiently searching for optimal neural architectures in deep learning.
method Evolutionary-Neural hybrid agents that combine the strengths of neural and evolutionary algorithms.
result Evo-NAS outperforms both neural and evolutionary agents in architecture search for various classification tasks.
Evolutionary algorithm improves DNN watermarking with fewer false positives.
problem Protecting deep learning models from piracy and proving ownership.
method Evolutionary algorithm for generating and optimizing trigger patterns.
result Reduces false positive rates in DNN watermarking.
Deep learning quantifies butterfly phenotypes, validating evolutionary theory.
problem Capturing comprehensive phenotypic information of butterflies.
method Deep convolutional triplet network for phenotypic distance calculation.
result Euclidean phenotypic distances support classical mimicry theory.
Study uses evolutionary deep learning to identify galaxies obscured by star densities.
problem Identifying galaxies in the Zone of Avoidance due to high star densities and extinction.
method Evolutionary algorithm to optimize CNN architecture for near-infrared images.
result Best evolved CNN outperforms other variants in identifying galaxies in the Zone of Avoidance.
Selection mechanisms impact market volatility in evolving markets.
problem Determining how selection mechanisms affect market volatility in evolving markets.
method Used a population of evolving zero-intelligence agents and a frequent batch auction price-discovery mechanism to analyze the role of selection mechanisms.
result Local fitness-proportionate selection mechanisms correlate with high correlation between risk-aversion and volatility, while quantile-based selection mechanisms show less correlation.
New approach generates black-box attacks on neural networks using swarm evolutionary algorithm.
problem Adversarial samples attack neural networks.
method Swarm evolutionary algorithm for black-box attacks.
result 100% success rate on MNIST and CIFAR-10 images.
This paper reviews the history and development of deep learning models.
problem Understanding the evolution and development of deep learning models.
method Review of historical models and their evolutionary paths.
result Summarizes the development and evolution of deep learning models.
PARSEC compresses text for sentiment analysis with minimal loss in accuracy.
problem Compressing text data for sentiment analysis without losing accuracy.
method Uses Parts-of-Speech tags to compress text intelligently.
result Accurate compression is possible with minimal loss in sentiment classification accuracy.
Develops efficient algorithms for data science, tackling the curse of dimensionality.
problem Tackles the curse of dimensionality in large datasets.
method Focuses on feature extraction techniques and meta-heuristic algorithms, including evolutionary algorithms.
result Evolutionary algorithms are effective in solving optimization problems with a curse of dimensionality.
Evolutionary algorithms improve neural network performance by discovering better activation functions.
problem The choice of activation function affects neural network performance, but ReLU remains dominant.
method Defined a tree-based search space of candidate activation functions and used evolutionary algorithms (mutation, crossover, exhaustive search) to explore and discover better functions.
result Replacing ReLU with evolved activation functions statistically significantly increases network accuracy.
LR-EDNN reduces PDE solver complexity by limiting network weights to low-rank subspace.
problem Efficiently solving time-dependent PDEs with deep neural networks.
method Low-rank constraint on network weights using SVD for efficient parameter updates.
result LR-EDNN achieves comparable accuracy to full EDNN with fewer parameters and lower cost.
DO uses DNNs to solve combinatorial optimisation problems.
problem Solving complex combinatorial optimisation problems.
method Combines evolutionary search with DNNs to learn and exploit problem structure.
result DO can solve problems like HTOP and MCparity that other algorithms cannot.
EDEN evolves efficient neural networks for machine learning.
problem Increasing complexity of deep neural networks requires better guidance for architecture and hyperparameter selection.
method EDEN uses neuro-evolution to evolve simple yet successful architectures from basic layers and hyperparameters.
result EDEN reliably finds good networks, achieving state-of-the-art results on multiple datasets in a short time.
A new neural model evolves to learn at the synaptic level.
problem Lack of biologically realistic neural models in deep learning.
method Evolve individual neuron and synaptic models using ENUs.
result Evolved neural network learns complex tasks like a T-maze.
Combines evolutionary and RL methods for better policy search.
problem Low sample efficiency in evolutionary methods and high sensitivity in RL methods.
method Combines CEM and td3 algorithms for policy search.
result cem-rl offers a better trade-off between performance and sample efficiency.
Intelligence emerges from stabilizing invariant cycles in memory.
problem Understanding the nature of intelligence and its emergence.
method Structural-dynamical account rooted in a topological closure law: \(\partial^2=0\).
result Memory-amortized inference (MAI) mechanism that implements SbS \(
ightarrow\) CCUP.
API identifies regression or classification problems with high accuracy.
problem Automatically identifying regression or classification problems.
method Evolutionary Deep Learning (EDL) algorithm using TensorFlow.
result API achieves 96.3% accuracy in identifying problem types.
Computational Intelligence (CI) is a sub-branch of Artificial Intelligence paradigm focusing on the study of adaptive mechanisms to enable or facilitate intelligent behavior in complex and changing environments. There are several paradigms of CI [like artificial neural networks, evolutionary computations, swarm intelli…
Parameter noise enhances RL exploration efficiency.
problem Enhancing RL exploration efficiency through parameter noise.
method Combining parameter noise with traditional RL methods.
result RL with parameter noise learns more efficiently than traditional RL methods.
A real-time federated neural architecture search approach reduces costs and improves performance.
problem High communication and computational demands in federated learning for large models.
method Evolutionary approach with double-sampling technique to optimize model performance and reduce costs.
result Effective real-time federated neural architecture search for deep models on edge devices.
NHC learns scalable algorithmic solutions from diverse tasks.
problem Neural networks struggle to learn algorithmic strategies.
method Memory-augmented network with abstraction mechanism and evolutionary training.
result Reliable learning of robust and scalable algorithmic solutions.
Optimizes master faces for 2D and 3D face verification using evolutionary algorithms and neural networks.
problem Impersonation attacks using master faces for face-based identity authentication.
method Evolutionary algorithm in latent space of StyleGAN, neural network to direct search, 2D and 3D face reconstruction.
result Obtains high impersonation rates with fewer master faces for 2D and 3D face verification.
Trading strategies evolve in a simulated market to outperform real data.
problem Creating profitable trading strategies in diverse market conditions.
method Agent-based model of heterogeneous agents evolving deep neural networks.
result Elite trading algorithms outperform in real high-frequency foreign exchange data.
High-frequency trading models fail due to overfitting and survivor bias.
problem Failure of hybrid DRL-EC trading systems in high-frequency environments.
method Deployed a population of 500 agents in a high-frequency cryptocurrency environment, analyzing failure modes through multi-disciplinary lens.
result Increasing model complexity without information asymmetry exacerbates systemic fragility.
EA-LSTM improves LSTM for time series prediction by evolving attention.
problem LSTMs struggle with assigning varying attention to sub-windows in time series data.
method Evolutionary attention-based LSTM with competitive random search.
result EA-LSTM achieves competitive performance in multivariate time series prediction.
New method shows cultural transmission improves language compositionality.
problem How cultural transmission affects language emergence and compositionality.
method Introduced cultural evolutionary dynamics into language emergence by periodically replacing agents in a population.
result Languages emerge with better compositional generalization due to implicit cultural transmission.
New back-propagation rules discovered through evolutionary methods.
problem Improving the back-propagation algorithm for faster training.
method Evolutionary approach to discover new update equations.
result Several new update equations that train faster and perform similarly at convergence.
PDERL improves evolutionary reinforcement learning by using learning-based variation operators.
problem Scalability issue in Genetic Algorithms when combined with Deep Neural Networks.
method Integrates evolutionary and reinforcement learning through a hierarchical approach with learning-based variation operators.
result PDERL outperforms traditional evolutionary and reinforcement learning methods in robot locomotion tasks.
OpEvo automates tensor operator optimization for better efficiency.
problem Manual optimization of tensor operators is inefficient and limited.
method OpEvo uses evolutionary computation with topology-aware mutation.
result OpEvo finds optimal configurations with less effort and variance.
Survey on deep neural networks for vision and speech.
problem Improving intelligent vision and speech systems.
method Review of deep learning models and challenges.
result Emerging technologies show promise for future systems.
This paper reviews deep learning's latest progress and applications.
problem Challenges in deep learning models and applications.
method Analysis of existing models and new emerging models.
result Summarizes deep learning's applications in various AI fields.
GADAM uses genetic algorithm to improve Adam's performance in deep learning.
problem Deep learning optimization stuck in local optima.
method GADAM combines Adam and genetic algorithm to evolve unit models.
result GADAM effectively avoids local optima and achieves faster convergence.
Evolutionary method constructs CNNs for data compression and classification.
problem Creating efficient CNNs for data compression and classification.
method Two-step approach using evolutionary algorithms: 1) Convolutional autoencoder, 2) Convolutional neural network. Compression trade-off considered.
result Framework achieves comparable accuracy to hand-crafted networks, demonstrating effectiveness.
GEN Model uses genetic-evolutionary strategy for deep learning.
problem Deep learning models are complex and hard to interpret.
method GEN Model builds a group of unit models through genetic-evolutionary learning.
result GEN Model outperforms state-of-the-art methods in effectiveness and efficiency.
This paper tackles URLLC in 6G networks with deep learning.
problem Stringent requirements on end-to-end delay and reliability for mission-critical applications.
method Develops a multi-level architecture combining theoretical models and real-world data, using deep transfer learning and federated learning.
result Demonstrates improved performance in URLLC for mission-critical applications.
Explains AI basics and its neural origins.
problem Understanding AI and neural origins.
method Overview of AI and its biological roots.
result Highlights the evolution of AI models.