New approach generates black-box attacks on neural networks using swarm evolutionary algorithm.
problem Adversarial samples attack neural networks.
method Swarm evolutionary algorithm for black-box attacks.
result 100% success rate on MNIST and CIFAR-10 images.
AdversarialPSO uses fewer queries to create high-success-rate adversarial examples.
problem Creating imperceptible adversarial examples with high success rates in black-box settings.
method AdversarialPSO, a black-box attack using Particle Swarm Optimization.
result Achieved high success rates (99.6% on CIFAR-10, 96.3% on MNIST, 82.0% on Imagenet) with fewer queries.
Swarm intelligence is the collective behavior emerging in systems with locally interacting components. Because of their self-organization capabilities, swarm-based systems show essential properties for handling real-world problems such as robustness, scalability, and flexibility. Yet, we do not know why swarm-based alg…
This paper studies adversarial examples in NIDS, revealing their vulnerability.
problem Vulnerability of machine learning-based NIDS to adversarial examples.
method Used evolutionary computation and deep learning to generate adversarial examples.
result Adversarial examples cause high misclassification rates in various machine learning models.
DBS uses swarm intelligence to cluster data without needing a global objective function.
problem Clustering high-dimensional data with unknown natural clusters.
method Databionic swarm (DBS) system that self-organizes and adapts to data structures.
result DBS outperforms traditional clustering methods in scenarios with no prior knowledge.
We study a distributed framework for stochastic optimization which is inspired by models of collective motion found in nature (e.g., swarming) with mild communication requirements. Specifically, we analyze a scheme in which each one of N>1 independent threads, implements in a distributed and unsynchronized fashion,…
Modified swarm optimizers improve GD initialization for EEG spatial filtering.
problem Gradient Descent fails in complex, multi-scale convexity scenarios.
method Modified Swarm-based Optimizers (ICA and PSO) applied to GD initialization.
result The modified optimizers outperform baseline optimizers in EEG classification and loss function fitness.
Paper proposes a federated learning framework for UAV swarms, optimizing convergence rate and energy consumption.
problem Challenges of centralized ML in UAV swarms due to limited connections and large data volumes.
method Distributed federated learning within UAV swarm, joint power allocation and scheduling design.
result Joint design strategy reduces communication rounds by up to 35%.
Hybrid models improve groundwater level prediction and uncertainty analysis.
problem Predicting and analyzing uncertainty of monthly groundwater levels.
method Six evolutionary optimization algorithms (GOA, CSO, WA, GA, KA, PSO) hybridized with ANFIS, ANN, and SVM.
result ANFIS-GOA outperformed other models in predicting groundwater levels.
Study examines CSO algorithm for 3D swarming and tracking multiple targets.
problem Simulating and tracking multiple targets in 3D space.
method Cyclic Stochastic Optimization (CSO) algorithm implemented by mobile sensing agents.
result CSO algorithm converges in 3D space, minimizing uncertainty in targets' state estimates.
The ABC algorithm's social interactions are characterized through a novel interaction network.
problem Understanding complex behavior in swarm intelligence systems.
method Definition and analysis of the interaction network for the ABC algorithm.
result ABC exhibits dynamic information flow but lacks continuous coordination.
This paper reviews feature selection methods using swarm intelligence.
problem Reducing dimensionality in high-dimensional datasets.
method Comparative analysis of swarm intelligence-based feature selection methods.
result Evaluation of strengths and weaknesses of swarm intelligence-based methods.
Deep learning autoencoder detects bee colony anomalies.
problem Early detection of bee swarms and other unusual behaviors.
method Deep Recurrent Autoencoder model trained on sensor data.
result Autoencoder detects anomalies independent of their origin.
Paper uses averaging from many particle filters to approximate posterior predictive distributions.
problem Approximating posterior predictive distributions efficiently and accurately.
method Particle swarm filter algorithm that averages many particle filter approximations.
result Law of large numbers and central limit theorem support the method's effectiveness.
As one of Bayesian analysis tools, Hidden Markov Model (HMM) has been used to in extensive applications. Most HMMs are solved by Baum-Welch algorithm (BWHMM) to predict the model parameters, which is difficult to find global optimal solutions. This paper proposes an optimized Hidden Markov Model with Particle Swarm Opt…
A combination of a priority queueing model and mean field theory shows the emergence of traders' swarm behavior, even when each has a subjective prediction of the market driven by a limit order book. Using a nonlinear Markov model, we analyze the dynamics of traders who select a favorable order price taking into accoun…
evo-RL combines evolutionary computation with reinforcement learning for better adaptability.
problem Improving reinforcement learning algorithms' adaptability and performance in environments with rewardless states.
method Embedding reinforcement learning in an evolutionary cycle, distinguishing instinctive from learnable behavior.
result evo-RL leads to state-of-the-art performance on OpenAI Gym control problems with rewardless states.
In this study, we present a simple stochastic order-book model for investors' swarm behaviors seen in the continuous double auction mechanism, which is employed by major global exchanges. Our study shows a characteristic called "fat tail" is seen in the data obtained from our model that incorporates the investors' swar…
Proposes new genetic algorithm rule for market competition.
problem Market competition genetic algorithm rules.
method Econophysics kinetic market model as an evolutionary algorithm.
result New replacement rule for genetic algorithms.
New algorithm uses PSO to optimize DNN training parameters in distributed systems.
problem Reducing synchronization frequency in DNN training leads to poor convergence.
method Integrates PSO into distributed training to automatically compute new parameters.
result Proposed algorithm outperforms synchronous methods in distributed DNN training.
In many practical applications of clustering, the objects to be clustered evolve over time, and a clustering result is desired at each time step. In such applications, evolutionary clustering typically outperforms traditional static clustering by producing clustering results that reflect long-term trends while being ro…
Deep learning improves evolutionary algorithms' adaptability.
problem Improving evolutionary algorithms' adaptability to various circumstances.
method Using deep reinforcement learning to dynamically adjust evolutionary algorithms' strategies.
result Deep learning enhances evolutionary algorithms' fitness increase and attainable fitness.
A new optimizer, MVO, improves nonlinear regression performance.
problem Finding optimal coefficients in nonlinear regression models.
method Multi-Verse Optimizer (MVO) compared to Particle Swarm Optimizer (PSO).
result MVO statistically outperforms PSO in 10 nonlinear regression problems.
Optimizes K-means clustering with PSO for better accuracy.
problem Improving the accuracy of K-means clustering.
method Uses Particle Swarm Optimization (PSO) to find optimal initial centroids for K-means.
result Optimal centroids found using PSO lead to better clustering accuracy.
The paper learns particle swarming models from data using Gaussian processes.
problem Understanding the link between individual interaction rules and swarming behavior.
method Proposes a learning approach using Gaussian processes to model latent radial interaction functions and scalar parameters in non-collective friction forces.
result Establishes that a coercivity condition is sufficient for recoverability and provides a finite-sample analysis showing optimal convergence rates.
Empirical comparison of 18 hyperparameter tuning algorithms for SVM.
problem Tuning hyperparameters C and γ for SVM with RBF kernel. method Compared 18 search algorithms on 115 real-life data sets.
result Trees of Parzen estimators and particle swarm optimization perform similarly to grid search.
AdaSwarm optimizes deep learning models with swarm intelligence, outperforming Adam.
problem Optimization challenges in deep learning models.
method AdaSwarm uses EMPSO to approximate gradients for optimization.
result AdaSwarm outperforms Adam and handles various loss functions.
In this paper, we examine the problem of missing data in high-dimensional datasets by taking into consideration the Missing Completely at Random and Missing at Random mechanisms, as well as theArbitrary missing pattern. Additionally, this paper employs a methodology based on Deep Learning and Swarm Intelligence algorit…
Swarm systems constitute a challenging problem for reinforcement learning (RL) as the algorithm needs to learn decentralized control policies that can cope with limited local sensing and communication abilities of the agents. While it is often difficult to directly define the behavior of the agents, simple communicatio…
Evolutionary algorithms improve decision tree ensembles.
problem Improving predictive performance of decision trees.
method Real-valued vector representation of decision trees, evolutionary algorithms (Differential evolution, Evolution strategies).
result Proposed methods outperform classical decision tree induction algorithms.
Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized decision making. However, concatenation scales poorly to swarm systems with a large…
New algorithm improves game learning with randomised optimism.
problem Learning in matrix games with unknown payoffs and bandit feedback.
method Integrates evolutionary algorithms into bandit framework for randomised optimism.
result Achieves sublinear regret, outperforming classical methods.
In this paper, we investigate how to learn to control a group of cooperative agents with limited sensing capabilities such as robot swarms. The agents have only very basic sensor capabilities, yet in a group they can accomplish sophisticated tasks, such as distributed assembly or search and rescue tasks. Learning a pol…
EAP clusters evolving data, promoting temporal smoothness and automatic cluster tracking.
problem Clustering time-evolving data with temporal smoothness and automatic cluster identification.
method Evolutionary Affinity Propagation (EAP) on a factor graph exchanging messages between adjacent data snapshots.
result EAP clusters data with temporal smoothness and automatically tracks clusters, outperforming existing methods.
A new time-series clustering method using slope-based similarity and PSO.
problem Clustering time-series data efficiently and accurately.
method Developed a novel slope-based similarity measure combined with Particle Swarm Optimization (PSO) for clustering.
result The proposed similarity measure outperforms existing measures in clustering time-series data.
A method to control results of gradient descent unsupervised learning in a deep neural network by using evolutionary algorithm is proposed. To process crossover of unsupervisedly trained models, the algorithm evaluates pointwise fitness of individual nodes in neural network. Labeled training data is randomly sampled an…
Combines variational and evolutionary optimization for generative models.
problem Optimizing generative models with discrete latent variables.
method Truncated posteriors as variational distributions, evolutionary algorithms applied to variational parameters.
result Evolutionary algorithms effectively optimize variational bounds for generative models.
Metaheuristics optimize portfolios with pre-assignment and margin trading for better risk-adjusted returns.
problem Maximizing returns while minimizing risk in portfolio optimization.
method Incorporates pre-assignment constraints and margin trading strategies using Genetic Algorithms and Particle Swarm Optimization.
result Metaheuristic-based portfolio optimization yields superior risk-adjusted returns compared to traditional methods.
Inverse reinforcement learning (IRL) has become a useful tool for learning behavioral models from demonstration data. However, IRL remains mostly unexplored for multi-agent systems. In this paper, we show how the principle of IRL can be extended to homogeneous large-scale problems, inspired by the collective swarming b…
Computational Intelligence (CI) is a sub-branch of Artificial Intelligence paradigm focusing on the study of adaptive mechanisms to enable or facilitate intelligent behavior in complex and changing environments. There are several paradigms of CI [like artificial neural networks, evolutionary computations, swarm intelli…
Enhanced Particle Swarm Optimization improves ANN classification accuracy and stability.
problem Improving classification accuracy of ANN models.
method Proposes an enhanced Particle Swarm Optimization for ANN training.
result Significant improvement in classification accuracy through stability analysis.
Enhanced evolutionary algorithms solve NP-hard portfolio optimization with cardinality constraints.
problem Portfolio optimization under cardinality constraints with real-world conditions.
method Strengthened multi-objective evolutionary algorithms with new representations, operators, and repair mechanisms.
result The proposed algorithms converge faster and provide better approximations with no performance loss.
New neural network learns set-equivariant functions efficiently.
problem Efficiently implementing and learning set-equivariant functions.
method Gated recurrent network applied iteratively to all entities and syncs with population progression.
result SWARM mappings achieve state-of-the-art performance in various applications.
Proposes Genetic Thompson Sampling for multi-armed bandits, improving performance in nonstationary settings.
problem Improving sequential decision making tasks of online learning agents using multi-armed bandits.
method Integrates genetic principles into Thompson Sampling for multi-armed bandits.
result Significantly outperforms baselines in nonstationary settings.
MERL uses evolutionary and gradient-based methods to optimize sparse team-based and dense agent-specific rewards in multiagent coordination.
problem Training multiagent reinforcement learning policies on sparse team-based rewards is difficult and relying solely on agent-specific rewards is sub-optimal.
method MERL employs a split-level training platform with an evolutionary algorithm and a gradient-based optimizer, transferring skills between the two processes.
result MERL significantly outperforms state-of-the-art methods on coordination benchmarks.
Evolutionary algorithm improves DNN watermarking with fewer false positives.
problem Protecting deep learning models from piracy and proving ownership.
method Evolutionary algorithm for generating and optimizing trigger patterns.
result Reduces false positive rates in DNN watermarking.
Evolutionary algorithms improve neural network performance by discovering better activation functions.
problem The choice of activation function affects neural network performance, but ReLU remains dominant.
method Defined a tree-based search space of candidate activation functions and used evolutionary algorithms (mutation, crossover, exhaustive search) to explore and discover better functions.
result Replacing ReLU with evolved activation functions statistically significantly increases network accuracy.
DeepSwarm uses swarm intelligence to optimize CNN architectures.
problem Optimizing Convolutional Neural Networks (CNNs).
method Ant Colony Optimization (ACO) for neural architecture search.
result DeepSwarm outperforms existing methods on MNIST, Fashion-MNIST, and CIFAR-10 datasets.