PBO methods improve RNN performance in learning long-term dependencies.
problem Training RNNs to learn long-term dependencies is challenging.
method Population-based global optimisation (PBO) techniques, including evolution strategies and particle swarm optimisation.
result PBO methods lead to performance improvements in RNNs for volatility forecasting.
The paper learns particle swarming models from data using Gaussian processes.
problem Understanding the link between individual interaction rules and swarming behavior.
method Proposes a learning approach using Gaussian processes to model latent radial interaction functions and scalar parameters in non-collective friction forces.
result Establishes that a coercivity condition is sufficient for recoverability and provides a finite-sample analysis showing optimal convergence rates.
Paper uses averaging from many particle filters to approximate posterior predictive distributions.
problem Approximating posterior predictive distributions efficiently and accurately.
method Particle swarm filter algorithm that averages many particle filter approximations.
result Law of large numbers and central limit theorem support the method's effectiveness.
The paper connects PSO and CBO methods using stochastic modeling and mean-field limits.
problem Global optimization problems with particle swarm optimization and consensus based optimization.
method Stochastic differential equations and mean-field approximation to derive macroscopic hydrodynamic equations.
result Derives mean-field approximation for PSO and links it to CBO methods.
In many contexts the modal properties of a structure change, either due to the impact of a changing environment, fatigue, or due to the presence of structural damage. For example during flight, an aircraft's modal properties are known to change with both altitude and velocity. It is thus important to quantify these cha…
New algorithm uses PSO to optimize DNN training parameters in distributed systems.
problem Reducing synchronization frequency in DNN training leads to poor convergence.
method Integrates PSO into distributed training to automatically compute new parameters.
result Proposed algorithm outperforms synchronous methods in distributed DNN training.
As one of Bayesian analysis tools, Hidden Markov Model (HMM) has been used to in extensive applications. Most HMMs are solved by Baum-Welch algorithm (BWHMM) to predict the model parameters, which is difficult to find global optimal solutions. This paper proposes an optimized Hidden Markov Model with Particle Swarm Opt…
Swarm intelligence is the collective behavior emerging in systems with locally interacting components. Because of their self-organization capabilities, swarm-based systems show essential properties for handling real-world problems such as robustness, scalability, and flexibility. Yet, we do not know why swarm-based alg…
A new optimizer, MVO, improves nonlinear regression performance.
problem Finding optimal coefficients in nonlinear regression models.
method Multi-Verse Optimizer (MVO) compared to Particle Swarm Optimizer (PSO).
result MVO statistically outperforms PSO in 10 nonlinear regression problems.
AdaSwarm optimizes deep learning models with swarm intelligence, outperforming Adam.
problem Optimization challenges in deep learning models.
method AdaSwarm uses EMPSO to approximate gradients for optimization.
result AdaSwarm outperforms Adam and handles various loss functions.
PSO optimizes model parameters in nonstandard distributions.
problem Estimating model parameters in nonstandard distributions using existing algorithms.
method Particle Swarm Optimization (PSO) as an alternative optimization routine.
result PSO produces more optimal or convergent results than existing algorithms.
Empirical comparison of 18 hyperparameter tuning algorithms for SVM.
problem Tuning hyperparameters C and γ for SVM with RBF kernel. method Compared 18 search algorithms on 115 real-life data sets.
result Trees of Parzen estimators and particle swarm optimization perform similarly to grid search.
A new time-series clustering method using slope-based similarity and PSO.
problem Clustering time-series data efficiently and accurately.
method Developed a novel slope-based similarity measure combined with Particle Swarm Optimization (PSO) for clustering.
result The proposed similarity measure outperforms existing measures in clustering time-series data.
Modified swarm optimizers improve GD initialization for EEG spatial filtering.
problem Gradient Descent fails in complex, multi-scale convexity scenarios.
method Modified Swarm-based Optimizers (ICA and PSO) applied to GD initialization.
result The modified optimizers outperform baseline optimizers in EEG classification and loss function fitness.
mFI-PSO generates effective adversarial images for DNNs.
problem Vulnerability of DNNs to small perturbations in images.
method Uses mFI for pixel selection and PSO for objective functions.
result mFI-PSO effectively designs flexible adversarial images.
AdversarialPSO uses fewer queries to create high-success-rate adversarial examples.
problem Creating imperceptible adversarial examples with high success rates in black-box settings.
method AdversarialPSO, a black-box attack using Particle Swarm Optimization.
result Achieved high success rates (99.6% on CIFAR-10, 96.3% on MNIST, 82.0% on Imagenet) with fewer queries.
TomOpt optimizes muon detector designs using differentiable programming.
problem Designing efficient particle detectors for muon tomography.
method Differentiable programming for muon interaction modeling, inference, and optimisation.
result Demonstrated end-to-end differentiable and inference-aware optimisation of particle physics instruments.
DeepSwarm uses swarm intelligence to optimize CNN architectures.
problem Optimizing Convolutional Neural Networks (CNNs).
method Ant Colony Optimization (ACO) for neural architecture search.
result DeepSwarm outperforms existing methods on MNIST, Fashion-MNIST, and CIFAR-10 datasets.
Hybrid ANN model predicts firm bankruptcy with improved PSO and SA.
problem Predicting firm failure for investors and decision makers.
method Hybrid ANN model using improved PSO and SA for variable selection and optimization.
result The hybrid model outperforms in convergence and accuracy compared to traditional methods.
Supervised classification is the most active and emerging research trends in today's scenario. In this view, Artificial Neural Network (ANN) techniques have been widely employed and growing interest to the researchers day by day. ANN training aims to find the proper setting of parameters such as weights (W) …
Optimal income crossover found using particle swarm optimization.
problem Determining the crossover point between two income distributions.
method Particle swarm optimization for finding crossover income, temperature, and Pareto index.
result Optimization method finds boundaries of two income distributions.
Metaheuristics optimize portfolios with pre-assignment and margin trading for better risk-adjusted returns.
problem Maximizing returns while minimizing risk in portfolio optimization.
method Incorporates pre-assignment constraints and margin trading strategies using Genetic Algorithms and Particle Swarm Optimization.
result Metaheuristic-based portfolio optimization yields superior risk-adjusted returns compared to traditional methods.
Metaheuristics improve yield curve estimation for Costa Rica.
problem Estimating the yield curve for Costa Rica using historical data.
method Used Nelson-Siegel and Svensson models with four metaheuristics (Ant colony, Genetic, Particle Swarm, Simulated Annealing) for optimization.
result Metaheuristics achieved better results than classical methods, especially Particle Swarm and Simulated Annealing.
Derives a fluid model for fish swarming in arbitrary dimensions.
problem Modeling fish swarming behavior in various dimensions.
method Develops a novel n-dimensional model using bundle geometry and variational formulation. result Derives the self-organized hydrodynamic model from the interacting particle system.
Method for explaining machine learning survival models using counterfactuals.
problem Tackles the challenge of explaining survival models in machine learning.
method Introduces a condition based on the difference of mean times to event for counterfactual explanation. Reduces the problem to a convex optimization problem for Cox models and applies Particle Swarm Optimization for other models.
result Demonstrates the effectiveness of the proposed method through numerical experiments.
Study defines and optimizes bank reliability using LR and PSO.
problem Lack of reliability concept in financial services.
method Logistic Regression (LR) for initial estimation, Particle Swarm Optimization (PSO) for optimization.
result Optimal financial ratios maximize bank reliability.
Optimizes trading portfolios considering risk and profit.
problem Balancing risk and profit in trading portfolios.
method Risk-Aware Trading Swarm (RATS) algorithm.
result RATS improves portfolio performance and risk management.
Develops a new algorithm for estimating model parameters using interacting particle systems.
problem Estimating parameters of latent variable models.
method Interacting Particle Langevin Algorithm (IPLA) based on Langevin diffusion.
result Nonasymptotic optimisation error bounds for the estimator.
ARS visualization improves t-SNE dynamics with tunable attraction and repulsion.
problem Improve data visualization techniques for complex data sets.
method ARS framework based on t-SNE dynamics with normalized interactions and tunable kernels.
result ARS visualization provides better control over cluster tightness and spacing.
PSO improves G-optimal designs for up to 5 factors, reducing computation time.
problem Computing highly G-optimal designs for response surface models is computationally expensive. method Extended Particle Swarm Optimization (PSO) for optimal design problems.
result PSO generates improved G-optimal designs for up to 5 factors with comparable computational cost. This paper improves combine harvester performance using ANN-PSO hybrid model.
problem Improving performance of combine harvesters to minimize waste and reduce maintenance.
method Proposes a hybrid machine learning model combining artificial neural networks and particle swarm optimization.
result Demonstrates higher accuracy and stability in predicting optimal performance of combine harvesters.
This paper proposes the use of an optimization algorithm, namely PSO to decide the initial centroids in K-means, to eventually get better accuracy. The vectorized notation of the optimal centroids can be thought of as entities in an optimization space, where the accuracy of K-means over a random subset of the data coul…
Numerical optimization is an important tool in the field of computational physics in general and in nano-optics in specific. It has attracted attention with the increase in complexity of structures that can be realized with nowadays nano-fabrication technologies for which a rational design is no longer feasible. Also, …
Transformers approximate mean-field dynamics of indistinguishable particles.
problem Approximating the dynamics of indistinguishable particles in complex systems.
method Using transformers to model the mean-field dynamics of interacting particle systems.
result Theoretical bounds on the distance between true and transformer-obtained mean-field dynamics.
A new method uses PSO to optimize sentence weights for user-oriented document summaries.
problem Handling information overload in documents through efficient summarization.
method Particle Swarm Optimization (PSO) to identify and weight sentence features.
result Improved accuracy in summarization compared to previous methods.
Novel LSTM network predicts pulsar timing residuals with few-shot data.
problem Predicting pulsar timing residuals with limited data.
method Long Short-Term Memory (LSTM) network optimized with model-agnostic meta-learning and particle swarm optimization.
result Robust generalization and accurate predictions across high-frequency test domains with minimal data.
Inferring the laws of interaction between particles and agents in complex dynamical systems from observational data is a fundamental challenge in a wide variety of disciplines. We propose a non-parametric statistical learning approach to estimate the governing laws of distance-based interactions, with no reference or a…
Method identifies IPS governing equations from particle data efficiently.
problem Identify governing equations of interacting particle systems efficiently.
method Combines mean-field theory and WSINDy for large N and M. result Converges with rate O(N−1/2) for N≥100. Purpose: Malicious web domain identification is of significant importance to the security protection of Internet users. With online credibility and performance data, this paper aims to investigate the use of machine learning tech-niques for malicious web domain identification by considering the class imbalance issue (i…
Optimizes bus schedules to improve on-time performance.
problem Improving on-time performance of public transit systems.
method Formulated as a single-objective optimization task, solved using greedy algorithm, GA, and PSO.
result Enhanced bus timetables leading to better on-time performance.
PSO optimizes hyperparameters for edge ML models in FL.
problem Efficient local training and inference at edge devices.
method Particle Swarm Optimization (PSO) for hyperparameter tuning.
result PSO reduces the number of communication rounds by 2 orders of magnitude.
Estimates log-likelihood of interacting particle systems using virtual particles.
problem Inconsistent estimation of finite-particle log-likelihood in large particle systems.
method Stochastic gradient estimate using continuous trajectory and virtual particle systems.
result Convergence to stationary points of limiting mean-field system's log-likelihood.
Paper proposes an end-to-end learning method for state estimation in robotics.
problem Lack of annotated data for optimising dynamic and measurement models in particle filters.
method End-to-end learning objective based on maximising a pseudo-likelihood function.
result Improves state estimation when large portions of true states are unknown.
DBS uses swarm intelligence to cluster data without needing a global objective function.
problem Clustering high-dimensional data with unknown natural clusters.
method Databionic swarm (DBS) system that self-organizes and adapts to data structures.
result DBS outperforms traditional clustering methods in scenarios with no prior knowledge.
This paper tackles batch Bayesian optimal experimental design by using Wasserstein gradient flows.
problem The challenge of optimising high-dimensional, strongly non-convex expected information gain in batch settings.
method Probabilistic lifting to the space of probability measures, entropic regularisation, Wasserstein gradient flow, and particle-based algorithms.
result The proposed approach can be used directly as a randomised batch-design policy or as a computational relaxation.
A combination of a priority queueing model and mean field theory shows the emergence of traders' swarm behavior, even when each has a subjective prediction of the market driven by a limit order book. Using a nonlinear Markov model, we analyze the dynamics of traders who select a favorable order price taking into accoun…
Paper proposes a federated learning framework for UAV swarms, optimizing convergence rate and energy consumption.
problem Challenges of centralized ML in UAV swarms due to limited connections and large data volumes.
method Distributed federated learning within UAV swarm, joint power allocation and scheduling design.
result Joint design strategy reduces communication rounds by up to 35%.
We apply numerical methods in combination with finite-difference-time-domain (FDTD) simulations to optimize transmission properties of plasmonic mirror color filters using a multi-objective figure of merit over a five-dimensional parameter space by utilizing novel multi-fidelity Gaussian processes approach. We compare …