It is well-known that tuning a metaheuristic is a critical task because the performance of a metaheuristic and the quality of its solutions depend on its parameter values. However, finding a good parameter setting is a time-consuming task. In this work, we apply the upper confidence bound (UCB) algorithm to automate offline tuning in a (1 + 1)-evolution strategy. Preliminary results show that our proposed approach is a less costly method.
Belarmino Adenso-DíazManuel Laguna, Fine-tuning ofalgorithms using fractional experimental designs and local search, Operations Research54(1) (2006), 99–114.
2.
Peter AuerNicolò Cesa-BianchiPaul Fischer, Finite-timeanalysis of the multiarmed bandit problem, Machine Learning47(2) (2002), 235–256.
3.
Danny DijkzeulNielis BrouwerIris PijningLevi KoppenholDaan van den Berg, Painting with evolutionary algorithms. In Tiago Martins, Nereida Rodryguez-Fernandez and Sergio M. Rebelo, editors, Artificial Intelligence in Music, Sound, Art and Design, pages 52–67, Cham, 2022. Springer International Publishing.
4.
Onas Mockus, et al., Bayesian Heuristic approach to discrete and global optimization: Algorithms, visualization, software, and applications, Springer Science & Business Media, 2013.
Changwu HuangYuanxiang LiXin Yao, A survey of automaticparameter tuning methods for metaheuristics, IEEE Transactionson Evolutionary Computation24(2) (2020), 201–216.
7.
Frank HutterHolger HoosH.Kevin Leyton-BrownSequential model-based optimization for general algorithm configuration. In Carlos A. Coello Coello, editor, Learning and Intelligent Optimization, pages 507–523, Berlin, Heidelberg, 2011. Springer Berlin Heidelberg.
8.
Frank HutterHolger HoosH.Kevin Leyton-BrownThomas Stützle, Paramils: An automatic algorithm configurationframework, J. Artif. Int. Res.36(1) (2009), 267–306.
9.
Maryam Karimi-MamaghanMehrdad MohammadiPatrick MeyerAmirMohammad Karimi-MamaghanEl-Ghazali Talbi, Machine learning atthe service of meta-heuristics for solving combinatorialoptimization problems: A state-of-theart, European Journal ofOperational Research296(2) (2022), 393–422.
10.
Misael Lopez-SanchezCosío-LeónM.A.Anabel Martínez-VargasComparative Analysis of Constraint Handling Techniques Based on Taguchi Design of Experiments, pages 285–315. Springer Singapore, Singapore, 2021.
11.
Anabel Martínez-VargasJesús Gómez-AvilésA.Cosío-LeónM.A.Ángel AndradeG., Explaining the walkingthrough of a team of algorithms, Computer56(2) (2023), 67–81.
12.
MercerR.E.SampsonJ.R., Adaptive search using a reproductivemeta-plan, Kybernetes7(3) (1978), 215–228.
13.
Elizabeth MonteroMaría-Cristina RiffNicolásRojas-Morales, Tuners review: How crucial are set-up values to findeffective parameter values?Engineering Applications ofArtificial Intelligence76 (2018), 108–118.
14.
RavichandiranS.Hands-On Reinforcement Learning with Python: Master Reinforcement and Deep Reinforcement Learning Using OpenAI Gym and TensorFlow. Packt Publishing, 2018.
15.
Andrew BartoG.Richard SuttonS.Reinforcement Learning: An Introduction, Bradford Books, 2018.
16.
Gabriela Rodríguez-CortésL.Anabel Martínez-VargasOscar Montiel-RossH.Cosío-LeónM.A.Daniela MartínezM.Deployment of unmanned aerial vehicles for maximum coverage in emergency scenarios using the (1 + 1) evolution strategy with one-fifth success rule. In 2021 Mexican International Conference on Computer Science (ENC), pages 1–7, 2021.
17.
Bobak ShahriariKevin SwerskyZiyu WangRyan AdamsP.Nandode Freitas, Taking the human out of the loop: A review of bayesianoptimization, Proceedings of the IEEE104(1) (2016), 148–175.
18.
Selmar Kagiso SmitParameter Tuning and Scientific Testing in Evolutionary Algorithms. PhD thesis, Vrije Universiteit Amsterdam, 2012.
19.
Mahnaz SohrabiMostafa ZandiehMohammad Shokouhifar, Sustainable inventory management in blood banks considering healthequity using a combined metaheuristic-based robust fuzzy stochasticprogramming, Socio-Economic Planning Sciences86 (2023), 101462–.
20.
StützleManuel López-Ibáñez, Automated Design of Metaheuristic Algorithms, pages 541–579. Springer International Publishing, Cham, 2019.
21.
El-Ghazali Talbi, Machine learning into metaheuristics: A survey and taxonomy, ACM Comput. Surv.54(6) (2021).
22.
Maritzol TenemazaSergio Luján-MoraAngélica De AntonioJaime Ramírez, Improving itinerary recommendations fortourists through metaheuristic algorithms: An optimization proposal, IEEE Access8 (2020), 79003–79023.
23.
Peter Krause BäckChristophe FoussetteContemporary Evolution Strategies. Springer Berlin, Heidelberg, 2013.
24.
WolpertD.H.MacreadyW.G., No free lunch theorems foroptimization, IEEE Transactions on Evolutionary Computation1(1) (1997), 67–82.
