Papers
Topics
Authors
Recent
Search
2000 character limit reached

On the Robustness of Lexicase Selection to Contradictory Objectives

Published 11 Mar 2024 in cs.NE | (2403.06805v1)

Abstract: Lexicase and epsilon-lexicase selection are state of the art parent selection techniques for problems featuring multiple selection criteria. Originally, lexicase selection was developed for cases where these selection criteria are unlikely to be in conflict with each other, but preliminary work suggests it is also a highly effective many-objective optimization algorithm. However, to predict whether these results generalize, we must understand lexicase selection's performance on contradictory objectives. Prior work has shown mixed results on this question. Here, we develop theory identifying circumstances under which lexicase selection will succeed or fail to find a Pareto-optimal solution. To make this analysis tractable, we restrict our investigation to a theoretical problem with maximally contradictory objectives. Ultimately, we find that lexicase and epsilon-lexicase selection each have a region of parameter space where they are incapable of optimizing contradictory objectives. Outside of this region, however, they perform well despite the presence of contradictory objectives. Based on these findings, we propose theoretically-backed guidelines for parameter choice. Additionally, we identify other properties that may affect whether a many-objective optimization problem is a good fit for lexicase or epsilon-lexicase selection.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (21)
  1. Sneha Aenugu and Lee Spector. 2019. Lexicase Selection in Learning Classifier Systems. In Proceedings of the Genetic and Evolutionary Computation Conference (Prague, Czech Republic) (GECCO ’19). Association for Computing Machinery, New York, NY, USA, 356–364. https://doi.org/10.1145/3321707.3321828
  2. How the Combinatorics of Neutral Spaces leads GP to discover Simple Solutions. To appear in Genetric Programming Theory and Practice XX (2024).
  3. Robots That Can Adapt like Animals. Nature 521, 7553 (May 2015), 503–507. https://doi.org/10.1038/nature14422
  4. Li Ding and Lee Spector. 2022. Optimizing Neural Networks with Gradient Lexicase Selection. In International Conference on Learning Representations. https://openreview.net/forum?id=J_2xNmVcY4
  5. Emily Dolson. 2023. Calculating Lexicase Selection Probabilities Is NP-Hard. https://doi.org/10.48550/arXiv.2301.06724 arXiv:2301.06724 [cs]
  6. Emily Dolson and Alexander Lalejini. 2023. Reachability Analysis for Lexicase Selection via Community Assembly Graphs. arXiv:2309.10973 [cs.NE]
  7. Ecological Theory Provides Insights about Evolutionary Computation. PeerJ Preprints 6 (Nov. 2018), e27315v1. https://doi.org/10.7287/peerj.preprints.27315v1
  8. The Genotype-Phenotype Map of an Evolving Digital Organism. PLOS Computational Biology 13, 2 (Feb. 2017), e1005414. https://doi.org/10.1371/journal.pcbi.1005414
  9. Thomas Helmuth. 2015. General Program Synthesis from Examples Using Genetic Programming with Parent Selection Based on Random Lexicographic Orderings of Test Cases. Ph. D. Dissertation. University of Massachusetts Amherst. https://doi.org/10.7275/7408407.0
  10. Thomas Helmuth and Amr Abdelhady. 2020. Benchmarking Parent Selection for Program Synthesis by Genetic Programming. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion (Cancún, Mexico) (GECCO ’20). Association for Computing Machinery, New York, NY, USA, 237–238. https://doi.org/10.1145/3377929.3389987
  11. What Can Phylogenetic Metrics Tell us About Useful Diversity in Evolutionary Algorithms? Springer Nature Singapore, Singapore, 63–82. https://doi.org/10.1007/978-981-16-8113-4_4
  12. A Suite of Diagnostic Metrics for Characterizing Selection Schemes. https://doi.org/10.48550/arXiv.2204.13839 arXiv:2204.13839 [cs]
  13. A Probabilistic and Multi-Objective Analysis of Lexicase Selection and ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Selection. Evolutionary Computation 27, 3 (2019), 377–402. https://doi.org/10.1162/evco_a_00224
  14. William La Cava and Jason Moore. 2017. A General Feature Engineering Wrapper for Machine Learning Using ϵitalic-ϵ\epsilonitalic_ϵ-Lexicase Survival. In Genetic Programming, James McDermott, Mauro Castelli, Lukas Sekanina, Evert Haasdijk, and Pablo García-Sánchez (Eds.). Springer International Publishing, Cham, 80–95.
  15. William La Cava and Jason H. Moore. 2018. An analysis of ϵitalic-ϵ\epsilonitalic_ϵ-lexicase selection for large-scale many-objective optimization. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO ’18). Association for Computing Machinery, New York, NY, USA, 185–186. https://doi.org/10.1145/3205651.3205656
  16. Epsilon-Lexicase Selection for Regression. In Proceedings of the Genetic and Evolutionary Computation Conference 2016 (GECCO ’16). Association for Computing Machinery, New York, NY, USA, 741–748. https://doi.org/10.1145/2908812.2908898
  17. Shakiba Shahbandegan and Emily Dolson. 2023. Theoretical Limits on the Success of Lexicase Selection Under Contradictory Objectives. In Proceedings of the Companion Conference on Genetic and Evolutionary Computation (Lisbon, Portugal) (GECCO ’23 Companion). Association for Computing Machinery, New York, NY, USA, 827–830. https://doi.org/10.1145/3583133.3590714
  18. Untangling Phylogenetic Diversity’s Role in Evolutionary Computation Using a Suite of Diagnostic Fitness Landscapes. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (Boston, Massachusetts) (GECCO ’22). Association for Computing Machinery, New York, NY, USA, 2322–2325. https://doi.org/10.1145/3520304.3534028
  19. Lee Spector. 2012. Assessment of Problem Modality by Differential Performance of Lexicase Selection in Genetic Programming: A Preliminary Report. In Proceedings of the 14th Annual Conference Companion on Genetic and Evolutionary Computation (Philadelphia, Pennsylvania, USA) (GECCO ’12). Association for Computing Machinery, New York, NY, USA, 401–408. https://doi.org/10.1145/2330784.2330846
  20. Adam Stanton and Jared M. Moore. 2022. Lexicase Selection for Multi-Task Evolutionary Robotics. Artificial Life 28, 4 (11 2022), 479–498. https://doi.org/10.1162/artl_a_00374 arXiv:https://direct.mit.edu/artl/article-pdf/28/4/479/2043352/artl_a_00374.pdf
  21. L. A. Zadeh. 1965. Fuzzy Sets. Information and Control 8, 3 (June 1965), 338–353. https://doi.org/10.1016/S0019-9958(65)90241-X
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.