We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a "blacklist" of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems. © 2012 Springer Science+Business Media New York.

White, D., Mcdermott, J., Castelli, M., Manzoni, L., Goldman, B., Kronberger, G., et al. (2013). Better GP benchmarks: Community survey results and proposals. GENETIC PROGRAMMING AND EVOLVABLE MACHINES, 14(1), 3-29 [10.1007/s10710-012-9177-2].

Better GP benchmarks: Community survey results and proposals

CASTELLI, MAURO;MANZONI, LUCA;
2013

Abstract

We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a "blacklist" of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems. © 2012 Springer Science+Business Media New York.
Articolo in rivista - Articolo scientifico
Benchmarks; Community survey; Genetic programming; Software; Hardware and Architecture; Computer Science Applications1707 Computer Vision and Pattern Recognition; Theoretical Computer Science
English
3
29
27
White, D., Mcdermott, J., Castelli, M., Manzoni, L., Goldman, B., Kronberger, G., et al. (2013). Better GP benchmarks: Community survey results and proposals. GENETIC PROGRAMMING AND EVOLVABLE MACHINES, 14(1), 3-29 [10.1007/s10710-012-9177-2].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/60836
Citazioni
  • Scopus 154
  • ???jsp.display-item.citation.isi??? 129
Social impact