Evals is not enough: why we should report wall-clock time

Created by W.Langdon from gp-bibliography.bib Revision:1.8010

@InProceedings{Woodward:2016:GIa,

• author = "John Woodward and Alexander Brownlee and Colin Johnson",
• title = "Evals is not enough: why we should report wall-clock time",
• booktitle = "Genetic Improvement 2016 Workshop",
• year = "2016",
• editor = "Justyna Petke and David R. White and Westley Weimer",
• pages = "1157--1158",
• address = "Denver",
• publisher_address = "New York, NY, USA",
• month = jul # " 20-24",
• organisation = "SIGEvo",
• publisher = "ACM",
• keywords = "genetic algorithms, genetic programming, Genetic Improvement, SBSE",
• URL = "http://geneticimprovementofsoftware.com/wp-content/uploads/2016/06/Evals_is_not_enough_why_we_should_report_wall-clock_time.pdf",
• DOI = "doi:10.1145/2908961.2931695",
• size = "2 pages",
• abstract = "Have you ever noticed that your car never achieves the fuel economy claimed by the manufacturer? Does this seem unfair? Unscientific? Would you like the same situation to occur in Genetic Improvement? Comparison will always be difficult [9], however, guidelines have been discussed [3, 5, 4]. With two GP [8] approaches, comparing the number of evaluations of the fitness function is reasonably fair. This means you are comparing the GP systems, and not how well they are implemented, how fast the language is. However, the situation with GI [6, 1] is unique. With GI we will typically compare systems which are applied to the same application written in the same language (i.e. a GI systems targeted at Java, may not even be applied to C). Thus, wall-clock time becomes more relevant. Thus, this paper asks if reporting number of evaluations is enough, or if wall-clock time is also important, particularly in the context of GI. It argues that reporting time is even more important when doing GI when compared to traditional GP.",
• notes = "GECCO-2016 Workshop http://geneticimprovementofsoftware.com/",

}

Genetic Programming entries for John R Woodward Alexander E I Brownlee Colin G Johnson

Citations