We present a standardised format for representing algorithm selection scenarios and a repository that contains a growing number of data sets from the literature, called ASlib. Algorithm selection is an area that increasingly attracts attention from researchers and practitioners from a variety of different backgrounds. After years of fruitful applications in a number of domains, there is a lot of data, but no standard format or repository for this data. This is in contrast to more established fields and makes it difficult to effectively share and compare different approaches. It also creates unnecessary obstacles for researchers new to algorithm selection to begin work in this area. We present a standardised format for representing algorithm selection scenarios and a repository that contains a growing number of data sets from the literature. Our format has been designed to be able to express a wide variety of different scenarios. Leveraging this standardisation, we have run a set of example experiments that build and evaluate algorithm selection models through a common interface.
References
- Bischl, B. and Kerschke, P. and Kotthoff, L. and Lindauer, M. and Malitsky, Y. and Frechétte, A. and Hoos, H. and Hutter, F. and Leyton-Brown, K. and Tierney, K. and Vanschoren, J.
ASlib: A Benchmark Library for Algorithm Selection
In: Artificial Intelligence Journal (AIJ) 237 (2016): 41-58