PMLB: a large benchmark suite for machine learning evaluation and comparison

Published on Dec 1, 2017in Biodata Mining2.30
· DOI :10.1186/s13040-017-0154-4
Randal S. Olson15
Estimated H-index: 15
(UPenn: University of Pennsylvania),
William G. La Cava10
Estimated H-index: 10
(UPenn: University of Pennsylvania)
+ 2 AuthorsJason H. Moore69
Estimated H-index: 69
(UPenn: University of Pennsylvania)
Background The selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark datasets have emerged from different sources, but their organization and adoption as standards have been inconsistent. As such, selecting and curating specific benchmarks remains an unnecessary burden on machine learning practitioners and data scientists.
  • References (24)
  • Citations (40)
#1Mario A. Muñoz (Monash University)H-Index: 10
#2Laura Villanova (Monash University)H-Index: 5
Last.Kate Smith-Miles (Monash University)H-Index: 22
view all 4 authors...
#1Jing Li (Dartmouth College)H-Index: 4
#2James D. Malley (CIT: Center for Information Technology)H-Index: 26
Last.Jason H. Moore (UPenn: University of Pennsylvania)H-Index: 69
view all 5 authors...
#1William G. La Cava (UMass: University of Massachusetts Amherst)H-Index: 10
#2Kourosh Danai (UMass: University of Massachusetts Amherst)H-Index: 16
Last.Lee Spector (Hampshire College)H-Index: 33
view all 3 authors...
#1Joaquin Vanschoren (TU/e: Eindhoven University of Technology)H-Index: 15
#2Jan N. van Rijn (LEI: Leiden University)H-Index: 9
Last.Luís Torgo (University of Porto)H-Index: 23
view all 4 authors...
#1David White (Glas.: University of Glasgow)H-Index: 27
#2James McDermott (UCD: University College Dublin)H-Index: 17
Last.Sean Luke (GMU: George Mason University)H-Index: 35
view all 9 authors...
#1Ryan J. Urbanowicz (Dartmouth College)H-Index: 16
#2Jeff Kiralis (Dartmouth College)H-Index: 8
Last.Jason H. Moore (Dartmouth College)H-Index: 69
view all 4 authors...
#1Johannes Stallkamp (RUB: Ruhr University Bochum)H-Index: 7
#2Marc Schlipsing (RUB: Ruhr University Bochum)H-Index: 11
Last.Christian Igel (UCPH: University of Copenhagen)H-Index: 36
view all 4 authors...
Cited By40
#1José Pablo Cambronero (MIT: Massachusetts Institute of Technology)H-Index: 2
#2Martin Rinard (MIT: Massachusetts Institute of Technology)H-Index: 57
#1Jose Marcio Luna (UPenn: University of Pennsylvania)H-Index: 6
#2Efstathios D. Gennatas (UCSF: University of California, San Francisco)H-Index: 16
Last.Gilmer Valdes (UCSF: University of California, San Francisco)H-Index: 11
view all 10 authors...
#1Hilde J. P. Weerts (TU/e: Eindhoven University of Technology)H-Index: 1
Last.Mykola Pechenizkiy (TU/e: Eindhoven University of Technology)H-Index: 29
view all 3 authors...
#1Stephen R. Piccolo (BYU: Brigham Young University)H-Index: 14
#2Terry J Lee (BYU: Brigham Young University)
Last.Kimball Hill (BYU: Brigham Young University)H-Index: 1
view all 4 authors...
View next paperPMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparison