MattBench Testing Framework

Finished
DanHobbesfeature/nmp-improving-reddiff8.0+0.08LLR: -2.26 (-2.25, 2.89) [0.00, 4.00]
Games: 11020 W: 2740 L: 2810 D: 5470
Ptnml(0-2): 50, 1351, 2788, 1261, 60
DanHobbesfeature/standpat-tt-storediff8.0+0.08LLR: -0.81 (-2.25, 2.89) [0.00, 4.00]
Games: 7994 W: 2047 L: 2060 D: 3887
Ptnml(0-2): 40, 981, 1979, 946, 51
DanHobbesmaindiff8.0+0.08Elo: 70.75 +- 5.62 (95%) [N=5000]
Games: 5008 W: 1912 L: 906 D: 2190
Ptnml(0-2): 15, 273, 1070, 983, 163
DanHobbesfeature/early-static-eval-ttdiff8.0+0.08LLR: 3.00 (-2.25, 2.89) [0.00, 4.00]
Games: 4284 W: 1188 L: 1038 D: 2058
Ptnml(0-2): 11, 461, 1061, 585, 24
TecciCherryrfp-corrplexitydiff8.0+0.08LLR: 0.03 (-2.25, 2.89) [0.00, 3.00]
Games: 798 W: 202 L: 198 D: 398
Ptnml(0-2): 7, 90, 198, 100, 4
TecciCherryrfp-corrplexitydiff8.0+0.08LLR: -1.65 (-2.25, 2.89) [0.00, 3.00]
Games: 7562 W: 1836 L: 1926 D: 3800
Ptnml(0-2): 91, 929, 1799, 903, 59
DanHobbesfeature/conthist-mainhist-basediff40.0+0.40LLR: -2.07 (-2.25, 2.89) [0.00, 4.00]
Games: 2916 W: 669 L: 750 D: 1497
Ptnml(0-2): 4, 383, 766, 300, 5
PaulByte-Knightfeature/killers-againdiff8.0+0.08LLR: -1.49 (-2.94, 2.94) [0.00, 2.00]
Games: 20090 W: 5990 L: 6138 D: 7962
Ptnml(0-2): 787, 2404, 3781, 2316, 757
TecciCherryse-fix *diff40.0+0.40LLR: -0.50 (-2.25, 2.89) [-3.00, 0.00]
Games: 8184 W: 1983 L: 2032 D: 4169
Ptnml(0-2): 36, 1006, 2067, 937, 46
DanHobbesfeature/conthist-mainhist-basediff8.0+0.08LLR: -2.27 (-2.25, 2.89) [0.00, 4.00]
Games: 19852 W: 4951 L: 4995 D: 9906
Ptnml(0-2): 107, 2403, 4940, 2379, 97
DanHobbesfeature/spsa-6-testdiff40.0+0.40LLR: 2.94 (-2.25, 2.89) [0.00, 4.00]
Games: 27682 W: 6799 L: 6592 D: 14291
Ptnml(0-2): 35, 3194, 7187, 3379, 46
QuinniChaosrewritediff8.0+0.08LLR: 2.91 (-2.25, 2.89) [0.00, 5.00]
Games: 354 W: 278 L: 34 D: 42
Ptnml(0-2): 2, 4, 29, 32, 110
QuinniChaosrewritediff8.0+0.08LLR: 3.58 (-2.25, 2.89) [0.00, 5.00]
Games: 1280 W: 731 L: 548 D: 1
Ptnml(0-2): 35, 0, 478, 1, 126
QuinniChaosrewritediff8.0+0.08LLR: 5.51 (-2.25, 2.89) [0.00, 5.00]
Games: 880 W: 599 L: 203 D: 78
Ptnml(0-2): 15, 9, 172, 53, 191
QuinniChaosmaindiff8.0+0.08LLR: 0.13 (-2.25, 2.89) [0.00, 5.00]
Games: 38 W: 19 L: 12 D: 7
Ptnml(0-2): 1, 0, 10, 7, 1
QuinniChaosrewritediff8.0+0.08LLR: -5.16 (-2.25, 2.89) [0.00, 5.00]
Games: 512 W: 0 L: 492 D: 20
Ptnml(0-2): 236, 20, 0, 0, 0
QuinniChaosrewritediff8.0+0.08LLR: -5.91 (-2.25, 2.89) [0.00, 5.00]
Games: 1310 W: 526 L: 774 D: 10
Ptnml(0-2): 119, 10, 526, 0, 0
QuinniChaosmaindiffN=3000Generated 8000730/8000000 Games
Elo: 0.05 +- 0.24 (95%) [N=8000000]
Games: 8000730 W: 3888669 L: 3887424 D: 224637
DanHobbesfeature/spsa-6diff40.0+0.40Tuning 101 Parameters
5000/5000 Iterations
40002/40000 Games Played
TecciCherryhist-pruningdiff8.0+0.08LLR: -0.31 (-2.25, 2.89) [0.00, 3.00]
Games: 12458 W: 3091 L: 3081 D: 6286
Ptnml(0-2): 119, 1486, 3012, 1490, 122
TecciCherrymdpdiff8.0+0.08LLR: -0.59 (-2.25, 2.89) [-3.00, 0.00]
Games: 9806 W: 2401 L: 2459 D: 4946
Ptnml(0-2): 76, 1060, 2692, 996, 79
TecciCherryrfp-fail-firmdiff8.0+0.08LLR: 2.89 (-2.25, 2.89) [0.00, 3.00]
Games: 11792 W: 3021 L: 2807 D: 5964
Ptnml(0-2): 85, 1331, 2890, 1465, 125
TecciCherryneg-extdiff8.0+0.08LLR: 0.92 (-2.25, 2.89) [0.00, 5.00]
Games: 82410 W: 20483 L: 20118 D: 41809
Ptnml(0-2): 685, 9752, 20010, 10029, 729
DanHobbesfeature/multicut-fail-firmdiff8.0+0.08LLR: 2.68 (-2.23, 2.55) [0.00, 4.00]
Games: 22206 W: 5786 L: 5600 D: 10820
Ptnml(0-2): 86, 2502, 5755, 2660, 100
PaulByte-Knightfeature/killers-againdiff8.0+0.08LLR: -2.98 (-2.94, 2.94) [0.00, 5.00]
Games: 47502 W: 14458 L: 14358 D: 18686
Ptnml(0-2): 1883, 5509, 8896, 5551, 1912