MattBench Testing Framework

Finished
Sp00phicarusqsearch-skip-quietsdiff8.0+0.08LLR: 2.09 (-2.94, 2.94) [0.00, 5.00]
Games: 23922 W: 6657 L: 6482 D: 10783
Ptnml(0-2): 204, 2736, 5908, 2907, 206
NocturHeimdallscore-eval-fixesdiff8.0+0.08LLR: 2.94 (-2.25, 2.89) [-5.00, 0.00]
Games: 9670 W: 2354 L: 2285 D: 5031
Ptnml(0-2): 32, 1093, 2533, 1128, 49
NocturHeimdallscore-eval-fixesdiff8.0+0.08LLR: -2.18 (-2.25, 2.89) [-5.00, 0.00]
Games: 270 W: 9 L: 183 D: 78
Ptnml(0-2): 54, 67, 13, 1, 0
NocturHeimdallscore-eval-fixesdiff8.0+0.08LLR: -0.67 (-2.25, 2.89) [-5.00, 0.00]
Games: 82 W: 3 L: 57 D: 22
Ptnml(0-2): 17, 20, 4, 0, 0
Sp00phicarusrfp-fail-firmdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [0.00, 5.00]
Games: 30396 W: 8572 L: 8335 D: 13489
Ptnml(0-2): 251, 3586, 7338, 3721, 302
Sp00phicarusoutput-bucketsdiff8.0+0.08LLR: -2.95 (-2.94, 2.94) [0.00, 5.00]
Games: 10148 W: 2865 L: 2940 D: 4343
Ptnml(0-2): 109, 1244, 2436, 1183, 102
PaulByte-Knightchore/simplify-rand-usage *diff8.0+0.08LLR: -3.09 (-2.94, 2.94) [-5.00, 0.00]
Games: 9014 W: 2608 L: 2804 D: 3602
Ptnml(0-2): 353, 1020, 1849, 1040, 245
Sp00phicarusqs-see-fixdiff8.0+0.08LLR: -2.72 (-2.94, 2.94) [-5.00, 0.00]
Games: 3772 W: 1010 L: 1131 D: 1631
Ptnml(0-2): 41, 506, 896, 419, 24
Sp00phicarusqs-see-fixdiff8.0+0.08LLR: -1.28 (-2.94, 2.94) [-5.00, 0.00]
Games: 1016 W: 245 L: 297 D: 474
Ptnml(0-2): 13, 132, 262, 96, 5
DanHobbesfeature/qs-standpat-fail-more-filmdiff8.0+0.08LLR: -2.26 (-2.25, 2.89) [0.00, 4.00]
Games: 50026 W: 11785 L: 11738 D: 26503
Ptnml(0-2): 169, 5943, 12716, 6042, 143
DanHobbesfeature/more-hist-tunablesdiff40.0+0.40Tuning 164 Parameters
5002/5000 Iterations
40016/40000 Games Played
Sp00phicarusqs-see-fixdiff8.0+0.08LLR: -0.22 (-2.94, 2.94) [-5.00, 0.00]
Games: 152 W: 37 L: 45 D: 70
Ptnml(0-2): 1, 19, 43, 13, 0
Sp00phicarusqs-see-fixdiff8.0+0.08LLR: -0.45 (-2.94, 2.94) [-5.00, 0.00]
Games: 184 W: 49 L: 65 D: 70
Ptnml(0-2): 4, 21, 54, 13, 0
DanHobbesfeature/lmr-noisy-tablediff8.0+0.08LLR: 2.89 (-2.25, 2.89) [-5.00, 0.00]
Games: 9362 W: 2163 L: 2101 D: 5098
Ptnml(0-2): 22, 885, 2806, 945, 23
DanHobbesfeature/lmr-noisy-tablediff8.0+0.08LLR: -1.60 (-2.25, 2.89) [0.00, 4.00]
Games: 2470 W: 534 L: 598 D: 1338
Ptnml(0-2): 8, 330, 619, 274, 4
Sp00phicarusavx512-inferencediff8.0+0.08LLR: 2.97 (-2.94, 2.94) [0.00, 5.00]
Games: 2144 W: 671 L: 548 D: 925
Ptnml(0-2): 11, 206, 536, 287, 32
DanHobbesfeature/lmr-checkdiff8.0+0.08LLR: -1.11 (-2.25, 2.89) [0.00, 4.00]
Games: 4406 W: 989 L: 1026 D: 2391
Ptnml(0-2): 21, 532, 1127, 509, 14
Sp00phicarus1024hldiff8.0+0.08LLR: 3.04 (-2.94, 2.94) [0.00, 10.00]
Games: 548 W: 184 L: 122 D: 242
Ptnml(0-2): 1, 41, 134, 91, 7
Tecciicarusmain *diffN=5000Generated 10000638/10000000 Games
Elo: -0.05 +- 0.19 (95%) [N=10000000]
Games: 10000638 W: 4037344 L: 4038842 D: 1924452
Sp00phicarusoutput-bucketsdiff8.0+0.08LLR: 1.98 (-2.94, 2.94) [0.00, 5.00]
Games: 19314 W: 5588 L: 5426 D: 8300
Ptnml(0-2): 251, 2239, 4503, 2425, 239
DanHobbes[Tarnished] master *diff8.0+0.08Elo: 15.90 +- 5.92 (95%) [N=3000]
Games: 3084 W: 1142 L: 1001 D: 941
Ptnml(0-2): 17, 204, 980, 303, 38
DanHobbes[Heimdall] master *diff8.0+0.08Elo: 86.69 +- 7.04 (95%) [N=3000]
Games: 3064 W: 1486 L: 737 D: 841
Ptnml(0-2): 2, 69, 811, 478, 172
DanHobbes[Stormphrax] v7.0.0 *diff8.0+0.08Elo: -31.74 +- 5.98 (95%) [N=40000]
Games: 3030 W: 897 L: 1173 D: 960
Ptnml(0-2): 54, 336, 969, 144, 12
DanHobbes[Stormphrax] v7.0.0diff8.0+0.08Elo: 7.35 +- 5.96 (95%) [N=4000]
Games: 4020 W: 1146 L: 1061 D: 1813
Ptnml(0-2): 31, 440, 996, 499, 44
DanHobbesfeature/qs-pv-lmp-mcdiff8.0+0.08LLR: -2.40 (-2.25, 2.89) [0.00, 4.00]
Games: 7864 W: 1797 L: 1882 D: 4185
Ptnml(0-2): 35, 979, 1978, 916, 24