nocturn9x’s tests
Active 2 Workers / 0 Training / 28 Test threads / 26.81 MNPS
Finished 25 shown
| Author | Engine | Identifier | Code | Time control | Results
|
|---|---|---|---|---|---|
| nocturn9x | Heimdall | remiel-v2 | diff ↗ | 40.0+0.40 |
LLR: 0.00 (-2.25, 2.89) [0.00, 3.00] Games: 0 W: 0 L: 0 D: 0 Ptnml(0-2): 0, 0, 0, 0, 0 |
|
Switch to remiel-v2 (bench 4810274)
Use MattBench run 49, superbatch 1100, with a 768-neuron FT and
32/32 hidden layers. Match the synthetic fixture and SIMD checks to
the production dimensions.
On all 7,153,653 lichess-big3 positions, the absolute mean is 928.76
for remiel and 949.83 for remiel-v2 at scale 282. getScale yields
275.744417, rounded to EVAL_SCALE=276.
Co-authored-by: GPT 6.1 Sol <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | remiel-v2 | diff ↗ | 8.0+0.08 |
LLR: -0.46 (-2.25, 2.89) [0.00, 3.00] Games: 388 W: 90 L: 121 D: 177 Ptnml(0-2): 6, 63, 84, 38, 3 |
|
Try remiel-v2 from training run 49, final SB 1100. Expand FT 512 to 768 and hidden sizes 16/32 to 32/32. On all 7,153,653 lichess-big3 positions, absolute mean is 928.76 for remiel and 949.83 for remiel-v2 at scale 282. getScale gives 275.744417; use scale 276 (mean 929.61).
|
|||||
| nocturn9x | Heimdall | 50mr-tm | diff ↗ | 8.0+0.08 |
LLR: -0.80 (-2.25, 2.89) [0.00, 3.00] Games: 1100 W: 239 L: 286 D: 575 Ptnml(0-2): 6, 160, 262, 119, 3 |
|
Scale soft time bound according to half move clock (bench 5611448)
|
|||||
| nocturn9x | Heimdall | 50mr-tm | diff ↗ | 8.0+0.08 |
LLR: -2.28 (-2.25, 2.89) [0.00, 3.00] Games: 3246 W: 726 L: 856 D: 1664 Ptnml(0-2): 23, 430, 832, 330, 8 |
|
Scale soft time bound according to half move clock (bench 5611448)
|
|||||
| nocturn9x | Heimdall | 50mr-tm | diff ↗ | 8.0+0.08 |
LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 4764 W: 1085 L: 1213 D: 2466 Ptnml(0-2): 29, 623, 1198, 511, 21 |
|
Scale soft time bound according to half move clock (bench 5611448)
|
|||||
| nocturn9x | Heimdall | 50mr-tm | diff ↗ | 8.0+0.08 |
LLR: -0.20 (-2.25, 2.89) [0.00, 3.00] Games: 88 W: 16 L: 29 D: 43 Ptnml(0-2): 2, 16, 19, 7, 0 |
|
Scale soft time bound according to half move clock (bench 5611448)
|
|||||
| nocturn9x | Heimdall | master | diff ↗ | N=12000 |
Generated 5000088/5000000 Games Elo: -0.08 +- 0.25 (95%) [N=5000000] Games: 5000088 W: 1660723 L: 1661884 D: 1677481 |
| nocturn9x | Heimdall | rep-collision-fix | diff ↗ | 8.0+0.08 |
LLR: 2.90 (-2.25, 2.89) [-5.00, 0.00] Games: 9330 W: 2325 L: 2257 D: 4748 Ptnml(0-2): 56, 955, 2550, 1073, 31 |
|
Yeet silly debug easter egg to use faster autovec repetition comparisons + clang LTO black magic (bench 5611448)
|
|||||
| nocturn9x | Heimdall | rep-collision-fix | diff ↗ | 8.0+0.08 |
LLR: 0.97 (-2.25, 2.89) [-5.00, 0.00] Games: 4930 W: 1232 L: 1216 D: 2482 Ptnml(0-2): 23, 535, 1327, 563, 17 |
|
Double check zobrist collisions using our position stack (bench 5611448)
Co-authored-by: GPT 6 <codex@openai.com>
Not actually coauthored by ze slopper btw, I just had it fix missing benches and it upid. Keeping this up for accountability purposes
|
|||||
| nocturn9x | Heimdall | worker-pv-score-fix | diff ↗ | 8.0+0.08 |
LLR: 2.91 (-2.25, 2.89) [-5.00, 0.00] Games: 6392 W: 1600 L: 1520 D: 3272 Ptnml(0-2): 15, 733, 1624, 805, 19 |
|
Use completed PV scores when selecting workers (bench 5551733)
Compare workers using scores saved with their last completed primary PV,
and report the selected PV's saved score. Live root scores may belong to
secondary variations or interrupted searches. Ignore workers without a
completed primary PV.
Co-authored-by: Codex (GPT-6 Astra) <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | tyrfing-12ksn | diff ↗ | 40.0+0.40 |
LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 12500 W: 3242 L: 3040 D: 6218 Ptnml(0-2): 32, 1440, 3111, 1628, 39 |
|
Merge master and select A8607157 (bench 5611448)
Bring tyrfing-12ksn up to date with master and select the new
A8607157 network with the unchanged multilayer TI architecture.
Keep the weights local in networks/files/tyrfing-12ksn-v2.bin;
network publication remains deferred until the net is merged.
Calibrate on all 7,153,653 positions in lichess-big3-resolved.book.
At scale 305, getStats reports absolute means of 927.90 for
master's 510EEBF8 network and 1004.55 for A8607157. getScale
recommends 281.727639, rounded to 282. At scale 282, the new
absolute mean is 928.76. Update the documented default scale.
Validation: make dev and the runtime-check build pass. Scalar
and AVX2 NNUE tests each pass 17,731 incremental/full-refresh
comparisons with identical checksums. Python regressions pass
(99 tests, 5 skipped) with Git signing disabled for temporary
test commits. The repository commit hook also passes make test.
The optimized depth-13 bench is 5611448 nodes.
Network SHA-256:
a8607157fbb8ac900ac7fe25d45d772509db9ecf3d9b5cb5000e5a581e1d0890
Co-authored-by: GPT 6 <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | tyrfing-12ksn | diff ↗ | 8.0+0.08 |
LLR: 2.93 (-2.25, 2.89) [0.00, 3.00] Games: 8286 W: 2265 L: 2053 D: 3968 Ptnml(0-2): 65, 935, 1952, 1105, 86 |
|
Merge master and select A8607157 (bench 5611448)
Bring tyrfing-12ksn up to date with master and select the new
A8607157 network with the unchanged multilayer TI architecture.
Keep the weights local in networks/files/tyrfing-12ksn-v2.bin;
network publication remains deferred until the net is merged.
Calibrate on all 7,153,653 positions in lichess-big3-resolved.book.
At scale 305, getStats reports absolute means of 927.90 for
master's 510EEBF8 network and 1004.55 for A8607157. getScale
recommends 281.727639, rounded to 282. At scale 282, the new
absolute mean is 928.76. Update the documented default scale.
Validation: make dev and the runtime-check build pass. Scalar
and AVX2 NNUE tests each pass 17,731 incremental/full-refresh
comparisons with identical checksums. Python regressions pass
(99 tests, 5 skipped) with Git signing disabled for temporary
test commits. The repository commit hook also passes make test.
The optimized depth-13 bench is 5611448 nodes.
Network SHA-256:
a8607157fbb8ac900ac7fe25d45d772509db9ecf3d9b5cb5000e5a581e1d0890
Co-authored-by: GPT 6 <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | master | diff ↗ | N=12000 |
Generated 4312694/5000000 Games Elo: 0.24 +- 0.27 (95%) [N=5000000] Games: 4312694 W: 1434990 L: 1431976 D: 1445728 |
| nocturn9x | Heimdall | optional-eval-qsearch-evasions | diff ↗ | 8.0+0.08 |
LLR: -0.37 (-2.25, 2.89) [0.00, 3.00] Games: 3028 W: 734 L: 750 D: 1544 Ptnml(0-2): 17, 392, 707, 386, 12 |
|
Search all legal evasions in quiescence (bench 5983062)
Quiescence previously generated only captures and applied losing-capture SEE
pruning in check. Generate every legal evasion and bypass that pruning while
checked; return matedIn(ply) when none exist. Keep capture-only generation
outside check and retain bound-only TT storage.
Add regressions for checkmate without an allocated NNUE state, all four quiet
king evasions from a rook check, and a SEE-negative capture evasion. These
changes are independent of optional static-eval representation and consumers.
Validation: focused AVX2 checked/danger and scalar checked search regressions,
including unchanged TT/stack layouts; Python suite (99 run, 5 skipped).
Optimized depth-13; depth 14 visited 8366978 nodes.
Co-authored-by: GPT 6 <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | optional-eval-in-check | diff ↗ | 8.0+0.08 |
LLR: -1.64 (-2.25, 2.89) [0.00, 3.00] Games: 1316 W: 276 L: 374 D: 666 Ptnml(0-2): 14, 193, 331, 117, 3 |
|
Guard search heuristics and skip static evaluation in check (bench 5401484)
Checked nodes carry noEval through the search stack and TT. Main-search
futility pruning and the fail-low extension after a reduced parent search
previously consumed static eval in check; require present evaluations before
using them. Guard improving, reverse futility, null move and correction-history
arithmetic likewise, and compute TT-adjusted eval only where needed.
Disable qsearch stand pat when static eval is absent. Preserve capture-only
move generation and SEE pruning here; full check evasions and qsearch mate
recognition are isolated in a follow-up commit. Until then, checked qsearch
nodes with no searched capture retain -SCORE_INF.
At the hard ply boundary, return a neutral score in check instead of evaluating.
Enforce the rawEval precondition with doAssert, including in danger builds.
Subprocess tests verify this invariant and absent-eval unwrapping survive there.
Validation: focused AVX2 checked/danger and scalar checked tests; exhaustive
optional-eval/TT round trips and unchanged layouts; Python suite (99 run,
5 skipped). Optimized depth-13; depth 14 visited 8078278 nodes.
Twelve alternating depth-14 pairs on CPU 2 versus the representation-only
commit show -1.25% throughput change, 95% bootstrap interval
[-7.32%, +3.49%]. Search trees differ, so this measures throughput rather
than identical work or playing strength.
Co-authored-by: GPT 6 <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | master | diff ↗ | N=12000 |
Generated 4509392/5000000 Games Elo: -0.08 +- 0.26 (95%) [N=5000000] Games: 4509392 W: 1498806 L: 1499796 D: 1510790 |
| nocturn9x | Heimdall | qs-pv-fixes | diff ↗ | 8.0+0.08 |
LLR: -0.61 (-2.25, 2.89) [-5.00, 0.00] Games: 3466 W: 833 L: 869 D: 1764 Ptnml(0-2): 13, 450, 850, 400, 20 |
|
Make qsearch keep track of PVs, avoid qsearching with invalid windows and don't cutoff QS in PV nodes (bench 5515662)
|
|||||
| nocturn9x | Heimdall | [Potential] main | diff ↗ | 40.0+0.40 |
Elo: 32.17 +- 16.65 (95%) [N=1000] Games: 444 W: 140 L: 99 D: 205 Ptnml(0-2): 2, 34, 107, 79, 0 |
|
so eren will stop sending heimdall blunder positions
|
|||||
| nocturn9x | Heimdall | tyrfing-12ksn | diff ↗ | 40.0+0.40 |
LLR: 0.10 (-2.25, 2.89) [0.00, 3.00] Games: 448 W: 116 L: 109 D: 223 Ptnml(0-2): 2, 47, 118, 56, 1 |
|
Switch to tyrfing-12ksn (bench 4979204)
Select tyrfing-12ksn network 77F0596E and set the multilayer
scale to 288. Update the documented default scale.
At scale 305, the 7,153,653-position Lichess comparison gives
absolute means 927.90 for master and 981.15 for the new network;
getScale yields 288.446721, rounded to 288.
Validation: make bench with 77F0596E at scale 288 gives 4979204
nodes at depth 13. Confirmed the network ID and compiled scale;
the 10,000-position absolute mean is 911.04. Runtime-check build,
full-book evaluation and Python regressions passed (5 skipped).
Network weights remain local pending separate publication.
Co-authored-by: GPT 6.1 Sol <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | tyrfing-12ksn | diff ↗ | 8.0+0.08 |
LLR: -0.05 (-2.25, 2.89) [0.00, 3.00] Games: 4238 W: 1130 L: 1123 D: 1985 Ptnml(0-2): 52, 497, 1008, 516, 46 |
|
Switch to tyrfing-12ksn (bench 4979204)
Select tyrfing-12ksn network 77F0596E and set the multilayer
scale to 288. Update the documented default scale.
At scale 305, the 7,153,653-position Lichess comparison gives
absolute means 927.90 for master and 981.15 for the new network;
getScale yields 288.446721, rounded to 288.
Validation: make bench with 77F0596E at scale 288 gives 4979204
nodes at depth 13. Confirmed the network ID and compiled scale;
the 10,000-position absolute mean is 911.04. Runtime-check build,
full-book evaluation and Python regressions passed (5 skipped).
Network weights remain local pending separate publication.
Co-authored-by: GPT 6.1 Sol <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | tyrfing-12ksn | diff ↗ | 8.0+0.08 |
LLR: -0.58 (-2.25, 2.89) [0.00, 3.00] Games: 436 W: 96 L: 132 D: 208 Ptnml(0-2): 6, 66, 105, 40, 1 |
|
Switch to tyrfing-12ksn (bench 5228946)
Select the completed SB 1100 tyrfing-12ksn network and set the
multilayer evaluation scale to 274. Update the documented scale.
The 7,153,653-position Lichess comparison gives absolute means
927.90 for master and 1032.37 for the new network at scale 305;
getScale yields 274.135727, rounded to 274.
Validation: make bench with the selected network at scale 274 gives
5228946 nodes at depth 13. Confirmed the built-in network ID and scale.
Runtime-check build and Python regressions passed (5 skipped).
The network weights remain local pending separate publication.
Co-authored-by: GPT 6.1 Sol <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | master | diff ↗ | N=12000 |
Generated 4072722/5000000 Games Elo: 0.10 +- 0.28 (95%) [N=5000000] Games: 4072722 W: 1353222 L: 1351992 D: 1367508 |
| nocturn9x | Heimdall | tyrfing-v2 | diff ↗ | 8.0+0.08 |
LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 1806 W: 392 L: 544 D: 870 Ptnml(0-2): 44, 259, 418, 169, 13 |
|
Document direct executable downloads and Unix permissions (bench 5551733)
Co-authored-by: GPT-6 Astra <codex@openai.com>
|
|||||
| nocturn9x | Heimdall | tyrfing-v2 | diff ↗ | 40.0+0.40 |
LLR: -0.25 (-2.25, 2.89) [0.00, 3.00] Games: 554 W: 136 L: 150 D: 268 Ptnml(0-2): 1, 77, 135, 63, 1 |
|
Switch to tyrfing v2 (bench 5638473)
|
|||||
| nocturn9x | Heimdall | 1.5.1 | diff ↗ | 40.0+0.40 |
Elo: 12.66 +- 5.51 (95%) [N=2000] Games: 2004 W: 208 L: 135 D: 1661 Ptnml(0-2): 2, 89, 747, 162, 2 |
|
Document direct executable downloads and Unix permissions (bench 5551733)
Co-authored-by: GPT-6 Astra <codex@openai.com>
|
|||||