MattBench

MattBench Testing Framework

Author	Ellie
Creation	1788695932
Source	https://github.com/Silverrzz/sable
Sha	b2af9e6860c66c4ae37b7c8dfa928c48c29b1c3e
Branch	uncertainty-tune
Bench	1993289
Network
Options	Threads=1 Hash=256 UCI_Chess960=true
Time	80.0+0.80
Opening Book	DFRC_4852_v2.epd
Upload PGNs	FALSE
Syzygy WDL	DISABLED
Syzygy ADJ.	OPTIONAL
Win ADJ.	movecount=5 score=600
Draw ADJ.	movenumber=32 movecount=6 score=15
Scaling	DEV 1000000 NPS
Alpha	0.602
Gamma	0.101
A-Ratio	0.1
Reporting	BATCHED
Distribution	SINGLE
Pairs Per Point	6

uncertainty-tune vs uncertainty-tune

Approve Restart Delete

RFP_UNCERTAINTY_SCALE, int, 64.0, 0.0, 192.0, 8.0, 0.032
RFP_UNCERTAINTY_MAX_MARGIN, int, 64.0, 0.0, 256.0, 8.0, 0.0427
RFP_UNCERTAINTY_MIN_DEPTH, int, 2.0, 1.0, 3.0, 0.5, 0.0053
RFP_UNCERTAINTY_MAX_DEPTH, int, 4.0, 3.0, 5.0, 0.5, 0.0053
RFP_UNCERTAINTY_CONFIDENT_WEIGHT, int, 192.0, 0.0, 384.0, 16.0, 0.032
RFP_UNCERTAINTY_UNCERTAIN_WEIGHT, int, 192.0, 0.0, 384.0, 16.0, 0.032
RFP_UNCERTAINTY_DEADBAND, int, 4.0, 0.0, 64.0, 2.0, 0.0427
LMR_UNCERTAINTY_REFERENCE, int, 850.0, 200.0, 1600.0, 64.0, 0.0292
LMR_UNCERTAINTY_WEIGHT, int, 384.0, 0.0, 768.0, 32.0, 0.032
LMR_UNCERTAINTY_CONFIDENT_WEIGHT, int, 384.0, 0.0, 768.0, 32.0, 0.032
LMR_UNCERTAINTY_DEADBAND, int, 32.0, 0.0, 256.0, 8.0, 0.0427
LMR_UNCERTAINTY_MIN_DEPTH, int, 4.0, 2.0, 6.0, 0.5, 0.0107
LMR_UNCERTAINTY_MAX_DEPTH, int, 10.0, 6.0, 16.0, 1.0, 0.0133
LMR_UNCERTAINTY_MIN_MOVE, int, 4.0, 2.0, 12.0, 1.0, 0.0133
FUTILITY_UNCERTAINTY_REFERENCE, int, 400.0, 100.0, 1000.0, 32.0, 0.0375
FUTILITY_UNCERTAINTY_WEIGHT, int, 24.0, 0.0, 96.0, 8.0, 0.016
FUTILITY_UNCERTAINTY_CONFIDENT_WEIGHT, int, 32.0, 0.0, 96.0, 8.0, 0.016
FUTILITY_UNCERTAINTY_DEADBAND, int, 16.0, 0.0, 128.0, 4.0, 0.0427
FUTILITY_UNCERTAINTY_MIN_DEPTH, int, 2.0, 1.0, 4.0, 0.5, 0.008
FUTILITY_UNCERTAINTY_MAX_DEPTH, int, 5.0, 4.0, 8.0, 0.5, 0.0107

Copy SPSA Inputs

RFP_UNCERTAINTY_SCALE, 52
RFP_UNCERTAINTY_MAX_MARGIN, 80
RFP_UNCERTAINTY_MIN_DEPTH, 2
RFP_UNCERTAINTY_MAX_DEPTH, 4
RFP_UNCERTAINTY_CONFIDENT_WEIGHT, 168
RFP_UNCERTAINTY_UNCERTAIN_WEIGHT, 135
RFP_UNCERTAINTY_DEADBAND, 2
LMR_UNCERTAINTY_REFERENCE, 939
LMR_UNCERTAINTY_WEIGHT, 269
LMR_UNCERTAINTY_CONFIDENT_WEIGHT, 269
LMR_UNCERTAINTY_DEADBAND, 70
LMR_UNCERTAINTY_MIN_DEPTH, 3
LMR_UNCERTAINTY_MAX_DEPTH, 9
LMR_UNCERTAINTY_MIN_MOVE, 3
FUTILITY_UNCERTAINTY_REFERENCE, 266
FUTILITY_UNCERTAINTY_WEIGHT, 38
FUTILITY_UNCERTAINTY_CONFIDENT_WEIGHT, 18
FUTILITY_UNCERTAINTY_DEADBAND, 35
FUTILITY_UNCERTAINTY_MIN_DEPTH, 2
FUTILITY_UNCERTAINTY_MAX_DEPTH, 5

Copy SPSA Outputs

Tuning 20 Parameters
750/750 Iterations
9000/9000 Games Played

Name	Curr	Start	Min	Max	C	C_end	R	R_end
RFP_UNCERTAINTY_SCALE	51.8735	64	0	192	7.9989	8.0000	0.0320	0.0320
RFP_UNCERTAINTY_MAX_MARGIN	80.1814	64	0	256	7.9989	8.0000	0.0427	0.0427
RFP_UNCERTAINTY_MIN_DEPTH	2.2967	2	1	3	0.5000	0.5000	0.0053	0.0053
RFP_UNCERTAINTY_MAX_DEPTH	3.7033	4	3	5	0.5000	0.5000	0.0053	0.0053
RFP_UNCERTAINTY_CONFIDENT_WEIGHT	167.7469	192	0	384	15.9978	16.0000	0.0320	0.0320
RFP_UNCERTAINTY_UNCERTAIN_WEIGHT	134.6745	192	0	384	15.9978	16.0000	0.0320	0.0320
RFP_UNCERTAINTY_DEADBAND	2.2065	4	0	64	1.9997	2.0000	0.0427	0.0427
LMR_UNCERTAINTY_REFERENCE	938.5238	850	200	1600	63.9914	64.0000	0.0292	0.0292
LMR_UNCERTAINTY_WEIGHT	269.3491	384	0	768	31.9957	32.0000	0.0320	0.0320
LMR_UNCERTAINTY_CONFIDENT_WEIGHT	269.3491	384	0	768	31.9957	32.0000	0.0320	0.0320
LMR_UNCERTAINTY_DEADBAND	70.2468	32	0	256	7.9989	8.0000	0.0427	0.0427
LMR_UNCERTAINTY_MIN_DEPTH	3.4010	4	2	6	0.5000	0.5000	0.0107	0.0107
LMR_UNCERTAINTY_MAX_DEPTH	8.5109	10	6	16	0.9999	1.0000	0.0133	0.0133
LMR_UNCERTAINTY_MIN_MOVE	3.3700	4	2	12	0.9999	1.0000	0.0133	0.0133
FUTILITY_UNCERTAINTY_REFERENCE	265.6434	400	100	1000	31.9957	32.0000	0.0375	0.0375
FUTILITY_UNCERTAINTY_WEIGHT	38.3314	24	0	96	7.9989	8.0000	0.0160	0.0160
FUTILITY_UNCERTAINTY_CONFIDENT_WEIGHT	17.6686	32	0	96	7.9989	8.0000	0.0160	0.0160
FUTILITY_UNCERTAINTY_DEADBAND	35.1234	16	0	128	3.9995	4.0000	0.0427	0.0427
FUTILITY_UNCERTAINTY_MIN_DEPTH	1.8105	2	1	4	0.5000	0.5000	0.0080	0.0080
FUTILITY_UNCERTAINTY_MAX_DEPTH	5.2534	5	4	8	0.5000	0.5000	0.0107	0.0107

#	User	Updated	Games	Won	Lost	Drawn	Time	Crash