Variant Stockfish Testing Queue

Filter: variant = shatranj

Finished - 241 tests

21-04-19 ia shatranj piece_values diff 
LLR: 2.99 (-2.94,2.94) [0.00,10.00]
Total: 12837 W: 603 L: 518 D: 11716
 sprt @ 30+0.3 th 1 tweak piece values. LTC
21-04-19 ia shatranj piece_values diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 7429 W: 527 L: 446 D: 6456
 sprt @ 10+0.1 th 1 tweak piece values
20-04-19 ia shatranj tune_pv diff 
9151/10000 iterations
20000/20000 games played
 20000 @ 15+0.03 th 1 tune shatranj piece values. low A
18-04-19 ia shatranj tune_material diff 
9388/10000 iterations
20000/20000 games played
 20000 @ 15+0.03 th 1 tune second order material bonus
18-04-19 ia shatranj tune_pv diff 
9352/10000 iterations
20000/20000 games played
 20000 @ 15+0.03 th 1 tune shatranj piece values
15-04-19 ia shatranj 9ff23dfd922f0d2135e6e2f diff 
ELO: -1.56 +-7.3 (95%) LOS: 33.7%
Total: 2000 W: 223 L: 232 D: 1545
 2000 @ 10+0.1 th 1 measure Elo of passed pawn extension
06-04-19 ia shatranj tune_search diff 
4585/5000 iterations
10000/10000 games played
 10000 @ 15+0.03 th 1 tune search parameters (low A)
08-04-19 ia shatranj passed_pawn diff 
ELO: 6.25 +-6.4 (95%) LOS: 97.3%
Total: 2000 W: 194 L: 158 D: 1648
 2000 @ 30+0.3 th 1 tweak passed pawn evaluation. measure Elo
30-03-19 ia shatranj master diff 
ELO: -82.10 +-8.0 (95%) LOS: 0.0%
Total: 2000 W: 72 L: 536 D: 1392
 2000 @ 30+0.3 th 1 measure Elo against Shantraj-SF, being up to date with official SF
30-03-19 ia shatranj merge diff 
ELO: 4.34 +-7.4 (95%) LOS: 87.5%
Total: 2000 W: 248 L: 223 D: 1529
 2000 @ 10+0.1 th 1 regression test for upstream merges
04-03-19 ia shatranj nmp diff 
LLR: 5.68 (-2.94,2.94) [0.00,10.00]
Total: 22005 W: 2402 L: 2174 D: 17429
 sprt @ 10+0.1 th 1 tweak NMP depth
16-03-19 ia shatranj passed_pawn diff 
LLR: 15.68 (-2.94,2.94) [0.00,10.00]
Total: 15959 W: 1537 L: 1169 D: 13253
 sprt @ 30+0.3 th 1 tweak passed pawn evaluation. LTC
16-03-19 ia shatranj passed_pawn diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 4787 W: 590 L: 504 D: 3693
 sprt @ 10+0.1 th 1 tweak passed pawn evaluation
15-03-19 ia shatranj master diff 
ELO: -79.53 +-8.1 (95%) LOS: 0.0%
Total: 2000 W: 81 L: 531 D: 1388
 2000 @ 30+0.3 th 1 measure Elo against shatranj-SF
08-03-19 ia shatranj merge diff 
ELO: -15.99 +-7.1 (95%) LOS: 0.0%
Total: 2000 W: 172 L: 264 D: 1564
 2000 @ 10+0.1 th 1 regression test for upstream merge
05-03-19 ia shatranj shatranj_pv2 diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 918 W: 134 L: 71 D: 713
 sprt @ 30+0.3 th 1 tweak piece values
05-03-19 ia shatranj shatranj_pv2 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 980 W: 170 L: 104 D: 706
 sprt @ 10+0.1 th 1 tweak piece values
05-03-19 ia shatranj shatranj_pv diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 914 W: 145 L: 81 D: 688
 sprt @ 30+0.3 th 1 tweak piece values
04-03-19 ia shatranj shatranj_pv diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 774 W: 156 L: 89 D: 529
 sprt @ 10+0.1 th 1 tweak piece values
28-02-19 ia shatranj tune_danger diff 
4675/5000 iterations
10000/10000 games played
 10000 @ 15+0.03 th 1 tune king danger
28-02-19 ia shatranj tune_search diff 
4664/5000 iterations
10000/10000 games played
 10000 @ 15+0.03 th 1 tune search parameters
27-02-19 ia shatranj tune_pv diff 
9177/10000 iterations
20000/20000 games played
 20000 @ 15+0.03 th 1 tune piece values for shatranj
02-03-19 ia shatranj merge diff 
ELO: 7.30 +-7.0 (95%) LOS: 97.9%
Total: 2000 W: 235 L: 193 D: 1572
 2000 @ 10+0.1 th 1 regression test for upstream merge
27-02-19 ia shatranj tune_pv diff 
0/10000 iterations
27/20000 games played
 20000 @ 10+0.1 th 1 tune piece values for shatranj
27-02-19 ia shatranj tune_pv diff 
0/10000 iterations
168/20000 games played
 20000 @ 10+0.1 th 1 tune piece values for shatranj
23-02-19 ia shatranj merge diff 
ELO: 10.60 +-7.2 (95%) LOS: 99.8%
Total: 2000 W: 256 L: 195 D: 1549
 2000 @ 10+0.1 th 1 regression test for upstream merge
22-02-19 ia shatranj master diff 
ELO: -125.39 +-8.9 (95%) LOS: 0.0%
Total: 2000 W: 42 L: 734 D: 1224
 2000 @ 30+0.3 th 1 test against shatranj-SF
12-01-19 ia shatranj zh_danger diff 
LLR: -0.16 (-2.94,2.94) [-10.00,5.00]
Total: 4681 W: 451 L: 465 D: 3765
 sprt @ 30+0.3 th 1 tweak king danger
01-01-19 ia shatranj zh_danger diff 
LLR: 4.74 (-2.94,2.94) [-10.00,5.00]
Total: 7257 W: 914 L: 874 D: 5469
 sprt @ 10+0.1 th 1 tweak king danger
12-01-19 ia shatranj tune_danger diff 
1139/5000 iterations
10000/10000 games played
 10000 @ 10+0.1 th 1 tune king danger
11-01-19 ia shatranj master diff 
ELO: -18.95 +-7.7 (95%) LOS: 0.0%
Total: 2000 W: 205 L: 314 D: 1481
 2000 @ 10+0.1 th 1 regression test for fairy-SF
01-01-19 ia shatranj master diff 
ELO: -6.95 +-7.8 (95%) LOS: 4.0%
Total: 2000 W: 241 L: 281 D: 1478
 2000 @ 10+0.1 th 1 regression test for fairy-SF
01-01-19 ia shatranj fairy_psqt diff 
LLR: -2.96 (-2.94,2.94) [-10.00,5.00]
Total: 584 W: 46 L: 86 D: 452
 sprt @ 30+0.3 th 1 generic PSQT for fairy pieces
31-12-18 ia shatranj fairy_psqt diff 
LLR: -3.00 (-2.94,2.94) [-10.00,5.00]
Total: 1891 W: 242 L: 289 D: 1360
 sprt @ 10+0.1 th 1 generic PSQT for fairy pieces
22-12-18 ia shatranj master diff 
ELO: -327.94 +-15.7 (95%) LOS: 0.0%
Total: 2000 W: 29 L: 1503 D: 468
 2000 @ 30+0.3 th 1 test against shatranj-SF
15-12-18 ia shatranj zh_checks diff 
LLR: 3.01 (-2.94,2.94) [-10.00,5.00]
Total: 1535 W: 206 L: 171 D: 1158
 sprt @ 10+0.1 th 1 rewrite bonus for safe and unsafe checks
08-10-18 ia shatranj large_boards diff 
ELO: -5.21 +-10.3 (95%) LOS: 16.1%
Total: 1000 W: 107 L: 122 D: 771
 1000 @ 10+0.1 th 1 check generalization for large boards for regression
27-09-18 ia shatranj master diff 
ELO: -371.33 +-24.7 (95%) LOS: 0.0%
Total: 1000 W: 10 L: 799 D: 191
 1000 @ 10+0.1 th 1 measure elo after endgame eval change
23-09-18 ia shatranj shatranj_endgame diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 229 W: 76 L: 14 D: 139
 sprt @ 10+0.1 th 1 disable endgame evaluation
16-09-18 ia shatranj master diff 
ELO: -436.43 +-30.0 (95%) LOS: 0.0%
Total: 1000 W: 10 L: 860 D: 130
 1000 @ 10+0.1 th 1 measure elo difference to shatranj-stockfish
07-07-18 ia shatranj mobility_all2 diff 
ELO: -1.22 +-8.5 (95%) LOS: 39.0%
Total: 2000 W: 310 L: 317 D: 1373
 2000 @ 10+0.1 th 1 mobility bonus for fairy pieces
26-06-18 ia shatranj mobility_all diff 
ELO: 30.48 +-8.9 (95%) LOS: 100.0%
Total: 2000 W: 430 L: 255 D: 1315
 2000 @ 10+0.1 th 1 evaluate mobility for all piece types
26-06-18 ia shatranj passed_eval diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 82 W: 63 L: 1 D: 18
 sprt @ 10+0.1 th 1 scale passed pawn eval by promotion piece value
23-06-18 ia shatranj master diff 
ELO: -735.98 +-49.4 (95%) LOS: 0.0%
Total: 2000 W: 4 L: 1947 D: 49
 2000 @ 10+0.1 th 1 measure elo difference
10-04-18 ia shatranj queen_pair diff 
LLR: -2.95 (-2.94,2.94) [0.00,10.00]
Total: 18282 W: 868 L: 874 D: 16540
 sprt @ 30+0.3 th 1 replace bishop pair by queen pair bonus. LTC
09-04-18 ia shatranj queen_pair2 diff 
LLR: -2.97 (-2.94,2.94) [0.00,10.00]
Total: 14364 W: 669 L: 686 D: 13009
 sprt @ 30+0.3 th 1 queen pair. Take 2. LTC
07-04-18 ia shatranj queen_pair diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 16959 W: 1191 L: 1075 D: 14693
 sprt @ 10+0.1 th 1 replace bishop pair by queen pair bonus
07-04-18 ia shatranj queen_pair2 diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 9381 W: 690 L: 600 D: 8091
 sprt @ 10+0.1 th 1 queen pair. Take 2
30-03-18 ia shatranj no_bishop_pair diff 
LLR: -2.98 (-2.94,2.94) [0.00,10.00]
Total: 4428 W: 185 L: 228 D: 4015
 sprt @ 90+0.9 th 1 retry removing bonus for bishop pair. test scaling at VLTC. low priority
29-03-18 ia shatranj queen_pair diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 6395 W: 299 L: 231 D: 5865
 sprt @ 30+0.3 th 1 add bonus for queen pair. LTC