Variant Stockfish Testing Queue

Filter: success_only = True

Finished - 2185 tests

28-11-20 ia seirawan gating_see diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 8045 W: 2705 L: 2527 D: 2813
 sprt @ 30+0.3 th 1 rebased
29-11-20 ia racingkings attackers_to diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1962 W: 689 L: 588 D: 685
 sprt @ 10+0.1 th 1 measure speed-up
29-11-20 ia crazyhouse attackers_to diff 
LLR: 3.64 (-2.94,2.94) [0.00,10.00]
Total: 814 W: 457 L: 324 D: 33
 sprt @ 10+0.1 th 1 measure speed-up
30-11-20 dd kingofthehill lazy-threshold-no-nnue diff 
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 953 W: 416 L: 364 D: 173
 sprt @ 10+0.1 th 1 Enable lazy evaluation for variants
29-11-20 ia standard attackers_to diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 999 W: 278 L: 200 D: 521
 sprt @ 10+0.1 th 1 measure speed-up
28-11-20 ia giveaway anti_cache diff 
LLR: 2.94 (-2.94,2.94) [0.00,10.00]
Total: 1873 W: 743 L: 637 D: 493
 sprt @ 10+0.1 th 1 speedup using caching
28-11-20 ia losers anti_cache diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1194 W: 577 L: 469 D: 148
 sprt @ 10+0.1 th 1 speedup using caching
27-11-20 dd crazyhouse zh-king-safety-no-nnue diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 919 W: 478 L: 418 D: 23
 sprt @ 30+0.3 th 1 Simplify crazyhouse king safety evaluation (LTC)
24-11-20 ia seirawan gating_see diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 3037 W: 1102 L: 984 D: 951
 sprt @ 10+0.1 th 1 rebased
11-09-20 ia horde king_pawn_rank_s diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 9385 W: 4771 L: 4534 D: 80
 sprt @ 10+0.1 th 1
25-11-20 dd crazyhouse zh-king-safety-no-nnue diff 
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 877 W: 458 L: 397 D: 22
 sprt @ 10+0.1 th 1 Simplify crazyhouse king safety evaluation
16-11-20 dd standard no-nnue diff 
ELO: 14.91 +-4.7 (95%) LOS: 100.0%
Total: 10000 W: 2564 L: 2135 D: 5301
 10000 @ 10+0.1 th 1 Regression test no-NNUE versus SF 11
25-10-20 ia giveaway horde_space3 diff 
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 13265 W: 4950 L: 4984 D: 3331
 sprt @ 10+0.1 th 1
19-11-20 dd atomic atomic-king-danger-no-n diff 
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 3614 W: 1187 L: 1159 D: 1268
 sprt @ 10+0.1 th 1 Remove cap for atomic king danger
20-11-20 ia seirawan gating_see diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 3868 W: 1310 L: 1185 D: 1373
 sprt @ 30+0.3 th 1
21-11-20 ia seirawan gating_see_min diff 
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 1483 W: 494 L: 453 D: 536
 sprt @ 30+0.3 th 1
20-11-20 ia seirawan gating_see diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1125 W: 437 L: 344 D: 344
 sprt @ 10+0.1 th 1
15-11-20 ia horde master diff 
ELO: 118.33 +-22.7 (95%) LOS: 100.0%
Total: 1000 W: 660 L: 332 D: 8
 1000 @ 10+0.1 th 1 regression test
07-11-20 ia standard nnue diff 
ELO: 262.83 +-20.4 (95%) LOS: 100.0%
Total: 1000 W: 680 L: 41 D: 279
 1000 @ 10+0.1 th 1 test NNUE against classical
16-10-20 ia giveaway anti_lmr diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 13481 W: 5116 L: 4854 D: 3511
 sprt @ 10+0.1 th 1
03-11-20 dd atomic atomic-see-no-nnue diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 92 W: 60 L: 10 D: 22
 sprt @ 30+0.3 th 1 Atomic alternate moves in SEE (LTC)
03-11-20 dd atomic atomic-see-no-nnue diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 73 W: 55 L: 5 D: 13
 sprt @ 10+0.1 th 1 Atomic alternate moves in SEE
23-10-20 ia horde master diff 
ELO: 90.59 +-22.2 (95%) LOS: 100.0%
Total: 1000 W: 623 L: 368 D: 9
 1000 @ 10+0.1 th 1 regression test
25-10-20 ia horde horde_space3 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 969 W: 540 L: 424 D: 5
 sprt @ 30+0.3 th 1
25-10-20 ia horde horde_space3 diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 464 W: 283 L: 175 D: 6
 sprt @ 10+0.1 th 1
23-10-20 ia horde horde_eval diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 3220 W: 1671 L: 1523 D: 26
 sprt @ 30+0.3 th 1
23-10-20 ia horde horde_eval diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 5975 W: 3049 L: 2861 D: 65
 sprt @ 10+0.1 th 1
22-10-20 ia shatranj revert_nmp diff 
LLR: 3.53 (-2.94,2.94) [0.00,10.00]
Total: 1293 W: 134 L: 63 D: 1096
 sprt @ 30+0.3 th 1
23-10-20 ia makruk revert_nmp diff 
LLR: 2.99 (-2.94,2.94) [0.00,10.00]
Total: 1277 W: 108 L: 49 D: 1120
 sprt @ 30+0.3 th 1
23-10-20 ia giveaway revert_nmp2 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1092 W: 430 L: 337 D: 325
 sprt @ 30+0.3 th 1
23-10-20 ia giveaway revert_nmp2 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1259 W: 523 L: 424 D: 312
 sprt @ 10+0.1 th 1
21-10-20 ia losalamos revert_nmp diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 2926 W: 731 L: 634 D: 1561
 sprt @ 10+0.1 th 1
22-10-20 ia losers master diff 
ELO: 53.58 +-21.0 (95%) LOS: 100.0%
Total: 1000 W: 540 L: 387 D: 73
 1000 @ 30+0.3 th 1 vs. MV-SF
21-10-20 ia giveaway master diff 
ELO: 106.39 +-20.5 (95%) LOS: 100.0%
Total: 1000 W: 570 L: 273 D: 157
 1000 @ 30+0.3 th 1 vs. MV-SF
20-10-20 ia makruk revert_nmp diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 1864 W: 182 L: 118 D: 1564
 sprt @ 10+0.1 th 1
22-10-20 ia horde horde_breakthrough diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 644 W: 375 L: 264 D: 5
 sprt @ 30+0.3 th 1
22-10-20 ia horde horde_imbalance diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 592 W: 347 L: 237 D: 8
 sprt @ 30+0.3 th 1
22-10-20 ia horde horde_breakthrough diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 783 W: 443 L: 330 D: 10
 sprt @ 10+0.1 th 1
22-10-20 ia horde horde_imbalance diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 570 W: 337 L: 227 D: 6
 sprt @ 10+0.1 th 1
19-10-20 ia shatranj revert_nmp diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1688 W: 195 L: 130 D: 1363
 sprt @ 10+0.1 th 1
04-09-20 ia minishogi shogi_promoted2 diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 28515 W: 14514 L: 14001 D: 0
 sprt @ 10+0.1 th 1
02-10-20 ia shogi leaper_checks_l diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 8240 W: 4203 L: 3982 D: 55
 sprt @ 30+0.3 th 1
18-09-20 ia shogi shogi_mobility diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 17489 W: 8874 L: 8520 D: 95
 sprt @ 30+0.3 th 1
19-09-20 ia shogi shogi_promoted2 diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 14354 W: 7294 L: 6985 D: 75
 sprt @ 30+0.3 th 1
16-09-20 ia shogi shogi_mobility diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 10872 W: 5545 L: 5286 D: 41
 sprt @ 10+0.1 th 1
13-09-20 ia makruk kssk diff 
LLR: 2.97 (-2.94,2.94) [-10.00,5.00]
Total: 12891 W: 944 L: 932 D: 11015
 sprt @ 10+0.1 th 1
22-09-20 ia makruk fers_endgame diff 
LLR: 2.94 (-2.94,2.94) [0.00,10.00]
Total: 6417 W: 472 L: 394 D: 5551
 sprt @ 10+0.1 th 1
22-09-20 ia capablanca largeboards diff 
ELO: 39.78 +-18.7 (95%) LOS: 100.0%
Total: 1000 W: 433 L: 319 D: 248
 1000 @ 30+0.3 th 1 11.2 RC2 vs. 11.1
22-09-20 ia pocketknight master diff 
ELO: 17.39 +-16.3 (95%) LOS: 98.2%
Total: 1000 W: 311 L: 261 D: 428
 1000 @ 30+0.3 th 1 11.2 RC1 vs. 11.1
21-09-20 ia sittuyin master diff 
ELO: 114.07 +-11.7 (95%) LOS: 100.0%
Total: 1000 W: 328 L: 11 D: 661
 1000 @ 30+0.3 th 1 11.2 RC1 vs. 11.1