Variant Stockfish Testing Queue

Filter: success_only = True

Finished - 2185 tests

23-01-21 ia giveaway nmp3 diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 3801 W: 1496 L: 1362 D: 943
sprt @ 10+0.1 th 1
22-01-21 ia 3check 3c_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 8971 W: 4250 L: 4026 D: 695
sprt @ 30+0.3 th 1
22-01-21 ia 3check 3c_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 9174 W: 4389 L: 4161 D: 624
sprt @ 10+0.1 th 1
21-01-21 ia racingkings race_pv diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 7351 W: 2363 L: 2198 D: 2790
sprt @ 10+0.1 th 1
21-01-21 ia racingkings race_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 6810 W: 1992 L: 1841 D: 2977
sprt @ 30+0.3 th 1
21-01-21 ia atomic atomic_pv2 diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 9223 W: 3259 L: 3061 D: 2903
sprt @ 30+0.3 th 1
20-01-21 ia atomic atomic_material diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 14756 W: 5451 L: 5175 D: 4130
sprt @ 10+0.1 th 1
20-01-21 ia atomic atomic_pv2 diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 9879 W: 3714 L: 3501 D: 2664
sprt @ 10+0.1 th 1
21-01-21 ia atomic atomic_material diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 3112 W: 1095 L: 978 D: 1039
sprt @ 30+0.3 th 1
20-01-21 dd 3check three-check-eval-no-nnu diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 847 W: 452 L: 343 D: 52
sprt @ 30+0.3 th 1 Reduce three-check piece values and attack bonuses (LTC)
20-01-21 dd 3check three-check-eval-no-nnu diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 478 W: 280 L: 175 D: 23
sprt @ 10+0.1 th 1 Reduce three-check piece values and attack bonuses
19-01-21 ia atomic atomic_danger2 diff
LLR: 2.94 (-2.94,2.94) [0.00,10.00]
Total: 7912 W: 2946 L: 2761 D: 2205
sprt @ 10+0.1 th 1
19-01-21 ia atomic atomic_no_check diff
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 2744 W: 1035 L: 999 D: 710
sprt @ 10+0.1 th 1 test interference of piece value changes
19-01-21 ia atomic atomic_no_check diff
LLR: 2.97 (-2.94,2.94) [-10.00,5.00]
Total: 913 W: 345 L: 298 D: 270
sprt @ 30+0.3 th 1 test interference of piece value changes
19-01-21 ia atomic atomic_pawn2 diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 961 W: 362 L: 273 D: 326
sprt @ 60+0.6 th 1
19-01-21 ia atomic atomic_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 864 W: 359 L: 267 D: 238
sprt @ 60+0.6 th 1 check scaling at VLTC
19-01-21 ia atomic atomic_danger diff
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 564 W: 247 L: 160 D: 157
sprt @ 60+0.6 th 1 take 5, check scaling at VLTC
19-01-21 ia atomic atomic_no_check~7 diff
ELO: 36.26 +-13.4 (95%) LOS: 100.0%
Total: 2000 W: 876 L: 668 D: 456
2000 @ 30+0.3 th 1 pawn value
19-01-21 ia atomic atomic_danger diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 13673 W: 5302 L: 5034 D: 3337
sprt @ 10+0.1 th 1 take 5
19-01-21 ia atomic atomic_pawn23 diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 11040 W: 4024 L: 3799 D: 3217
sprt @ 10+0.1 th 1
19-01-21 dd 3check lazy-threshold-no-nnue diff
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 3687 W: 1744 L: 1706 D: 237
sprt @ 10+0.1 th 1 Enable lazy evaluation for variants (rebased)
19-01-21 ia atomic atomic_danger diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 537 W: 237 L: 150 D: 150
sprt @ 60+0.6 th 1 take 2, VLTC
19-01-21 ia atomic atomic_danger diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 924 W: 382 L: 289 D: 253
sprt @ 30+0.3 th 1 take 5
19-01-21 ia atomic atomic_pawn2 diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1327 W: 500 L: 405 D: 422
sprt @ 30+0.3 th 1
19-01-21 ia atomic atomic_no_check~2 diff
ELO: 38.72 +-13.2 (95%) LOS: 100.0%
Total: 2000 W: 857 L: 635 D: 508
2000 @ 30+0.3 th 1 king safety 1
19-01-21 ia atomic atomic_pv diff
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 804 W: 340 L: 248 D: 216
sprt @ 30+0.3 th 1
19-01-21 ia atomic atomic_danger diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 376 W: 180 L: 95 D: 101
sprt @ 30+0.3 th 1 take 2
19-01-21 ia atomic atomic_pawn2 diff
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1473 W: 584 L: 484 D: 405
sprt @ 10+0.1 th 1
19-01-21 ia atomic atomic_danger diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 1314 W: 569 L: 466 D: 279
sprt @ 10+0.1 th 1 take 2
19-01-21 ia atomic atomic_pv diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1370 W: 586 L: 483 D: 301
sprt @ 10+0.1 th 1
18-01-21 ia atomic atomic_no_check~ diff
ELO: 54.11 +-13.0 (95%) LOS: 100.0%
Total: 2000 W: 876 L: 567 D: 557
2000 @ 30+0.3 th 1 king safety
18-01-21 ia atomic atomic_no_check diff
ELO: 28.90 +-12.4 (95%) LOS: 100.0%
Total: 2000 W: 745 L: 579 D: 676
2000 @ 30+0.3 th 1
18-01-21 ia atomic atomic_no_check~3 diff
ELO: 61.25 +-13.2 (95%) LOS: 100.0%
Total: 2000 W: 915 L: 566 D: 519
2000 @ 30+0.3 th 1
18-01-21 ia atomic atomic_no_check diff
ELO: 17.39 +-13.0 (95%) LOS: 99.6%
Total: 2000 W: 779 L: 679 D: 542
2000 @ 10+0.1 th 1
18-01-21 ia atomic atomic_no_check~ diff
ELO: 33.28 +-13.4 (95%) LOS: 100.0%
Total: 2000 W: 870 L: 679 D: 451
2000 @ 10+0.1 th 1 king safety
18-01-21 dd atomic no-nnue diff
ELO: 244.32 +-7.4 (95%) LOS: 100.0%
Total: 10000 W: 7212 L: 1148 D: 1640
10000 @ 10+0.1 th 1 Measure atomic regression
18-01-21 ia atomic atomic_no_check~7 diff
ELO: 30.30 +-13.5 (95%) LOS: 100.0%
Total: 2000 W: 870 L: 696 D: 434
2000 @ 10+0.1 th 1 pawn value
18-01-21 ia atomic atomic_no_check~3 diff
ELO: 55.36 +-13.4 (95%) LOS: 100.0%
Total: 2000 W: 916 L: 600 D: 484
2000 @ 10+0.1 th 1
18-01-21 ia atomic atomic_no_check~2 diff
ELO: 31.35 +-13.3 (95%) LOS: 100.0%
Total: 2000 W: 852 L: 672 D: 476
2000 @ 10+0.1 th 1 king safety 1
16-01-21 ia makruk see_pv diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 15734 W: 1231 L: 1113 D: 13390
sprt @ 10+0.1 th 1
18-01-21 ia atomic atomic_no_check diff
ELO: 302.70 +-25.8 (95%) LOS: 100.0%
Total: 1000 W: 781 L: 79 D: 140
1000 @ 30+0.3 th 1 test improvements of atomic implementation
18-01-21 ia atomic atomic_no_check diff
ELO: 282.31 +-25.4 (95%) LOS: 100.0%
Total: 1000 W: 770 L: 99 D: 131
1000 @ 10+0.1 th 1 test improvements of atomic implementation
17-01-21 dd atomic lazy-threshold-no-nnue diff
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 1141 W: 364 L: 322 D: 455
sprt @ 30+0.3 th 1 Sum variant-NNUE with (tuned) atomic bonuses
17-01-21 dd atomic lazy-threshold-no-nnue diff
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 3149 W: 1057 L: 1026 D: 1066
sprt @ 10+0.1 th 1 Sum variant-NNUE with (tuned) atomic bonuses
16-01-21 ia crazyhouse see_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 6698 W: 3333 L: 3137 D: 228
sprt @ 30+0.3 th 1
16-01-21 ia crazyhouse see_pv diff
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 1666 W: 870 L: 746 D: 50
sprt @ 10+0.1 th 1
16-01-21 dd atomic variant-bias-no-nnue diff
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 5228 W: 1792 L: 1774 D: 1662
sprt @ 10+0.1 th 1 Debias variant material evaluation
15-01-21 ia standard atomic_no_check diff
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 7561 W: 1666 L: 1659 D: 4236
sprt @ 10+0.1 th 1 performance regression test
14-01-21 ia losers variant_pv_all3 diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 8004 W: 3613 L: 3408 D: 983
sprt @ 10+0.1 th 1
14-01-21 ia crazyhouse variant_pv_all3 diff
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1698 W: 886 L: 762 D: 50
sprt @ 10+0.1 th 1