Variant Stockfish Testing Queue

Filter: success_only = True

Finished - 2185 tests

20-09-17 ia giveaway fishnet-140917 diff 
ELO: 361.78 +-14.7 (95%) LOS: 100.0%
Total: 5000 W: 4369 L: 477 D: 154
 5000 @ 30+0.3 th 1 regression test fishnet-140917 vs fishnet-021116 using "giveaway-p4-f12.epd"
20-09-17 ia giveaway fishnet-140917 diff 
ELO: 427.37 +-16.7 (95%) LOS: 100.0%
Total: 5000 W: 4514 L: 301 D: 185
 5000 @ 30+0.3 th 1 regression test fishnet-140917 vs fishnet-021116 using "giveaway.epd"
19-09-17 ct crazyhouse fishnet-140917 diff 
ELO: 596.26 +-27.0 (95%) LOS: 100.0%
Total: 5000 W: 4825 L: 138 D: 37
 5000 @ 30+0.3 th 1 regression test fishnet-140917 vs fishnet-021116 using "crazyhouse-p4-f12.epd"
19-09-17 ia horde fishnet-140917 diff 
ELO: 19.83 +-15.1 (95%) LOS: 99.5%
Total: 2000 W: 1044 L: 930 D: 26
 2000 @ 30+0.3 th 1 regression test with "horde-p4-f12.epd"
19-09-17 ia crazyhouse fishnet-140917 diff 
ELO: 133.55 +-16.0 (95%) LOS: 100.0%
Total: 2000 W: 1329 L: 596 D: 75
 2000 @ 30+0.3 th 1 regression test using "crazyhouse-p4-f12.epd"
15-09-17 ia kingofthehill koth_space diff 
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 5761 W: 2274 L: 2257 D: 1230
 sprt @ 30+0.3 th 1 simplify SpaceThreshold. LTC
16-09-17 ct crazyhouse fishnet-140917 diff 
ELO: 606.26 +-27.7 (95%) LOS: 100.0%
Total: 5000 W: 4835 L: 131 D: 34
 5000 @ 30+0.3 th 1 estimated the uncertainty of adding up incremental regression test results (fishnet 021116 vs 140917)
16-09-17 ia atomic atomic_shelter2 diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 6208 W: 2000 L: 1849 D: 2359
 sprt @ 10+0.1 th 1 tweak ShelterWeakness
16-09-17 ia crazyhouse zh_shelter_storm diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 1761 W: 894 L: 771 D: 96
 sprt @ 30+0.3 th 1 shelter_storm in "endgame". LTC
16-09-17 ia crazyhouse zh_shelter_storm diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 1598 W: 818 L: 697 D: 83
 sprt @ 10+0.1 th 1 shelter_storm in "endgame"
15-09-17 ia 3check 3check_danger_limit2 diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 8707 W: 3902 L: 3902 D: 903
 sprt @ 10+0.1 th 1 simplify king danger limit
15-09-17 ia horde horde_passed diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 2181 W: 1144 L: 1011 D: 26
 sprt @ 30+0.3 th 1 tweak passed pawn evaluation. LTC
15-09-17 ia horde horde_passed diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1893 W: 1000 L: 871 D: 22
 sprt @ 10+0.1 th 1 tweak passed pawn evaluation
15-09-17 ia 3check 3check_shelter diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 2130 W: 1005 L: 882 D: 243
 sprt @ 30+0.3 th 1 tweak ShelterWeakness. LTC
15-09-17 ia 3check 3check_shelter diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 4214 W: 2001 L: 1846 D: 367
 sprt @ 10+0.1 th 1 tweak ShelterWeakness
14-09-17 ia horde fishnet-140917 diff 
ELO: 16.86 +-15.1 (95%) LOS: 98.6%
Total: 2000 W: 1036 L: 939 D: 25
 2000 @ 30+0.3 th 1 regression test
14-09-17 ia crazyhouse fishnet-140917 diff 
ELO: 120.87 +-15.7 (95%) LOS: 100.0%
Total: 2000 W: 1291 L: 622 D: 87
 2000 @ 30+0.3 th 1 regression test
14-09-17 ia standard fishnet-140917 diff 
ELO: 13.90 +-8.5 (95%) LOS: 99.9%
Total: 2000 W: 353 L: 273 D: 1374
 2000 @ 30+0.3 th 1 regression test
13-09-17 ia crazyhouse zh_null2 diff 
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 1505 W: 742 L: 687 D: 76
 sprt @ 30+0.3 th 1 simplify nmp. LTC
13-09-17 ia crazyhouse zh_null2 diff 
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 1763 W: 869 L: 816 D: 78
 sprt @ 10+0.1 th 1 simplify nmp
13-09-17 ia crazyhouse zh_shelter diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1014 W: 532 L: 421 D: 61
 sprt @ 30+0.3 th 1 tweak shelter weakness malus. rebased. LTC
12-09-17 ia crazyhouse zh_shelter diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 8232 W: 4061 L: 3844 D: 327
 sprt @ 10+0.1 th 1 tweak shelter weakness malus
12-09-17 ia crazyhouse zh_qsearch diff 
ELO: 67.91 +-21.6 (95%) LOS: 100.0%
Total: 1000 W: 582 L: 389 D: 29
 1000 @ 10+0.1 th 1 no drops in qsearch. test mate finding
11-09-17 ia crazyhouse zh_qsearch diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 668 W: 370 L: 263 D: 35
 sprt @ 60+0.6 th 1 no drops in qsearch. VLTC
11-09-17 ia crazyhouse zh_qsearch diff 
ELO: 65.38 +-15.2 (95%) LOS: 100.0%
Total: 2000 W: 1148 L: 776 D: 76
 2000 @ 10+0.1 th 1 try a massive change: no drops in qsearch
11-09-17 ia crazyhouse zh_qsearch diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 486 W: 285 L: 180 D: 21
 sprt @ 30+0.3 th 1 no drops in qsearch. LTC
11-09-17 ia crazyhouse zh_qsearch diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 481 W: 286 L: 180 D: 15
 sprt @ 10+0.1 th 1 no drops in qsearch. STC
10-09-17 ia 3check 3c_limit diff 
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 1864 W: 855 L: 806 D: 203
 sprt @ 30+0.3 th 1 fix evaluations above VALUE_INFINITE. LTC
10-09-17 ia 3check 3c_limit diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 4412 W: 2017 L: 1986 D: 409
 sprt @ 10+0.1 th 1 fix evaluations above VALUE_INFINITE
08-09-17 ia atomic atomic_pawn_attack diff 
LLR: 2.97 (-2.94,2.94) [0.00,10.00]
Total: 10400 W: 3272 L: 3071 D: 4057
 sprt @ 10+0.1 th 1 pawn attack weight
09-09-17 ia atomic atomic_movepick4 diff 
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 1963 W: 592 L: 555 D: 816
 sprt @ 30+0.3 th 1 simplify capture scoring. LTC
08-09-17 ia atomic atomic_movepick4 diff 
LLR: 2.96 (-2.94,2.94) [-10.00,5.00]
Total: 5637 W: 1764 L: 1749 D: 2124
 sprt @ 10+0.1 th 1 simplify capture scoring
03-09-17 ia horde horde_space3 diff 
ELO: 12.51 +-9.6 (95%) LOS: 99.5%
Total: 5000 W: 2558 L: 2378 D: 64
 5000 @ 30+0.3 th 1 skip space bonus. measure potential Elo gain
04-09-17 ia horde horde_pawns7 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 1939 W: 1020 L: 891 D: 28
 sprt @ 30+0.3 th 1 tweak pawn evaluation. LTC
04-09-17 ia horde horde_pawns7 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 15926 W: 8013 L: 7683 D: 230
 sprt @ 10+0.1 th 1 tweak pawn evaluation
02-09-17 ia giveaway anti_seed diff 
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 3070 W: 1077 L: 1044 D: 949
 sprt @ 10+0.1 th 1 zero seed
02-09-17 ia horde horde_space3 diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 626 W: 336 L: 274 D: 16
 sprt @ 30+0.3 th 1 skip space bonus. LTC
02-09-17 ia horde horde_space3 diff 
LLR: 2.97 (-2.94,2.94) [-10.00,5.00]
Total: 1756 W: 890 L: 835 D: 31
 sprt @ 10+0.1 th 1 skip space bonus
30-08-17 ia crazyhouse merge2 diff 
ELO: 97.39 +-9.8 (95%) LOS: 100.0%
Total: 5000 W: 3105 L: 1739 D: 156
 5000 @ 10+0.1 th 1 compare options for upstream merge
27-08-17 ia horde horde_fmc2 diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 5952 W: 3032 L: 2845 D: 75
 sprt @ 10+0.1 th 1 tweak fmc
26-08-17 ia giveaway anti_mp diff 
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 2721 W: 893 L: 859 D: 969
 sprt @ 30+0.3 th 1 simplify move ordering. LTC
25-08-17 ia giveaway anti_mp diff 
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 1420 W: 512 L: 469 D: 439
 sprt @ 10+0.1 th 1 simplify move ordering
23-08-17 ia crazyhouse zh_check diff 
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 47468 W: 23061 L: 22523 D: 1884
 sprt @ 10+0.1 th 1 test [0,5] bounds
22-08-17 ia giveaway anti_connected2 diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 5484 W: 1936 L: 1787 D: 1761
 sprt @ 10+0.1 th 1 no connected bonus in giveaway chess
22-08-17 ia atomic fishnet-200817 diff 
ELO: 14.95 +-11.3 (95%) LOS: 99.5%
Total: 2000 W: 596 L: 510 D: 894
 2000 @ 30+0.3 th 1 regression test
06-08-17 ia horde unsupported diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 49271 W: 24626 L: 23816 D: 829
 sprt @ 10+0.1 th 1 reitroduce unsupported pawn malus
06-08-17 ia giveaway unsupported diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 6916 W: 2260 L: 2099 D: 2557
 sprt @ 30+0.3 th 1 reitroduce unsupported pawn malus. LTC
06-08-17 ia losers unsupported diff 
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 5816 W: 2635 L: 2461 D: 720
 sprt @ 10+0.1 th 1 reitroduce unsupported pawn malus
05-08-17 ia horde horde_pawns diff 
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 9183 W: 4632 L: 4399 D: 152
 sprt @ 10+0.1 th 1 tweak pawn evaluation
06-08-17 ia giveaway unsupported diff 
LLR: 2.98 (-2.94,2.94) [0.00,10.00]
Total: 2652 W: 980 L: 866 D: 806
 sprt @ 10+0.1 th 1 reitroduce unsupported pawn malus