# melee A/B session: common_libs/tests/fixtures/melee_bitbrain_ab
# arms: bb_learn, bb_ret, bb_round, pattern   reference: pattern
# commit=0f5cfe37b24952ae07fee0a7db526317ae127e6c binary_sha256=11bba2735413bc35ab3b61ead711c51d2223183ad9da510799bc7d76b99b22ca

ARM SUMMARY  (melee: score=server round score dmg+survival bonus)
arm        runs   wins/rd    score    surv  rank  meanrank score share  targets  tchanges
-----------------------------------------------------------------------------------------
bb_learn     16   112/112     2945    1050  1.00     1.000       60.2%     3.00     66.75
bb_ret       16   112/112     2903    1047  1.00     1.000       59.4%     3.00     68.06
bb_round     16   111/112     2998    1034  1.00     1.009       60.8%     3.00     68.75
pattern      16   109/112     2965    1031  1.00     1.000       59.5%     3.00     66.44

PER-RUN VALUES (never just the mean)
  bb_learn   wins:  r1=7 r10=7 r11=7 r12=7 r13=7 r14=7 r15=7 r16=7 r2=7 r3=7 r4=7 r5=7 r6=7 r7=7 r8=7 r9=7
             score: r1=2883 r10=2757 r11=2906 r12=3145 r13=2911 r14=3068 r15=2758 r16=2715 r2=3107 r3=2848 r4=3190 r5=2912 r6=2859 r7=3092 r8=2907 r9=3066
             surv:  r1=1050 r10=1050 r11=1050 r12=1050 r13=1050 r14=1050 r15=1050 r16=1050 r2=1050 r3=1050 r4=1050 r5=1050 r6=1050 r7=1050 r8=1050 r9=1050
             mrank: r1=1.00 r10=1.00 r11=1.00 r12=1.00 r13=1.00 r14=1.00 r15=1.00 r16=1.00 r2=1.00 r3=1.00 r4=1.00 r5=1.00 r6=1.00 r7=1.00 r8=1.00 r9=1.00
  bb_ret     wins:  r1=7 r10=7 r11=7 r12=7 r13=7 r14=7 r15=7 r16=7 r2=7 r3=7 r4=7 r5=7 r6=7 r7=7 r8=7 r9=7
             score: r1=2891 r10=2770 r11=2792 r12=2934 r13=2943 r14=2890 r15=2817 r16=2999 r2=2994 r3=2913 r4=2920 r5=2890 r6=3011 r7=2945 r8=2943 r9=2802
             surv:  r1=1050 r10=1050 r11=1050 r12=1050 r13=1050 r14=1050 r15=1050 r16=1050 r2=1050 r3=1050 r4=1050 r5=1000 r6=1050 r7=1050 r8=1050 r9=1050
             mrank: r1=1.00 r10=1.00 r11=1.00 r12=1.00 r13=1.00 r14=1.00 r15=1.00 r16=1.00 r2=1.00 r3=1.00 r4=1.00 r5=1.00 r6=1.00 r7=1.00 r8=1.00 r9=1.00
  bb_round   wins:  r1=7 r10=6 r11=7 r12=7 r13=7 r14=7 r15=7 r16=7 r2=7 r3=7 r4=7 r5=7 r6=7 r7=7 r8=7 r9=7
             score: r1=3040 r10=2944 r11=3125 r12=3110 r13=3037 r14=2993 r15=2985 r16=2842 r2=2835 r3=3045 r4=3180 r5=2952 r6=3126 r7=2927 r8=3021 r9=2804
             surv:  r1=1050 r10=900 r11=1050 r12=1050 r13=1050 r14=1050 r15=1050 r16=1050 r2=1050 r3=1050 r4=1050 r5=1050 r6=1050 r7=1050 r8=1050 r9=950
             mrank: r1=1.00 r10=1.14 r11=1.00 r12=1.00 r13=1.00 r14=1.00 r15=1.00 r16=1.00 r2=1.00 r3=1.00 r4=1.00 r5=1.00 r6=1.00 r7=1.00 r8=1.00 r9=1.00
  pattern    wins:  r1=7 r10=7 r11=7 r12=7 r13=7 r14=7 r15=7 r16=7 r2=7 r3=6 r4=7 r5=6 r6=7 r7=6 r8=7 r9=7
             score: r1=3082 r10=2795 r11=2897 r12=2915 r13=3176 r14=2922 r15=2860 r16=2878 r2=3261 r3=2957 r4=3106 r5=2869 r6=3194 r7=2728 r8=2869 r9=2931
             surv:  r1=1050 r10=1050 r11=1050 r12=1050 r13=1050 r14=950 r15=1050 r16=1050 r2=1050 r3=1000 r4=1050 r5=1050 r6=1050 r7=900 r8=1050 r9=1050
             mrank: r1=1.00 r10=1.00 r11=1.00 r12=1.00 r13=1.00 r14=1.00 r15=1.00 r16=1.00 r2=1.00 r3=1.00 r4=1.00 r5=1.00 r6=1.00 r7=1.00 r8=1.00 r9=1.00

PAIRWISE PERMUTATION TEST (per-run) + MANN-WHITNEY CROSS-CHECK
  perm: exact when C(n,na) <= 20,000,000; else Monte-Carlo 1,000,000 draws seed=0x5eed5eed
metric       A          B            diff(A-B)    perm p method            MW p     MW U
----------------------------------------------------------------------------------------
score        pattern    bb_learn      +19.7500    0.7117 MC/B=1,000,000    0.6109    114.0
score        pattern    bb_ret        +61.6250    0.1594 MC/B=1,000,000    0.5590    112.0
score        pattern    bb_round      -32.8750    0.4900 MC/B=1,000,000    0.3365    102.0
survival     pattern    bb_learn      -18.7500    0.2254 MC/B=1,000,000    0.0800    104.0
survival     pattern    bb_ret        -15.6250    0.3507 MC/B=1,000,000    0.2791    111.0
survival     pattern    bb_round       -3.1250    1.0000 MC/B=1,000,000    0.6982    121.0
wins         pattern    bb_learn       -0.1875    0.2251 MC/B=1,000,000    0.0795    104.0
wins         pattern    bb_ret         -0.1875    0.2251 MC/B=1,000,000    0.0795    104.0
wins         pattern    bb_round       -0.1250    0.5984 MC/B=1,000,000    0.3080    112.0
mean_rank    pattern    bb_learn       +0.0000    1.0000 MC/B=1,000,000    1.0000    128.0
mean_rank    pattern    bb_ret         +0.0000    1.0000 MC/B=1,000,000    1.0000    128.0
mean_rank    pattern    bb_round       -0.0089    1.0000 MC/B=1,000,000    0.3485    120.0
rank         pattern    bb_learn       +0.0000    1.0000 MC/B=1,000,000    1.0000    128.0
rank         pattern    bb_ret         +0.0000    1.0000 MC/B=1,000,000    1.0000    128.0
rank         pattern    bb_round       +0.0000    1.0000 MC/B=1,000,000    1.0000    128.0
score_share  pattern    bb_learn       -0.0071    0.5082 MC/B=1,000,000    0.6109    114.0
score_share  pattern    bb_ret         +0.0012    0.9046 MC/B=1,000,000    0.8653    123.0
score_share  pattern    bb_round       -0.0128    0.2908 MC/B=1,000,000    0.2662     98.0

MINIMUM DETECTABLE EFFECT (two-sample, alpha=0.05 two-sided, 80% power; MDE = 2.8016*sd*sqrt(2/n))
metric        n/arm   sd(ref)        MDE   ref mean
----------------------------------------------------
score            16    152.85     151.40   2965.000
survival         16     44.25      43.83   1031.250
wins             16      0.40       0.40      6.812
mean_rank        16      0.00       0.00      1.000

LIVENESS (per arm, from the bot's own boot report + log)
arm         rack_melee       mem  targets  tchanges  bb-reset   OK
bb_learn      BITBRAIN     decay     3.00     66.75     66.75  yes
bb_ret        BITBRAIN  retained     3.00     68.06     68.19  yes
bb_round      BITBRAIN  perRound     3.00     68.75     68.75  yes
pattern        PATTERN  perRound     3.00     66.44      0.00  yes

# machine-readable: common_libs/tests/fixtures/melee_bitbrain_ab/analysis.json
