gauntlet: BitBrain vs Pattern across 32 legacy opponents (does not generalize)
The repo's first multi-opponent gun measurement. Adds tools/ab/gauntlet_run.sh (per-opponent A/B over the legacy roster, subject = frozen ModularBot), tools/ab/gauntlet_analyze.py (paired per-opponent deltas, cross-opponent sign test, style split, MDE) and the arm/opponent fixtures. Result: BitBrain does NOT generalize beyond DrussGT. 32 opponents x 2 arms x 3 runs x 5 rounds = 192 battles / 960 rounds, 0 failed, 0 retries: damage/run 214.5 (pattern) vs 210.9 (bb), sign-flip p=0.53; round wins 237/480 vs 239/480, p=0.91. Sign test: bb better on 13/32 opponents (damage). The DrussGT-only penalty does not carry. The owner's 'killer vs regular movers' sub-claim is not supported: regular bucket +1.3 dmg/run vs dodgers -0.2 (MW p=0.85), and the measured movement predictability does not correlate with the delta.
This commit is contained in:
@@ -0,0 +1,42 @@
|
||||
# Opponents for the BitBrain-vs-Pattern generalization gauntlet.
|
||||
# Every entry is a validated legacy-champ bot dir from tools/robocode_shim/robots.json.
|
||||
# The trailing label is the MOVEMENT style (INFERRED from the bot's name/docs in
|
||||
# robots.json, not decompiled): regular = periodic/predictable/wall-following/
|
||||
# ramming, dodger = wave-surfing/adaptive evasion, other = mixed/unknown.
|
||||
#
|
||||
# regular: the owner's sub-claim ("killer vs spinners, wall-followers") lives here
|
||||
/tmp/tr_bots/WallAvoider | regular
|
||||
/tmp/tr_bots/HawkOnFire | regular
|
||||
/tmp/tr_bots/DiamondStealer| regular
|
||||
/tmp/tr_bots/BlitzBat | regular
|
||||
/tmp/tr_bots/PatternRobot | regular
|
||||
/tmp/tr_bots/FloodMini | regular
|
||||
/tmp/tr_bots/Aurora | regular
|
||||
# dodger: wave surfers / adaptive evasion
|
||||
/tmp/tr_bots/Diamond | dodger
|
||||
/tmp/tr_bots/Dookious | dodger
|
||||
/tmp/tr_bots/Lukious | dodger
|
||||
/tmp/tr_bots/GresSuffurd | dodger
|
||||
/tmp/tr_bots/KurtWaveSurfer| dodger
|
||||
/tmp/tr_bots/CassiusClay | dodger
|
||||
/tmp/tr_bots/WaveSurferGF | dodger
|
||||
/tmp/tr_bots/WaveSurferPG | dodger
|
||||
/tmp/tr_bots/Jen | dodger
|
||||
/tmp/tr_bots/Cigaret | dodger
|
||||
/tmp/tr_bots/CigaretBH | dodger
|
||||
/tmp/tr_bots/Komarious | dodger
|
||||
/tmp/tr_bots/LionWWSVMvoid | dodger
|
||||
/tmp/tr_bots/RougeDC | dodger
|
||||
/tmp/tr_bots/Aristocles | dodger
|
||||
# other: mixed / unknown movement
|
||||
/tmp/tr_bots/DrussGT | other
|
||||
/tmp/tr_bots/Shadow | other
|
||||
/tmp/tr_bots/Phoenix | other
|
||||
/tmp/tr_bots/Coriantumr | other
|
||||
/tmp/tr_bots/BrokenSword | other
|
||||
/tmp/tr_bots/TripHammer | other
|
||||
/tmp/tr_bots/RetroGirl | other
|
||||
/tmp/tr_bots/DiamondHawk | other
|
||||
/tmp/tr_bots/Ascendant | other
|
||||
/tmp/tr_bots/YersiniaPestis| other
|
||||
/tmp/tr_bots/LightningBug | other
|
||||
Reference in New Issue
Block a user