Network and state vector dimension changes #26
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Parent
#24 — PRD: Command abstraction layer for PPO action space
What to build
Mechanical dimension changes across the network and state vector modules to support the new 6-dim action space and 44-dim state input.
Network changes (in
network.nim):logStd: 5 → 6State vector changes (in
state_vector.nim):buildStateVectorneeds to accept these two values as parameters (they come from PPO_Bot at runtime)Training changes (in
training.nim):5references in log-prob computation anddLogP_dMeanallocation to6Acceptance criteria
actorForwardproduces 6-dim output tensorcriticForwardaccepts 44-dim input tensorlogStdis 6-dimensionalbuildStateVectorreturns 44-dim tensorcomputeLogProbworks with 6-dim actionsBlocked by
None — can start immediately
Implemented in commit c713585 on branch research/goto-controller.