Adaptive Multi-Horizon RL: Engineering Tradeoffs of State-Dependent Gating and Fixed γ
A research team proposes a state-dependent gating network that lets an agent automatically weight different temporal perspectives during continual learning. Using Expected SARSA and TD-error optimization, the architecture maintained stable episode returns of 36–40 while switching between MiniGrid tasks, reducing the engineering overhead of manually choosing one discount factor. The key constraint is state-feature information density: the system must distinguish temporal structures.