Reinforcement learning agents often fail to utilize small language models (SLMs) for assistance because vanilla uncertainty-gated approaches result in near-zero overwrite rates. This failure stems from insufficient egocentric context rather than a lack of model capacity. The proposed ASK+ method resolves this by providing SLMs with trajectory-aware context, such as partially revealed maps and visited positions, enabling meaningful reasoning and action guidance.
- Vanilla SLM guidance in RL fails due to context poverty, not model capacity.
- Egocentric prompts alone are insufficient for SLMs to reason effectively.
- ASK+ injects trajectory-aware context like maps and visit history.
- This approach significantly increases the SLM's contribution to agent actions.