This paper addresses the difficulty of adapting LLM agent behaviors to individual users without expensive fine-tuning. It proposes FABLE, a small, factorized policy model that sits outside the main agent to learn execution decisions from scalar feedback. FABLE separately optimizes memory retrieval, tool usage, and response style to tailor interactions.
- FABLE enables personalization of frozen, proprietary LLM agents without retraining the base model.
- It uses online learning from scalar feedback to adapt execution policies per user.
- The approach factorizes decisions into memory, information acquisition, and style layers.
- This method avoids the high cost of fine-tuning while improving user-specific relevance.