This arXiv paper explores memory strategies for spatial navigation in non-stationary environments with uncertain sensing in a foraging task. It compares simple to sophisticated agents, finding hybrid architectures with episodic memories and on-the-fly planning most efficient for exploration, search, and path optimization. Advanced agents substantially outperform minimal-memory ones as task difficulty increases, provided uncertainty is manageable.
Key Points
- 1.Foraging task features daily changes in barriers/food and limited location sensing.
- 2.Hybrid agents combine exploration/search strategies with memory-based planning on imperfect maps.
- 3.Non-stationary probability learning updates episodic memories for robust performance in harder scenarios.
Impact Analysis
Highlights need for multi-strategy RL agents in dynamic real-world robotics. Informs designs balancing memory use against uncertainty costs. Could improve efficiency in autonomous navigation systems.
Technical Details
Agent builds noisy, experience-limited maps from episodic memories. Uses planning for known food locations and simple heuristics for unknown ones. Tested across varying distances and change rates.