Path planning of multi-agent is much harder than single-agent. Reinforcement learning (RL) is a popular method for it. However, it cannot solve the path planning problem directly in unknown ...