Cooperative motion planning and control of a group of autonomous underwater vehicles using twin-delayed deep deterministic policy gradient
The cooperative execution of complex tasks can lead to desirable outcomes and increase the likelihood of mission success. Nevertheless, coordinating the movements of multiple autonomous underwater vehicles (AUVs) in a collaborative manner is challenging due to nonlinear dynamics and environmental disturbances. The paper presents a decentralized deep reinforcement learning algorithm for AUVs that enables cooperative motion planning and obstacle avoidance. The goal is to formulate control policies for AUVs, empowering each vehicle to create its optimal collision-free path through adjustments in speed and heading. To ensure safe navigation of multiple AUVs, COLlision AVoidance (COLAV) plays a crucial role. Therefore, the implementation of a multi-layer region control strategy enhances the AUVs’ responsiveness to nearby obstacles, leading to improved COLAV. Furthermore, a reward function is formulated to consider four criteria: path planning, obstacle- and self-COLAV, as well as feasible control signals, with the aim of strengthening the proposed strategy. Notably, the devised scheme demonstrates robustness against disturbances A comparative study is conducted with the well-established Artificial Potential Field (APF) planning method. The simulation results indicate that the proposed system effectively and safely guides the AUVs to their goals and exhibits desirable generalizability.
Item Type | Article |
---|---|
Additional information | © 2024 Elsevier Ltd. All rights reserved. This is the accepted manuscript version of an article which has been published in final form at https://doi.org/10.1016/j.apor.2024.103977 |
Keywords | multi-auvs, motion planning, obstacle avoidance, ocean current, deep reinforcement learning, ocean engineering |
Date Deposited | 15 May 2025 15:33 |
Last Modified | 31 May 2025 00:43 |
-
picture_as_pdf - Paper_5_PS_1_.pdf
-
subject - Submitted Version
-
lock_clock - Restricted to Repository staff only until 10 April 2026
-
- Available under Creative Commons: BY-NC-ND 4.0