Physics Maths Engineering

Adaptive Path Planning for Subsurface Plume Tracing with an Autonomous Underwater Vehicle

  Peer Reviewed

Abstract

Key Questions

1. What challenges do autonomous underwater vehicles (AUVs) address in plume tracing?

AUVs provide autonomous, efficient, and adaptive solutions for tracing subsurface plumes in hostile or inaccessible marine environments.

2. What is the advantage of using Double Deep Q-Network (DDQN) for path planning?

DDQN-based path planning allows AUVs to adaptively learn and optimize their survey paths, outperforming traditional methods like lawnmower patterns in efficiency and adaptability.

3. How does the proposed method compare to traditional survey patterns?

The DDQN approach demonstrated superior performance in numerical simulations, enabling faster and more precise plume source detection compared to the lawnmower strategy.

4. What are the implications for large-scale marine exploration?

The findings suggest that reinforcement learning-based adaptive path planning can significantly enhance the effectiveness of AUVs in large-scale environmental monitoring and exploration.

Abstract

Background

Oil spills in marine environments cause severe ecological and economic damage. Subsurface plume tracing is critical for understanding oil movement and its environmental impact. Autonomous underwater vehicles (AUVs) are emerging as pivotal tools for addressing these challenges.

Methods

This study presents an adaptive path planning approach using the Double Deep Q-Network (DDQN) algorithm. The plume tracing problem is modeled as a Markov Decision Process (MDP), enabling AUVs to iteratively learn optimal survey paths through reinforcement learning.

Results

The proposed method was validated through numerical simulations and real-world experiments. Results indicated that DDQN outperformed traditional strategies, such as the lawnmower pattern, in efficiency and plume source detection accuracy.

Conclusions

Reinforcement learning-based path planning is a promising solution for adaptive plume tracing. Future work will focus on enhancing AUV capabilities for multi-agent systems and complex marine environments.