Outline

Ingegneria Sismica

Ingegneria Sismica

Intelligent Recognition and classification of UAV floating objects in Rivers and Lakes based on deep Learning

Author(s): Yin Zhang1, Weijia Han2, Liqun He2, Fei Chen2
1Shunjiangyuan Provincial Nature Reserve Management Center (Tangpu Reservoir Management Center), Shaoxing, 312000, Zhejiang, China
2Shaoxing Water Conservancy and Hydropower Survey and Design Institute Co., Ltd, Shaoxing, 312000, Zhejiang, China
Zhang, Yin. et al “Intelligent Recognition and classification of UAV floating objects in Rivers and Lakes based on deep Learning.” Ingegneria Sismica Volume 43 Issue 3: 1-23, doi:10.65102/is20261055.

Abstract

The detection of floating objects in rivers and lakes based on unmanned aerial vehicle (UAV) is the basis for automatic water surface monitoring and fine-grained environmental monitoring. Manual inspection and traditional image processing methods are limited by complex ripples, shore shadows, small target scales, and unstable imaging angles. This paper proposes a multi-source deep learning framework for intelligent recognition and classification of floating objects in UAV river patrol images. The proposed framework combines visible light images, multispectral cues, and spatial state encoding to enhance the boundary representation of floating objects against a reflected water background. The lightweight detection branch locates the suspected floating area, and the classification branch is used to distinguish the categories of floating objects such as plastic bottles, foam boards, branches and leaves, bags and algae. A dataset consisting of 18,420 UAV images and 73,600 annotated objects is constructed from different river, lake, and wetland scenes. Experimental results show that the model achieves 91.8% mAP, 94.2% classification accuracy, 92.7% F1-score, 42.6 FPS, and FLOPs of 15.6B, which supports stable river patrol deployment and online analysis tasks.

Keywords
Deep learning; Uav river patrol; Floating object recognition; Image classification

Related Articles

Zhihao Jiang1,2, Limi Chen1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Limi Chen1,2, Zhihao Jiang1,2, Jing Yang1
1Hainan Vocational University of Science and Technology, Haikou 571126, China
2Institute for Mathematical Research, Universiti Putra Malaysia, Serdang 43400, Malaysia
Hui Yuan1, Minjie Chai2, Siqing Xu1, Jinsong Li1, Jinwan Zheng1
1Electric Power Research Institute, State Grid Shanxi Electric Power Co., Ltd., Taiyuan, 030001, Shanxi, China
2Jincheng Power Supply Branch, State Grid Shanxi Electric Power Co., Ltd., Jincheng, 048000, Shanxi, China
Yanhan Zhu1,2
1China Academy of Cultural Heritage, Chaoyang District, 100029, Beijing, China
2Beijing University of Civil Engineering and Architecture, Xicheng District, 100044, Beijing, China
Ken Wang1, Jinhan Shu2, Kan Yuan1
1School of Digital Media, Shenzhen Polytechnic University, Shenzhen 518055, Guangdong, China
2Postdoctoral Mobile Station of Journalism and communication, Fudan University, Shanghai 200433, Shanghai, China