End-to-end object detection and recognition in forward-looking sonar images with convolutional neural networks

Matias Valdenegro Toro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Object detection and recognition are typically stages that form part of the perception module of Autonomous Underwater Vehicles, used with different sensors such as Sonar and Optical imaging, but their design is usually separate and they are only combined at test time. In this work we present a convolutional neural network that does both object detection (through detection proposals) and recognition in Forward-Looking Sonar images and is trained with bounding boxes and class labels only. Convolutional layers are shared and a 128-element feature vector is shared between both tasks. After training we obtain 93% correct detections and 75% accuracy, but accuracy can be improved by fine- Tuning the classifier sub-network with the generated detection proposals. We evaluated fine- Tuning with a SVM classifier trained on the shared feature vector, increasing accuracy to 85%. Our detection proposal method can also detect unlabeled and untrained objects, and has good generalization performance. Our unified method can be used in any kind of sonar image, does not make assumptions about an object's shadow, and learns features directly from data.

Original languageEnglish
Title of host publication2016 IEEE/OES Autonomous Underwater Vehicles (AUV)
PublisherIEEE
Pages144-150
Number of pages7
ISBN (Electronic)9781509024421
DOIs
Publication statusPublished - 12 Dec 2016
Event2016 IEEE/OES Autonomous Underwater Vehicles - Tokyo, Japan
Duration: 6 Nov 20169 Nov 2016

Publication series

NameProceedings of the Symposium on Autonomous Underwater Vehicle Technology
PublisherIEEE
ISSN (Electronic)2377-6536

Conference

Conference2016 IEEE/OES Autonomous Underwater Vehicles
Abbreviated titleAUV 2016
CountryJapan
CityTokyo
Period6/11/169/11/16

ASJC Scopus subject areas

  • Oceanography
  • Automotive Engineering
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'End-to-end object detection and recognition in forward-looking sonar images with convolutional neural networks'. Together they form a unique fingerprint.

  • Cite this

    Valdenegro Toro, M. (2016). End-to-end object detection and recognition in forward-looking sonar images with convolutional neural networks. In 2016 IEEE/OES Autonomous Underwater Vehicles (AUV) (pp. 144-150). (Proceedings of the Symposium on Autonomous Underwater Vehicle Technology). IEEE. https://doi.org/10.1109/AUV.2016.7778662