Boat Detection in Marina Using Time-Delay Analysis and Deep Learning

Boat Detection in Marina Using Time-Delay Analysis and Deep Learning

Romane Scherrer, Erwan Aulnette, Thomas Quiniou, Joël Kasarherou, Pierre Kolb, Nazha Selmaoui-Folcher
Copyright: © 2022 |Pages: 16
DOI: 10.4018/IJDWM.298006
Article PDF Download
Open access articles are freely available for download

Abstract

An autonomous acoustic system based on two bottom-moored hydrophones, a two-input audio board and a small single-board computer was installed at the entrance of a marina to detect entering/exiting boat. Windowed time lagged cross-correlations are calculated by the system to find the consecutive time delays between the hydrophone signals and to compute a signal which is a function of the boats' angular trajectories. Since its installation, the single-board computer performs online prediction with a signal processing-based algorithm which achieved an accuracy of 80 %. To improve system performance, a convolutional neural network (CNN) is trained with the acquired data to perform real-time detection. Two classification tasks were considered (binary and multiclass) to both detect a boat and its direction of navigation. Finally, a trained CNN was implemented in a single-board computer to ensure that prediction can be performed in real time.
Article Preview
Top

Introduction

Since the invention of sonar, a growing interest was given to underwater sounds that radiated from boats. Although the first applications were related to military purposes, several studies aim at using the underwater sounds for non-military uses, such as maritime traffic management (Fillinger, 2009; Zwemer, 2018), underwater surveillance (Fillinger et al., 2010), assessment of the impact of noise pollution on marine life (Codarin, 2009; Holles, 2013), among others.

Since the acoustic signal produced by a ship has many sources (propeller, machinery, hydrodynamic, vibrations, etc.) that produced tones at different frequencies, most developed methods to detect, classify or track boats are applied in the frequency domain or time-frequency domain. Several approaches were developed to detect the harmonic frequencies in the signals and to extract the acoustic signature of the ships. In many cases, these methods are based on the spectrum (Guo et al., 2020), DEMON spectrum (Chung et al., 2011) and Cepstrum (Das, 2013; Santos-Domínguez, 2016) and the automatic detection is usually performed by detecting the peaks with a threshold (Reis et al., 2019).

In recent years, deep neural networks have seen a lot of successful applications in many different domains. One successful deep learning architecture used in computer vision is a convolutional neural network (CNN). This architecture is known to automatically learn complex feature representations using its convolutional layers and has led to impressive results in many problems such as in image classification (Krizhevsky et al., 2012), speech recognition (Palaz et al., 2015) or time series classification (Cui, 2016; Guennec, 2016; Zhao, 2017). More recently, several studies (Li, 2019; Yamaguchi, 2019) aimed at detecting boats have used machine learning methods, which have the advantage of automatically extracting characteristic attributes to classify the data. These methods are often more robust to noise and do not require hand designed features. However, all the proposed methods performed the detection on a 2D-signal in the frequency domain of the recorded sound. In this article, the researchers aimed to show than the detection itself can be performed with a simpler 1D signal that does not required the computation of the spectrum or the use of a 2 dimensional CNN. With a 1D signal, the detection can be performed with a time series classifier.

Complete Article List

Search this Journal:
Reset
Volume 20: 1 Issue (2024)
Volume 19: 6 Issues (2023)
Volume 18: 4 Issues (2022): 2 Released, 2 Forthcoming
Volume 17: 4 Issues (2021)
Volume 16: 4 Issues (2020)
Volume 15: 4 Issues (2019)
Volume 14: 4 Issues (2018)
Volume 13: 4 Issues (2017)
Volume 12: 4 Issues (2016)
Volume 11: 4 Issues (2015)
Volume 10: 4 Issues (2014)
Volume 9: 4 Issues (2013)
Volume 8: 4 Issues (2012)
Volume 7: 4 Issues (2011)
Volume 6: 4 Issues (2010)
Volume 5: 4 Issues (2009)
Volume 4: 4 Issues (2008)
Volume 3: 4 Issues (2007)
Volume 2: 4 Issues (2006)
Volume 1: 4 Issues (2005)
View Complete Journal Contents Listing