A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs

David Robb, Jonatan Scharff Willners, Nicolas Valeyrie, Francisco Javier Chiyah Garcia, Atanas Laskov, Xingkun Liu, Pedro Patron, Helen Hastie, Yvan Petillot

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Autonomous underwater vehicles (AUVs) are being tasked with increasingly complex missions. The acoustic communications required for AUVs are, by the nature of the medium, low bandwidth while adverse environmental conditions underwater often mean they are also intermittent. This has motivated development of highly autonomous systems, which can operate independently of their operators for considerable periods of time. These missions often involve multiple vehicles leading not only to challenges in communications but also in command and control (C2). Specifically operators face complexity in controlling multi-objective, multi-vehicle missions, whilst simultaneously facing uncertainty over the current status and safety of several remote high value assets. Additionally, it may be required to perform command and control of these complex missions in a remote control room. In this paper, we propose a combination of an intuitive, natural language operator interface combined with communications that use platforms from multiple domains to relay data over different mediums and transmission modes, improving command and control of collaborative and fully autonomous missions. In trials, we have demonstrated an integrated system combining working prototypes with established commercial C2 software that enables the use of a natural language interface to monitor an AUV survey mission in an on-shore command and control centre.
Original languageEnglish
Title of host publication2018 IEEE OES Autonomous Underwater Vehicle Symposium
PublisherIEEE
Publication statusAccepted/In press - 5 Nov 2018
Event2018 IEEE OES Autonomous Underwater Vehicle Symposium - Rectory Building, University of Porto, Porto, Portugal
Duration: 6 Nov 20189 Nov 2018
https://auv2018.lsts.pt/

Conference

Conference2018 IEEE OES Autonomous Underwater Vehicle Symposium
Abbreviated titleAUV2018
CountryPortugal
CityPorto
Period6/11/189/11/18
Internet address

Fingerprint

Autonomous underwater vehicles
Acoustics
Communication
Remote control
Bandwidth

Keywords

  • Conversational agent
  • Natural Language Understanding
  • Chatbot
  • AUV
  • USV
  • Communication Relay
  • Acoustic
  • Communication

Cite this

Robb, D., Scharff Willners, J., Valeyrie, N., Garcia, F. J. C., Laskov, A., Liu, X., ... Petillot, Y. (Accepted/In press). A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. In 2018 IEEE OES Autonomous Underwater Vehicle Symposium IEEE.
Robb, David ; Scharff Willners, Jonatan ; Valeyrie, Nicolas ; Garcia, Francisco Javier Chiyah ; Laskov, Atanas ; Liu, Xingkun ; Patron, Pedro ; Hastie, Helen ; Petillot, Yvan. / A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. 2018 IEEE OES Autonomous Underwater Vehicle Symposium. IEEE, 2018.
@inproceedings{a78e825d54ab46e99097d0c4876c3fab,
title = "A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs",
abstract = "Autonomous underwater vehicles (AUVs) are being tasked with increasingly complex missions. The acoustic communications required for AUVs are, by the nature of the medium, low bandwidth while adverse environmental conditions underwater often mean they are also intermittent. This has motivated development of highly autonomous systems, which can operate independently of their operators for considerable periods of time. These missions often involve multiple vehicles leading not only to challenges in communications but also in command and control (C2). Specifically operators face complexity in controlling multi-objective, multi-vehicle missions, whilst simultaneously facing uncertainty over the current status and safety of several remote high value assets. Additionally, it may be required to perform command and control of these complex missions in a remote control room. In this paper, we propose a combination of an intuitive, natural language operator interface combined with communications that use platforms from multiple domains to relay data over different mediums and transmission modes, improving command and control of collaborative and fully autonomous missions. In trials, we have demonstrated an integrated system combining working prototypes with established commercial C2 software that enables the use of a natural language interface to monitor an AUV survey mission in an on-shore command and control centre.",
keywords = "Conversational agent, Natural Language Understanding, Chatbot, AUV, USV, Communication Relay, Acoustic, Communication",
author = "David Robb and {Scharff Willners}, Jonatan and Nicolas Valeyrie and Garcia, {Francisco Javier Chiyah} and Atanas Laskov and Xingkun Liu and Pedro Patron and Helen Hastie and Yvan Petillot",
year = "2018",
month = "11",
day = "5",
language = "English",
booktitle = "2018 IEEE OES Autonomous Underwater Vehicle Symposium",
publisher = "IEEE",
address = "United States",

}

Robb, D, Scharff Willners, J, Valeyrie, N, Garcia, FJC, Laskov, A, Liu, X, Patron, P, Hastie, H & Petillot, Y 2018, A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. in 2018 IEEE OES Autonomous Underwater Vehicle Symposium. IEEE, 2018 IEEE OES Autonomous Underwater Vehicle Symposium, Porto, Portugal, 6/11/18.

A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. / Robb, David; Scharff Willners, Jonatan; Valeyrie, Nicolas; Garcia, Francisco Javier Chiyah; Laskov, Atanas ; Liu, Xingkun; Patron, Pedro; Hastie, Helen; Petillot, Yvan.

2018 IEEE OES Autonomous Underwater Vehicle Symposium. IEEE, 2018.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs

AU - Robb, David

AU - Scharff Willners, Jonatan

AU - Valeyrie, Nicolas

AU - Garcia, Francisco Javier Chiyah

AU - Laskov, Atanas

AU - Liu, Xingkun

AU - Patron, Pedro

AU - Hastie, Helen

AU - Petillot, Yvan

PY - 2018/11/5

Y1 - 2018/11/5

N2 - Autonomous underwater vehicles (AUVs) are being tasked with increasingly complex missions. The acoustic communications required for AUVs are, by the nature of the medium, low bandwidth while adverse environmental conditions underwater often mean they are also intermittent. This has motivated development of highly autonomous systems, which can operate independently of their operators for considerable periods of time. These missions often involve multiple vehicles leading not only to challenges in communications but also in command and control (C2). Specifically operators face complexity in controlling multi-objective, multi-vehicle missions, whilst simultaneously facing uncertainty over the current status and safety of several remote high value assets. Additionally, it may be required to perform command and control of these complex missions in a remote control room. In this paper, we propose a combination of an intuitive, natural language operator interface combined with communications that use platforms from multiple domains to relay data over different mediums and transmission modes, improving command and control of collaborative and fully autonomous missions. In trials, we have demonstrated an integrated system combining working prototypes with established commercial C2 software that enables the use of a natural language interface to monitor an AUV survey mission in an on-shore command and control centre.

AB - Autonomous underwater vehicles (AUVs) are being tasked with increasingly complex missions. The acoustic communications required for AUVs are, by the nature of the medium, low bandwidth while adverse environmental conditions underwater often mean they are also intermittent. This has motivated development of highly autonomous systems, which can operate independently of their operators for considerable periods of time. These missions often involve multiple vehicles leading not only to challenges in communications but also in command and control (C2). Specifically operators face complexity in controlling multi-objective, multi-vehicle missions, whilst simultaneously facing uncertainty over the current status and safety of several remote high value assets. Additionally, it may be required to perform command and control of these complex missions in a remote control room. In this paper, we propose a combination of an intuitive, natural language operator interface combined with communications that use platforms from multiple domains to relay data over different mediums and transmission modes, improving command and control of collaborative and fully autonomous missions. In trials, we have demonstrated an integrated system combining working prototypes with established commercial C2 software that enables the use of a natural language interface to monitor an AUV survey mission in an on-shore command and control centre.

KW - Conversational agent

KW - Natural Language Understanding

KW - Chatbot

KW - AUV

KW - USV

KW - Communication Relay

KW - Acoustic

KW - Communication

M3 - Conference contribution

BT - 2018 IEEE OES Autonomous Underwater Vehicle Symposium

PB - IEEE

ER -

Robb D, Scharff Willners J, Valeyrie N, Garcia FJC, Laskov A, Liu X et al. A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. In 2018 IEEE OES Autonomous Underwater Vehicle Symposium. IEEE. 2018