Capturing Frame-Like Object Descriptors in Human Augmented Mapping

Mohamadreza Faridghasemnia, Andrea Vanzo, Daniele Nardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The model of an environment plays a crucial role in autonomous mobile robots, by providing them with the necessary task-relevant information. As robots become more intelligent, they need a richer and more expressive environment model. This model is a map that contains a structured description of the environment that can be used as the robot’s knowledge for several tasks, such as planning and reasoning. In this work, we propose a framework that allows to capture important environment descriptors, such as functionality and ownership of the robot’s surrounding objects, through verbal interaction. Specifically, we propose a corpus of verbal descriptions annotated with frame-like structures. We use the proposed dataset to train two multi-task neural architectures. We compare the two architectures through an experimental evaluation, discussing the design choices. Finally, we describe the creation of a simple interactive interface with our system, implemented through the trained model. The novelties of this work are: (i) the definition of a new problem, i.e., addressing different object descriptors, that plays a crucial role for the robot’s tasks accomplishment; (ii) a specialized corpus to support the creation of rich Semantic Maps; (iii) the design of different neural architectures, and their experimental evaluation over the proposed dataset; (iv) a simple interface for the actual usage of the proposed resources.

Original languageEnglish
Title of host publicationAdvances in Artificial Intelligence
Subtitle of host publicationAI*IA 2019
EditorsMario Alviano, Gianluigi Greco, Francesco Scarcello
PublisherSpringer
Pages392-404
Number of pages13
ISBN (Electronic)9783030351663
ISBN (Print)9783030351656
DOIs
Publication statusPublished - 2019
Event18th International Conference of the Italian Association for Artificial Intelligence 2019 - Rende, Italy
Duration: 19 Nov 201922 Nov 2019

Publication series

NameLecture Notes in Computer Science
Volume11946
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference of the Italian Association for Artificial Intelligence 2019
Abbreviated titleAI*IA 2019
CountryItaly
CityRende
Period19/11/1922/11/19

Keywords

  • Corpus annotator
  • Human robot interaction
  • Natural Language understanding
  • Neural networks
  • Semantic mapping
  • Semantic mapping corpus

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Capturing Frame-Like Object Descriptors in Human Augmented Mapping'. Together they form a unique fingerprint.

  • Cite this

    Faridghasemnia, M., Vanzo, A., & Nardi, D. (2019). Capturing Frame-Like Object Descriptors in Human Augmented Mapping. In M. Alviano, G. Greco, & F. Scarcello (Eds.), Advances in Artificial Intelligence: AI*IA 2019 (pp. 392-404). (Lecture Notes in Computer Science; Vol. 11946). Springer. https://doi.org/10.1007/978-3-030-35166-3_28