Reasoning on Grasp-Action Affordances

Paola Ardon, Èric Pairet, Ronald Petrick, Subramanian Ramamoorthy, Katrin Lohan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Artificial intelligence is essential to succeed in challenging activities that involve dynamic environments, such as object manipulation tasks in indoor scenes. Most of the state-of-the-art literature explores robotic grasping methods by focusing exclusively on attributes of the target object. When it comes to human perceptual learning approaches, these physical qualities are not only inferred from the object, but also from the characteristics of the surroundings. This work proposes a method that includes environmental context to reason on an object affordance to then deduce its grasping regions. This affordance is reasoned using a ranked association of visual semantic attributes harvested in a knowledge base graph representation. The framework is assessed using standard learning evaluation metrics and the zero-shot affordance prediction scenario. The resulting grasping areas are compared with unseen labelled data to asses their accuracy matching percentage. The outcome of this evaluation suggest the autonomy capabilities of the proposed method for object interaction applications in indoor environments.
Original languageEnglish
Title of host publicationTowards Autonomous Robotic Systems. TAROS 2019
EditorsKaspar Althoefer, Jelizaveta Konstantinova, Ketao Zhang
PublisherSpringer
Chapter1
Pages3-15
Number of pages13
ISBN (Electronic)9783030238070
ISBN (Print)9783030238063
DOIs
Publication statusPublished - 28 Jun 2019
Event20th Towards Autonomous Robotic Systems Conference 2019 - London, United Kingdom
Duration: 3 Jul 20195 Jul 2019

Publication series

NameLecture Notes in Computer Science
Volume11649
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th Towards Autonomous Robotic Systems Conference 2019
Abbreviated titleTAROS 2019
Country/TerritoryUnited Kingdom
CityLondon
Period3/07/195/07/19

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Reasoning on Grasp-Action Affordances'. Together they form a unique fingerprint.

Cite this