The MuMMER project: Engaging human-robot interaction in real-world public spaces

Mary Ellen Foster*, Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, Jean Marc Odobez, Amit Kumar Pandey

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

52 Citations (Scopus)


MuMMER (MultiModal Mall Entertainment robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank robotics’ Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, social-signal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.

Original languageEnglish
Title of host publicationroceedings of the Eighth International Conference on Social Robotics (ICSR 2016), Kansas City, USA, 01-03 Nov 2016
Number of pages11
ISBN (Electronic)9783319474373
ISBN (Print)9783319474366
Publication statusE-pub ahead of print - 7 Oct 2016
Event8th International Conference on Social Robotics 2016 - Kansas City, United States
Duration: 1 Nov 20163 Nov 2016

Publication series

NameLecture Notes in Computer Science
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference8th International Conference on Social Robotics 2016
Country/TerritoryUnited States
CityKansas City

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'The MuMMER project: Engaging human-robot interaction in real-world public spaces'. Together they form a unique fingerprint.

Cite this