Skip to main navigation Skip to search Skip to main content

Computing behavioral distances, compositionally

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a general definition of composition operator on Markov Decision Processes with rewards (MDPs) and identify a well behaved class of operators, called safe, that are guaranteed to be non-extensive w.r.t. the bisimilarity pseudometrics of Ferns et al. [10], which measure behavioral similarities between MDPs. For MDPs built using safe/non-extensive operators, we present the first method that exploits the structure of the system for (exactly) computing the bisimilarity distance on MDPs. Experimental results show significant improvements upon the non-compositional technique.
Original languageEnglish
Title of host publicationMathematical Foundations of Computer Science 2013
Subtitle of host publication38th International Symposium, MFCS 2013, Klosterneuburg, Austria, August 26-30, 2013, Proceedings
EditorsKrishnendu Chatterjee, Jirí Sgall
Place of PublicationBerlin
PublisherSpringer
Pages74-85
Number of pages12
Volume8087
ISBN (Electronic)978-3-642-40313-2
ISBN (Print)978-3-642-40312-5
DOIs
Publication statusPublished - 2013

Publication series

NameLecture Notes in Computer Science
Volume8087
ISSN (Print)0302-9743

Keywords

  • discount factor
  • multi-agent system
  • composition operator
  • Markov decision processes
  • parallel composition

Fingerprint

Dive into the research topics of 'Computing behavioral distances, compositionally'. Together they form a unique fingerprint.

Cite this