Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit

  • Massimo Fornasier*
  • , Hui Huang
  • , Lorenzo Pareschi
  • , Philippe Sünnen
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

48 Citations (Scopus)

Abstract

We introduce a new stochastic differential model for global optimization of nonconvex functions on compact hypersurfaces. The model is inspired by the stochastic Kuramoto-Vicsek system and belongs to the class of Consensus-Based Optimization methods. In fact, particles move on the hypersurface driven by a drift towards an instantaneous consensus point, computed as a convex combination of the particle locations weighted by the cost function according to Laplace's principle. The consensus point represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached, then the stochastic component vanishes. In this paper, we study the well-posedness of the model and we derive rigorously its mean-field approximation for large particle limit.

Original languageEnglish
Pages (from-to)2725-2751
Number of pages27
JournalMathematical Models and Methods in Applied Sciences
Volume30
Issue number14
DOIs
Publication statusPublished - 30 Dec 2020

Keywords

  • Consensus-based optimization
  • mean-field limit
  • optimization over manifolds
  • stochastic Kuramoto-Vicsek model
  • well-posedness

ASJC Scopus subject areas

  • Modelling and Simulation
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit'. Together they form a unique fingerprint.

Cite this