Abstract
We consider the ensemble Kalman inversion (EKI) which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the EKI becomes computationally infeasible as the data misfit needs to be evaluated for each particle in each iteration. Here, randomised algorithms like stochastic gradient descent have been demonstrated to successfully overcome this issue by using only a random subset of the data in each iteration, so-called subsampling techniques. Based on a recent analysis of a continuous-time representation of stochastic gradient methods, we propose, analyse, and apply subsampling-techniques within EKI. Indeed, we propose two different subsampling techniques: either every particle observes the same data subset (single subsampling) or every particle observes a different data subset (batch subsampling).
Original language | English |
---|---|
Article number | 094002 |
Journal | Inverse Problems |
Volume | 39 |
Issue number | 9 |
Early online date | 28 Jul 2023 |
DOIs | |
Publication status | Published - Sept 2023 |
Keywords
- stochastic optimisation
- piecewise-deterministic Markov process
- particle system
- inverse problems
- data subsampling