Robust Linear Regression and Anomaly Detection in the Presence of Poisson Noise Using Expectation-Propagation

Yoann Altmann, Dan Yao, Stephen McLaughlin, Mike E. Davies

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a family of approximate Bayesian methods for joint anomaly detection and linear regression in the presence of non-Gaussian noise. Robust anomaly detection using non-convex sparsity-promoting regularization terms is generally challenging, in particular when additional uncertainty measures about the estimation process are needed, e.g., posterior probabilities of anomaly presence. The problem becomes even more challenging in the presence of non-Gaussian, (e.g., Poisson distributed), additional constraints on the regression coefficients (e.g., positivity) and when the anomalies present complex structures (e.g., structured sparsity). Uncertainty quantification is classically addressed using Bayesian methods. Specifically, Monte Carlo methods are the preferred tools to handle complex models. Unfortunately, such simulation methods suffer from a significant computational cost and are thus not scalable for fast inference in high dimensional problems. In this paper, we thus propose fast alternatives based on Expectation-Propagation (EP) methods, which aim at approximating complex distributions by more tractable models to simplify the inference process. The main problem addressed in this paper is linear regression and (sparse) anomaly detection in the presence of noisy measurements. The aim of this paper is to demonstrate the potential benefits and assess the performance of such EP-based methods. The results obtained illustrate that approximate methods can provide satisfactory results with a reasonable computational cost. It is important to note that the proposed methods are sufficiently generic to be used in other applications involving condition monitoring.

Original languageEnglish
Title of host publicationAdvances in Condition Monitoring and Structural Health Monitoring
Subtitle of host publicationWCCM 2019
EditorsLen Gelman, Nadine Martin, Andrew A. Malcolm, Chin Kian (Edmund) Liew
PublisherSpringer
Pages143-158
Number of pages16
ISBN (Electronic)9789811591990
ISBN (Print)9789811591983
DOIs
Publication statusPublished - 2021
Event2nd World Congress on Condition Monitoring 2019 - Singapore, Singapore
Duration: 2 Dec 20195 Dec 2019

Publication series

NameLecture Notes in Mechanical Engineering
ISSN (Print)2195-4356
ISSN (Electronic)2195-4364

Conference

Conference2nd World Congress on Condition Monitoring 2019
Abbreviated titleWCCM 2019
Country/TerritorySingapore
CitySingapore
Period2/12/195/12/19

Keywords

  • Anomaly detection
  • Bayesian inference
  • Expectation-propagation
  • Generalized linear models
  • Robust regression

ASJC Scopus subject areas

  • Automotive Engineering
  • Aerospace Engineering
  • Mechanical Engineering
  • Fluid Flow and Transfer Processes

Fingerprint

Dive into the research topics of 'Robust Linear Regression and Anomaly Detection in the Presence of Poisson Noise Using Expectation-Propagation'. Together they form a unique fingerprint.

Cite this