Benchmark Test Distributions for Expanded Uncertainty Evaluation Algorithms

Arvind Rajan, Ye Chow Kuang, Melanie Po Leen Ooi, Serge N. Demidenko

Research output: Contribution to journalArticlepeer-review

17 Citations (Scopus)

Abstract

Expanded uncertainty estimation is normally required for mission-critical applications, e.g., those involving health and safety. It helps to get a distribution range of the required confidence level for the uncertainty evaluation of a system. There are a number of available techniques to estimate the expanded uncertainty. However, there is currently no commonly accepted benchmark test distribution set adopted to compare the performances of different techniques when they are used to estimate the expanded uncertainty. Without such a common benchmarking platform, the relative reliability of a particular technique in comparison to other techniques can be untrustworthy. To address the shortcoming, this paper proposes a set of analytically derived benchmark test distributions. It goes on to show the benefits of using them by comparing the performance of existing distribution fitting techniques when applied to the moment-based expanded uncertainty evaluation. The most commonly used moment-based distribution fitting techniques, such as Pearson, Tukey's gh, Cornish-Fisher expansion, and extended generalized lambda distributions, are employed as test cases in this paper. The test distribution set proposed in this paper provides a common benchmarking platform for metrologists intending to assess the performance of different expanded uncertainty estimation techniques. Results from the performance comparison would help practitioners to make a better choice of a distribution fitting technique that would best suit their respective systems.

Original languageEnglish
Pages (from-to)1022-1034
Number of pages13
JournalIEEE Transactions on Instrumentation and Measurement
Volume65
Issue number5
Early online date23 Dec 2015
DOIs
Publication statusPublished - May 2016

Keywords

  • Benchmark distributions
  • Cornish-Fisher (CF)
  • expanded uncertainty
  • extended generalized lambda distributions (EGLD)
  • guide to the expression of uncertainty in measurement (GUM)
  • Monte Carlo (MC)
  • Pearson
  • Tukey's gh

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Instrumentation

Fingerprint

Dive into the research topics of 'Benchmark Test Distributions for Expanded Uncertainty Evaluation Algorithms'. Together they form a unique fingerprint.

Cite this