Impact of repeated hospital accreditation surveys on quality and reliability, an 8-year interrupted time series analysis

Subashnie Devkaran, Patrick Neil O'Farrell, Samer Ellahham, Randy Arcangel

Research output: Contribution to journalArticle

Abstract

OBJECTIVE: To evaluate whether hospital re-accreditation improves quality, patient safety and reliability over three accreditation cycles by testing the accreditation life cycle model on quality measures.

DESIGN: The validity of the life cycle model was tested by calibrating interrupted time series (ITS) regression equations for 27 quality measures. The change in the variation of quality over the three accreditation cycles was evaluated using the Levene's test.

SETTING: A 650-bed tertiary academic hospital in Abu Dhabi, UAE.

PARTICIPANTS: Each month (over 96 months), a simple random sample of 10% of patient records was selected and audited resulting in a total of 388 800 observations from 14 500 records.

INTERVENTIONS: The impact of hospital accreditation on the 27 quality measures was observed for 96 months, 1-year preaccreditation (2007) and 3 years postaccreditation for each of the three accreditation cycles (2008, 2011 and 2014).

MAIN OUTCOME MEASURES: The life cycle model was evaluated by aggregating the data for 27 quality measures to produce a composite score (YC) and to fit an ITS regression equation to the unweighted monthly mean of the series.

RESULTS: The results provide some evidence for the validity of the four phases of the life cycle namely, the initiation phase, the presurvey phase, the postaccreditation slump and the stagnation phase. Furthermore, the life cycle model explains 87% of the variation in quality compliance measures (R2=0.87). The best-fit ITS model contains two significant variables (β1 and β3) (p≤0.001). The Levene's test (p≤0.05) demonstrated a significant reduction in variation of the quality measures (YC) with subsequent accreditation cycles.

CONCLUSION: The study demonstrates that accreditation has the capacity to sustain improvements over the accreditation cycle. The significant reduction in the variation of the quality measures (YC) with subsequent accreditation cycles indicates that accreditation supports the goal of high reliability.

Original languageEnglish
Article numbere024514
JournalBMJ Open
Volume9
Issue number2
Early online date15 Feb 2019
DOIs
Publication statusPublished - Feb 2019

Fingerprint

Accreditation
Life Cycle Stages
Interrupted Time Series Analysis
Surveys and Questionnaires
United Arab Emirates
Patient Safety
Tertiary Care Centers
Compliance

Keywords

  • healthcare quality measures
  • high reliability
  • hospital accreditation
  • interrupted time series analysis
  • joint commission international
  • life cycle model

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{9a3ec6d019a34aeb9f816a6d721ab78e,
title = "Impact of repeated hospital accreditation surveys on quality and reliability, an 8-year interrupted time series analysis",
abstract = "OBJECTIVE: To evaluate whether hospital re-accreditation improves quality, patient safety and reliability over three accreditation cycles by testing the accreditation life cycle model on quality measures.DESIGN: The validity of the life cycle model was tested by calibrating interrupted time series (ITS) regression equations for 27 quality measures. The change in the variation of quality over the three accreditation cycles was evaluated using the Levene's test.SETTING: A 650-bed tertiary academic hospital in Abu Dhabi, UAE.PARTICIPANTS: Each month (over 96 months), a simple random sample of 10{\%} of patient records was selected and audited resulting in a total of 388 800 observations from 14 500 records.INTERVENTIONS: The impact of hospital accreditation on the 27 quality measures was observed for 96 months, 1-year preaccreditation (2007) and 3 years postaccreditation for each of the three accreditation cycles (2008, 2011 and 2014).MAIN OUTCOME MEASURES: The life cycle model was evaluated by aggregating the data for 27 quality measures to produce a composite score (YC) and to fit an ITS regression equation to the unweighted monthly mean of the series.RESULTS: The results provide some evidence for the validity of the four phases of the life cycle namely, the initiation phase, the presurvey phase, the postaccreditation slump and the stagnation phase. Furthermore, the life cycle model explains 87{\%} of the variation in quality compliance measures (R2=0.87). The best-fit ITS model contains two significant variables (β1 and β3) (p≤0.001). The Levene's test (p≤0.05) demonstrated a significant reduction in variation of the quality measures (YC) with subsequent accreditation cycles.CONCLUSION: The study demonstrates that accreditation has the capacity to sustain improvements over the accreditation cycle. The significant reduction in the variation of the quality measures (YC) with subsequent accreditation cycles indicates that accreditation supports the goal of high reliability.",
keywords = "healthcare quality measures, high reliability, hospital accreditation, interrupted time series analysis, joint commission international, life cycle model",
author = "Subashnie Devkaran and O'Farrell, {Patrick Neil} and Samer Ellahham and Randy Arcangel",
note = "{\circledC} Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.",
year = "2019",
month = "2",
doi = "10.1136/bmjopen-2018-024514",
language = "English",
volume = "9",
journal = "BMJ Open",
issn = "2044-6055",
publisher = "BMJ Publishing Group",
number = "2",

}

Impact of repeated hospital accreditation surveys on quality and reliability, an 8-year interrupted time series analysis. / Devkaran, Subashnie; O'Farrell, Patrick Neil; Ellahham, Samer; Arcangel, Randy.

In: BMJ Open, Vol. 9, No. 2, e024514, 02.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Impact of repeated hospital accreditation surveys on quality and reliability, an 8-year interrupted time series analysis

AU - Devkaran, Subashnie

AU - O'Farrell, Patrick Neil

AU - Ellahham, Samer

AU - Arcangel, Randy

N1 - © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

PY - 2019/2

Y1 - 2019/2

N2 - OBJECTIVE: To evaluate whether hospital re-accreditation improves quality, patient safety and reliability over three accreditation cycles by testing the accreditation life cycle model on quality measures.DESIGN: The validity of the life cycle model was tested by calibrating interrupted time series (ITS) regression equations for 27 quality measures. The change in the variation of quality over the three accreditation cycles was evaluated using the Levene's test.SETTING: A 650-bed tertiary academic hospital in Abu Dhabi, UAE.PARTICIPANTS: Each month (over 96 months), a simple random sample of 10% of patient records was selected and audited resulting in a total of 388 800 observations from 14 500 records.INTERVENTIONS: The impact of hospital accreditation on the 27 quality measures was observed for 96 months, 1-year preaccreditation (2007) and 3 years postaccreditation for each of the three accreditation cycles (2008, 2011 and 2014).MAIN OUTCOME MEASURES: The life cycle model was evaluated by aggregating the data for 27 quality measures to produce a composite score (YC) and to fit an ITS regression equation to the unweighted monthly mean of the series.RESULTS: The results provide some evidence for the validity of the four phases of the life cycle namely, the initiation phase, the presurvey phase, the postaccreditation slump and the stagnation phase. Furthermore, the life cycle model explains 87% of the variation in quality compliance measures (R2=0.87). The best-fit ITS model contains two significant variables (β1 and β3) (p≤0.001). The Levene's test (p≤0.05) demonstrated a significant reduction in variation of the quality measures (YC) with subsequent accreditation cycles.CONCLUSION: The study demonstrates that accreditation has the capacity to sustain improvements over the accreditation cycle. The significant reduction in the variation of the quality measures (YC) with subsequent accreditation cycles indicates that accreditation supports the goal of high reliability.

AB - OBJECTIVE: To evaluate whether hospital re-accreditation improves quality, patient safety and reliability over three accreditation cycles by testing the accreditation life cycle model on quality measures.DESIGN: The validity of the life cycle model was tested by calibrating interrupted time series (ITS) regression equations for 27 quality measures. The change in the variation of quality over the three accreditation cycles was evaluated using the Levene's test.SETTING: A 650-bed tertiary academic hospital in Abu Dhabi, UAE.PARTICIPANTS: Each month (over 96 months), a simple random sample of 10% of patient records was selected and audited resulting in a total of 388 800 observations from 14 500 records.INTERVENTIONS: The impact of hospital accreditation on the 27 quality measures was observed for 96 months, 1-year preaccreditation (2007) and 3 years postaccreditation for each of the three accreditation cycles (2008, 2011 and 2014).MAIN OUTCOME MEASURES: The life cycle model was evaluated by aggregating the data for 27 quality measures to produce a composite score (YC) and to fit an ITS regression equation to the unweighted monthly mean of the series.RESULTS: The results provide some evidence for the validity of the four phases of the life cycle namely, the initiation phase, the presurvey phase, the postaccreditation slump and the stagnation phase. Furthermore, the life cycle model explains 87% of the variation in quality compliance measures (R2=0.87). The best-fit ITS model contains two significant variables (β1 and β3) (p≤0.001). The Levene's test (p≤0.05) demonstrated a significant reduction in variation of the quality measures (YC) with subsequent accreditation cycles.CONCLUSION: The study demonstrates that accreditation has the capacity to sustain improvements over the accreditation cycle. The significant reduction in the variation of the quality measures (YC) with subsequent accreditation cycles indicates that accreditation supports the goal of high reliability.

KW - healthcare quality measures

KW - high reliability

KW - hospital accreditation

KW - interrupted time series analysis

KW - joint commission international

KW - life cycle model

UR - http://www.scopus.com/inward/record.url?scp=85061754279&partnerID=8YFLogxK

U2 - 10.1136/bmjopen-2018-024514

DO - 10.1136/bmjopen-2018-024514

M3 - Article

C2 - 30772852

VL - 9

JO - BMJ Open

JF - BMJ Open

SN - 2044-6055

IS - 2

M1 - e024514

ER -