Preliminary development of recommendations for the inclusion of patient-reported outcome measures in clinical quality registries

Publication Name

BMC Health Services Research


Background: Clinical quality registries (CQRs) monitor compliance against optimal practice and provide feedback to the clinical community and wider stakeholder groups. Despite a number of CQRs having incorporated the patient perspective to support the evaluation of healthcare delivery, no recommendations for inclusion of patient-reported outcome measures (PROMs) in CQRs exist. The aim of this study was to develop a core set of recommendations for PROMs inclusion of in CQRs. Method: An online two-round Delphi survey was performed among CQR data custodians, quality of life researchers, biostatisticians and clinicians largely recruited in Australia. A list of statements for the recommendations was identified from a literature and survey of the Australian registries conducted in 2019. The statements were grouped into the following domains: rationale, setting, ethics, instrument, administration, data management, statistical methods, and feedback and reporting. Eighteen experts were invited to participate, 11 agreed to undertake the first online survey (round 1). Of these, nine experts completed the online survey for round 2. Results: From 117 statements presented to the Delphi panel in round 1, a total of 72 recommendations (55 from round 1 and 17 from round 2) with median importance (MI) ≥ 7 and disagreement index (DI) < 1 were proposed for inclusion into the final draft set and were reviewed by the project team. Recommendations were refined for clarity and to read as stand-alone statements. Ten overlapped conceptually and, therefore, were merged to reduce repetition. The final 62 recommendations were sent for review to the panel members for their feedback, which was incorporated into the final set. Conclusion: This is the first study to develop preliminary recommendations for PROMs inclusion in CQRs. Recommendations for PROMs implementation are critically important for registries to assure meaningful PROMs data capture, use, interpretation, and reporting to improve health outcomes and healthcare value.

Open Access Status

This publication may be available as open access





Article Number




Link to publisher version (DOI)