eMJA     The Medical Journal of Australia

Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search   

Editorial

Clinical practice guidelines: time to move the debate from the how to the who

Martin B Van Der Weyden
MJA 2002; 176 (7): 304-305

Openness about all potential conflicts of interest, as well as the degree of agreement among members about the final guidelines, is the least we should expect

The ascendancy of evidence-based medicine over the last decade has fostered an unprecedented growth in practice guidelines.1-3 Departments of health and associated agencies, specialty societies and other medical organisations have all embraced the development of guidelines in the belief that adherence to their recommendations translates into benefits for patients (improved outcomes), practitioners (improved quality of care), and providers (improved cost-effectiveness).4

As the practice guideline movement has matured, the interest and debate surrounding guideline developments has shifted from the what to the how.5

In fact, the National Health and Medical Research Council's Guidelines for the development and implementation of clinical practice guidelines, published in 1995,6 was a pacesetter in the how of guidelines, and at its core are the three criteria that underpin the quality of guidelines:

  • a balance of healthcare disciplines in the guideline development group, together with consumer representation;

  • a systematic review of relevant literature and its stratification of the data according to a hierarchy of levels of evidence; and

  • the generation of evidence-graded recommendations that also take into account the generalisability of the evidence, its practice relevance and resource implications.

Despite the availability of guidelines for developing guidelines,6,7 recent reviews of practice guidelines have shown that most fail to meet quality standards.1-3 This is hardly surprising, as guideline development is an intensive, laborious and at times uncertain task.8 In essence, it is a human affair with all its attendant nuances, complexities and biases.

These human elements are illustrated in this issue of the Journal by Edmonds and colleagues (page 332)9 in their account of the workings of the Australian COX-2-Specific Inhibitor Prescribing Group. The outcome of its deliberations is also published in this issue of the Journal (page 328).10

The process pursued by the Prescribing Group followed the essentials outlined in the guidelines for guidelines.6,7 The working party was multidisciplinary, but with a difference! It had a high proportion of academics and clinicians with connections with the pharmaceutical industry, together with an undeniable first — representatives from the pharmaceutical companies involved in marketing COX-2 inhibitors. Initially, the group was embroiled in a debate on conflict of interest and its impact on the credibility of the outcomes, but this was only the beginning. A clash of minds in the interpretation of evidence led to resignations from the group, as did irreconcilable differences with its ultimate recommendations. This story suggests that the debate in guideline development should now shift even further from the how to the who .

The major issues arising from the Australian COX-2-Specific Inhibitor Prescribing Group's deliberations involve aspects of conflicts of interest and the management of differing interpretations of evidence. The definition of conflict of interest is complex, but a pragmatic description is "conflicts of interests comprise those which may not be fully apparent and which may influence judgment of authors reviewers or editors. They have been described as those which, revealed later, would make a reasonable reader feel misled or deceived".11 In contrast to the recent emphasis in disclosure of conflict of interest in scientific and medical publishing, it appears that this dsclosure has a low profile in practice guidelines. In two extensive surveys on quality in more than 700 practice guidelines, a statement of conflict of interest was not among the standards surveyed.1,2 Further, in a recent survey exploring the relationships between authors of clinical practice guidelines and the pharmaceutical industry,3 financial support for authors by pharmaceutical companies was declared in only two of the 44 guidelines surveyed, and industry financial support for the creation of the guideline was reported in only 20. Relationships with the pharmaceutical industry are widely accepted as being a potent catalyst for the potentiality of conflict of interest.12 But the time has come to explore conflicts in relationships with health departments, other government agencies, various healthcare providers and specialty organisations. Full and candid disclosure of conflict, as pursued by Edmonds and colleagues and as advocated by others (Box), is the only solution.

One inherent assumption of evidence-based medicine is that differences and controversies stemming from interpretation of data are inversely related to the quality of evidence. However, if the experience of the Australian COX-2-Specific Inhibitor Prescribing Group is anything to go by, this assumption would appear to be optimistic, as at the end of the exercise eight members of the group had resigned, essentially because of differing mindsets. The Journal has long encouraged authors of practice guidelines to cite the level of evidence underpinning recommendations.What remains intriguingly unknown is the range of levels of agreement on the evidence.

The account by Edmonds and colleagues is a refreshing and welcome exposition of the "real world" of guidelines development. Its central message is that practice guideline development is not a black-and-white affair, and that the time has come for open disclosure of conflicts of interest and the degrees of consensus or dissent. As guidelines have a powerful influence on clinical practice, doctors and their patients deserve nothing less than complete openness and transparency.

Recommendations for managing conflict of interests in practice guidelines development3

  • A formal process should exist to disclose potential conflict of interest before the guideline development begins.

  • All members of the guideline group should be involved in a discussion of conflicts of interest and how significant relationships will be managed.

  • Participants who have relationships with industry, government agencies , healthcare organisations or specialty societies need not necessarily be excluded, but the group has to decide among itself a threshold for exclusion.

  • There must be complete disclosure to readers of the practice guidelines of financial and/or other relationships with industry, government agencies, healthcare organisations and specialty societies.

  1. Shaneyfelt TM, Mayo-Smith MF, Rothwangl J. Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed literature. JAMA 1999; 81: 1900-1905.
  2. Grilli R, Magrini N, Penna A, et al. Practice guidelines developed by special societies: the need for critical appraisal. Lancet 2000; 335: 103-106.
  3. Choudhdry NK, Stelfox HT, Detsky AS. Relationships between authors of clinical practice guidelines and the pharmaceutical industry. Lancet 2002; 287: 612-617.
  4. Woolf SH, Groll R, Hutchison A, et al. Potential benefits, limitations and harms of clinical guidelines. BMJ 1999; 318: 527-530. <PubMed>
  5. Miller J,Petrie J. Development of practice guidelines [editorial]. Lancet 2000; 355: 82-83. <PubMed>
  6. National Health and Medical Research Council. Guidelines for the development and implementation of clinical practice guidelines. Canberra: AGPS, 1995.
  7. Shekelle PG, Woolf SH, Eccles M, Grimshaw J. Developing guidelines. BMJ 1999; 318: 593-596. <PubMed>
  8. Hirst GHL, Ward JE. Clinical practice guidelines: reality bites. Med J Aust 2000; 172: 287-291. <PubMed>
  9. Edmonds JP, Day RO, Bertoch JV. The road to consensus: considerations for the safe use and prescribing of COX-2-specific inhibitors. Med J Aust 2002; 176: 332-334. <eMJA full text> <PubMed>
  10. The Australian COX-2-Specific Inhibitor (CSI) Prescribing Group. Considerations for the safe prescribing and use of COX-2-specific inhibitors. Med J Aust 2002; 176: 328-331. <PubMed> <eMJA full text>
  11. Committee on Publication Ethics (COPE). The COPE Report 2001. Guidelines on good publication practice. Available at <http://www.publicationethics.org.uk/reports/2001/2001pdfcomplete.pdf> (accessed 12 March 2002).
  12. Stelfox HT, Chua G, O'Rourke, Detsky AS. Conflict of interest in the debate over calcium channel antagonists. N Engl J Med 1998; 338: 101-106. <PubMed>

(Received 12 Mar 2002, accepted 12 Mar 2002)

The Medical Journal of Australia, Strawberry Hills, NSW.

Martin B Van Der Weyden, MD, FRACP, FRCPA, Editor.

Correspondence: Dr Martin B Van Der Weyden, The Medical Journal of Australia, Locked Bag 3030, Strawberry Hills, NSW 2012.

Other articles have cited this article:

Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search

The Medical Journal of Australia    eMJA  

©The Medical Journal of Australia 2002 www.mja.com.au PRINT ISSN: 0025-729X ONLINE ISSN: 1326-5377