Impact of an educational intervention on general practitioners’ skills in cognitive behavioural strategies: a randomised controlled trial

Grant A Blashki, Leon Piterman, Graham N Meadows, David M Clarke, Vasuki Prabaharan, Jane M Gunn and Fiona K Judd
Med J Aust 2008; 188 (12): S129. || doi: 10.5694/j.1326-5377.2008.tb01876.x
Published online: 16 June 2008


Objective: To evaluate the impact of an educational intervention on general practitioners’ skills in cognitive behavioural strategies (CBS).

Design: Randomised controlled trial, with baseline and post-training measurement of GP competency in CBS using standardised simulated patient consultations, conducted between January 2005 and December 2006.

Participants and setting: 55 GPs in Victoria with a special interest in mental health issues.

Intervention: A 20-hour multifaceted educational program facilitated by mental health experts, incorporating rehearsal of CBS and provision of resources such as patient education material and worksheets.

Main outcome measures: Objective ratings of videotaped consultations of a standardised simulated patient using the Cognitive Therapy Scale.

Results: 32 doctors completed all phases of the intervention and the evaluation protocol. The intervention group showed greater improvements than the control group in both general therapeutic and specific CBS skills after the training.

Conclusion: Competency in CBS in highly motivated GPs can be improved by a brief training intervention.

Trial registration: International Standard Randomised Controlled Trial Number ISRCTN62481969.

Evidence-based psychological treatments such as cognitive behaviour therapy (CBT) provided by trained psychologists are effective in treating common mental disorders such as depression and anxiety.1 By contrast, evidence from systematic reviews for the effectiveness of general practitioner-provided cognitive behavioural strategies (CBS) — discrete elements of CBT without formal psychological training — is generally poor.2,3 Problem-solving techniques appear to be a promising approach for GP-delivered therapy, with two studies indicating superiority to usual care or equivalence to pharmacological treatment.4,5 However, both systematic reviews indicated that more research into GP delivery of psychological treatments is needed.2,3

This is relevant for recent major policy reforms in Australia, which have made specialist psychologist care much more accessible for patients through the Better Outcomes in Mental Health Care and Better Access initiatives,6 while at the same time supporting GPs with mental health training to provide what have been termed “focused psychological strategies”.7 These strategies involve a range of approaches derived from evidence-based psychological treatments that have been adapted for general practice, such as psychoeducation, interpersonal counselling and CBS.

Providing specific psychological treatments in general practice can be challenging for GPs, who are beset with issues such as lack of time, competing demands, and variable levels of training in specific psychological skills.8 One approach to GP mental health training is to teach some discrete elements of the CBT approach. CBT is appealing for the general practice context because it is usually time limited and highly structured, and patients are encouraged to do much of the “homework” outside the consultation.

In 2005 and 2006, we conducted the PEP (Primary Care Evidence Based Psychological Treatments) study — a randomised controlled trial of GPs undertaking a 20-hour CBS training program that met the Australian requirements for providing focused psychological strategies.7 A range of outcomes were measured, including GP knowledge, attitudes and competence, and patient outcomes. Here, we report on the component of the study that aimed to measure the impact of an educational intervention on GP acquisition of CBS skills. Our hypothesis was that trained GPs would demonstrate greater gains in competency in CBS than the control group.


Victorian GPs were recruited in three waves between January 2005 and December 2006 through newsletters of the Victorian Divisions of General Practice, an advertisement on the website of the Royal Australian College of General Practitioners,9 and direct mail-out to GPs who had previously participated in courses run by the training provider. A significant incentive for GPs who completed the training was that they would become eligible to apply for access to a higher Medicare Benefits Schedule rebate to provide focused psychological strategies.7 GPs who expressed interest were sent explanatory statements and consent forms.

The PEP study was approved by the ethics committees at Monash University and the University of Melbourne, and was lodged with the International Standard Randomised Controlled Trial Number Register (ISRCTN62481969).10


The CBS training, involving face-to-face teaching with a strong emphasis on role-playing specific CBS skills in pairs, has been described previously11-13 and is summarised in Box 1. It was a 20-hour program broken into four 5-hour sessions, usually over two weekends. Up to 14 GPs attended each training session, which was facilitated by a mental health specialist or a GP with independent mental health qualifications.

GP competency

Simulated patient consultations were undertaken at the GPs’ practices to assess their skills in CBS. A female actor portrayed a 35-year-old mother of two small children with a past history of postnatal depression, who was experiencing a mixture of depression and anxiety symptoms including panic attacks, negative automatic thinking, and avoidance behaviours. GPs were aware that the patient was an actor and were provided with written material about the patient’s background history to read for 5 minutes. They then had 20 minutes in which to demonstrate a brief cognitive behavioural strategy relevant to the clinical presentation. The consultations with the simulated patient were videotaped for GPs in both the intervention and control groups at baseline and at 3 months post-intervention.

Two independent observers, who were blinded to the GPs’ group allocations, rated the videotaped simulated consultations using the Cognitive Therapy Scale (CTS).14 This measure has previously been used in CBT centres and clinical studies to assess clinical competence.15 The CTS consists of 11 items measured on a scale from 0 to 6. Items were summed to generate an overall competency score (with a total possible score of 66 and a satisfactory threshold score of 39), along with two subscales assessing general therapeutic skills (Items 1–6) and specific CBT skills (Items 7–11). A higher score indicates greater competency in delivering CBT. In a small number of cases, there was one item missing from rating scales of the videotaped consultations due to rater error. For these ratings, the missing response for the item was substituted by the average of the remaining items in the subscale to which the item belonged.

Recruitment and participant flow

Invitations were sent to a total of 1021 GPs; 56 responded and agreed to participate and were randomly assigned to either the intervention or control group (Box 2). One of the GPs randomly assigned to the intervention group was unwilling to undertake training at the allocated time and dropped out of the study.

Outcomes and estimation

Summary measures of the competency in CBS skills at baseline and post-intervention, and the differences in mean competency scores between the two study groups, are shown in Box 4. Overall, there was moderate evidence that the intervention group had greater improvement in competency than the control group, with the greatest difference being an improvement in specific CBS skills.


This study supports our hypothesis that a short training course can improve GP skills in the provision of CBS. Only in the intervention group did the mean overall post-training competency scores increase beyond the satisfactory threshold score of 39.15 Greater improvements occurred in specific CBS skills than in general therapeutic skills.

This study does have some limitations. Potential sources of bias include self-selection of GPs with a special interest in mental health, and high drop-out rates. While there was some imbalance in baseline GP characteristics between the groups, the adjusted analysis suggested that this did not affect the outcome. Although our actual sample size was lower than our estimated required sample size, improvements in competency were large enough to be detected.

Caution is required in generalising our study findings, as the participants represent a highly self-selected group of GPs. Our findings may more accurately apply to other GPs who have a strong interest in mental health, such as those registering to provide focused psychological strategies in Australia through the Medicare Benefits Schedule.7

This study adds support to existing evidence that training can improve GP skills in specific psychological strategies. Previous studies have shown that GPs can improve their psychological skills in managing a range of mental health problems.16,17

Whether such improvements in GP performance translate to real and sustained improvements in competence and better patient outcomes is uncertain.2 One study suggested that competency as assessed by the CTS is associated with clinical improvements in depressed patients.15 Subsequent analysis of our study’s patient data may yield further information on this question.

From a policy perspective, a recent health economics analysis suggested that even small clinical improvements in patients receiving focused psychological strategies from GPs could render this a highly cost-effective approach.18 However, since the commencement of our study, major mental health reforms have occurred in Australia,6 which have greatly increased consumer access to specialist-delivered psychological treatments. In this context, future research should focus on which patients should appropriately receive specific focused psychological strategies from GPs and which should be referred for specialist psychologist treatments.

  • Grant A Blashki1
  • Leon Piterman2
  • Graham N Meadows3
  • David M Clarke4
  • Vasuki Prabaharan1
  • Jane M Gunn1
  • Fiona K Judd5

  • 1 Department of General Practice, University of Melbourne, Melbourne, VIC.
  • 2 School of Primary Health Care, Monash University, Melbourne, VIC.
  • 3 Discipline of Psychological Medicine, Southern Synergy, Monash University, Melbourne, VIC.
  • 4 Discipline of Psychological Medicine, Monash Medical Centre, Monash University, Melbourne, VIC.
  • 5 Department of Psychiatry, Royal Women's Hospital and University of Melbourne, Melbourne, VIC.



The late Dr Grace Groom and the late Professor Jeff Richards were members of the original study team and made a great contribution to this study. Thank you to: the PEP collaboration, the research fellows and assistants who worked on the study, including Dr Lisa Ciechomski, Dr Kathryn Gilson, Ms Maria Potiriadis, Ms Donna Southern, and Ms Kitty Novy; Ms Patty Chondros for statistical support; Educational Health Solutions for educational support; the Divisions of General Practice, GPs and patients who participated in the study; and beyondblue’s Victorian Centre of Excellence in Depression and Related Disorders, an initiative between beyondblue and the State Government of Victoria, for providing funding.

Competing interests:

None identified.

  • 1. Nathan PE, Gorman JM, editors. A guide to treatments that work. New York: Oxford University Press, 1998.
  • 2. Huibers MJ, Beurskens AJ, Bleijenberg G, van Schayck CP. The effectiveness of psychosocial interventions delivered by general practitioners (Cochrane review). The Cochrane Library, Issue 2, 2003. Oxford: Oxford Update Software.
  • 3. Moulding R, Blashki G, Gunn J, et al. Optimising the primary mental health care workforce: how can effective psychological treatments for common mental disorders best be delivered in primary health care? Canberra: Australian Primary Health Care Research Institute, 2007. (accessed Feb 2008).
  • 4. Mynors-Wallis LM, Gath DH, Day A, Baker F. Randomised controlled trial of problem solving treatment, antidepressant medication, and combined treatment for major depression in primary care. BMJ 2000; 320: 26-30.
  • 5. Mynors-Wallis LM, Gath DH, Lloyd-Thomas AR, Tomlinson D. Randomised controlled trial comparing problem solving treatment with amitriptyline and placebo for major depression in primary care. BMJ 1995; 310: 441-445.
  • 6. Hon Tony Abbott, Minister for Health and Ageing, and Hon Christopher Pyne, Parliamentary Secretary to the Minister for Health and Ageing. COAG mental health [media release]. 9 May 2006. (accessed Oct 2007).
  • 7. Blashki G, Hickie IB, Davenport TA. Providing psychological treatments in general practice: how will it work? Med J Aust 2003; 179: 23-25. <MJA full text>
  • 8. Blashki G, Parsons J, Morgan H, et al. Providing psychological treatments in general practice: rationale and practicalities. Aust Fam Physician 2003; 32: 625-630.
  • 9. Royal Australian College of General Practitioners. The General Practice Mental Health Standards Collaboration. (accessed Oct 2007).
  • 10. International Standard Randomised Controlled Trial Number Register [website]. (accessed Oct 2007).
  • 11. Blashki G, Morgan H, Hickie IB, et al. Structured problem solving in general practice. 3. Aust Fam Physician 2003; 32: 836-842.
  • 12. Blashki G, Morgan H, Sumich H, et al. Behavioural modification strategies for general practice. Aust Fam Physician 2003; 32: 715-721.
  • 13. Blashki G, Richards JC, Ryan P, et al. Cognitive behavioural strategies for general practice. Aust Fam Physician 2003; 32: 910-917.
  • 14. Young J, Beck AT. Cognitive Therapy Scale rating manual. Philadelphia: University of Pennsylvania, 1980.
  • 15. Trepka C, Rees A, Shapiro DA, et al. Therapist competence and outcome of cognitive therapy for depression. Cognit Ther Res 2004; 28: 143-157.
  • 16. Kroenke K, Taylor-Vaisey A, Dietrich AJ, Oxman TE. Interventions to improve provider diagnosis and treatment of mental disorders in primary care: a critical review of the literature. Psychosomatics 2000; 41: 39-52.
  • 17. Blashki G, Jolly B, Piterman L, Gunn J. Effective methodology for mental health training of general practitioners. Asia Pacific Family Medicine 2003; 2: 218-225.
  • 18. Mihalopoulos C, Kiropoulos L, Shih ST, et al. Exploratory economic analyses of two primary care mental health projects: implications for sustainability. Med J Aust 2005; 183 (10 Suppl): S73-S76. <MJA full text>


remove_circle_outline Delete Author
add_circle_outline Add Author

Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.