Connect
MJA
MJA

Implementing pay-for-performance in Australian primary care: lessons from the United Kingdom and the United States

Stephen M Campbell, Anthony Scott, Rhian M Parker, Lucio Naccarella, John S Furler, Doris Young and Peter M Sivey
Med J Aust 2010; 193 (7): 408-411. || doi: 10.5694/j.1326-5377.2010.tb03971.x
Published online: 4 October 2010

The Australian Government’s agenda for the reform of the health system is now under consideration.1,2 The National Primary Health Care Strategy recommends “pay-for-performance” as a key building block:

It has already been announced that the federal government is to take responsibility for all primary care funding and policy. Patients with diabetes will be encouraged to voluntarily enrol with a general practice for care of a chronic condition; capitation payments (set amounts paid to doctors for enrolled patients) will be made, and pay will be linked to performance. Given Australia’s past experience with pay-for-performance through the Practice Incentives Program (PIP), many of the conditions for the extension of a pay-for-performance scheme in Australian primary care seem to be in place. However, pay-for-performance can be expensive,3 and rigorous evidence that it leads to improvements in quality of care is lacking.

The aim of our article is to consider the international experience of pay-for-performance in primary care, identify the key lessons learned, and use these to examine what questions Australia may need to consider before such a scheme is introduced.

International experience

The Quality and Outcomes Framework (QOF) is a national primary care pay-for-performance scheme in the United Kingdom,4 described as “world-leading” at its introduction in 2004. The UK Government invested up to 20% of the primary care budget on the scheme, 90% of which was money additional to the existing health budget. Since 2004, there has been an increasing focus on clinical indicators (eg, the percentage of people with heart disease or with blood pressure below a defined target) (Box 1), which represented 52% of the framework in 2004, and increased to 66% in 2006 and 70% in 2009. Although the QOF is a voluntary system, over 99% of UK practices participate in it.5 Points are awarded for individual indicators in relation to the level of achievement of that indicator. There is a graduated scale of payments, from a minimum (25% initially, rising to 40% in 2006) to a maximum (usually 90%) once maximum points are reached.

The United States has the most diversity in pay-for-performance schemes in health care.6,7 There are hundreds of such schemes within US health maintenance organisations (HMOs), and some of these are large schemes involving coordination across a number of private health insurers.8 US national schemes are currently being developed and evaluated within the US Medicare system.9

There are few well designed empirical evaluations of the impact of pay-for-performance schemes.10,11 We reviewed the evidence from the UK, US and Australia and identified several important factors that should be considered when designing such schemes.12

Building on existing support systems

It is crucial to account for intrinsic and contextual factors which may accompany the introduction of pay-for-performance. Schemes evolve over time and usually involve several complex interventions, including accreditation, education, quality improvement programs (eg, guidelines and feedback), investment in information technology (IT) and data collection systems, and professional and regional support structures.12 These are all necessary conditions for linking financial incentives to quality of care. In the UK, there was a long history of structural reform, performance management, clinical guideline development and development of IT infrastructure before the QOF was introduced. Critically, it was possible to collect good quality data on current baselines for quality of care from some general practices.13 Performance pay in the UK relies on data collection at the practice level. The QOF uses electronic data entry and extraction processes using agreed clinical terms (Read codes). There are no comparable nationally computerised clinical information systems in Australia, although some progress has been made through the Australian Primary Care Collaboratives. In the US, and in the Australian PIP, administrative data based on fee claims are used to calculate performance measures. This approach does not lend itself to a pay-for-performance scheme that covers multiple disease areas, because fee claims are indicators of process of care, not clinical outcomes.

Reward quality improvement

The UK QOF policy documents do not mention rewarding improvement in quality of care, just “providing” it. None of the incentives reward quality improvements, only achieving targets for “intermediate” outcome measures.15 No scheme directly measures or rewards improvements in health, as patients’ health-related quality of life before and after interventions is not routinely measured. The Californian Integrated Healthcare Association scheme had clear objectives for rewarding improvements in quality, but the incentives actually rewarded attainment of target levels of performance or position in relative rankings, not change or improvement. The US Medicare Physician Group Practice Demonstration scheme includes both threshold targets to reward achievement and an improvement target.9

There are several reasons why rewarding the achievement of a specified level of quality may not be as effective as rewarding improvements in quality. First, for those already providing high-quality care, the reward represents a windfall financial gain with no incentive to change behaviour. The QOF could be regarded as another way of paying GPs, rather than encouraging improvements in quality of care through changed behaviour. Second, rewarding the achievement of a threshold of quality does not encourage further improvements in quality beyond the threshold. Third, for doctors with very low baseline levels of quality, the costs of achieving a relatively high threshold may seem prohibitive and they may not participate. These are the very groups where substantial gains in quality of care could be made at little additional cost.

Rewarding improvements in quality would encourage those with low baseline levels of quality to improve their care (ie, where the largest increases are likely to be made).6,16,17 This can be achieved either by setting successive thresholds close together (eg, at 5% intervals) or to pay only when a certain increase has been achieved (eg, a 5% increase). Additional costs for those achieving a given change in quality from a low baseline are likely to be lower than the costs for those already providing high-quality care, where the “easy” gains have already been made. The increasing costs of achieving each successive improvement should then be reflected in the payment schedule. Rewards for those who already provide high-quality care, but find it difficult to improve any further, should be part of a background payment scheme rather than a key element of the pay-for-performance scheme.

Unintended consequences

Possible unintended consequences, such as a focus on the remunerated areas at the cost of unremunerated areas (“gaming”), need to be thought through and managed carefully. Few empirical studies have examined potential adverse consequences of pay-for-performance.18 The QOF was intended to reward quality of care rather than numbers of registered patients, and also to improve data capture, care processes, patient outcomes and doctors’ working conditions.4 However, evidence suggests that over the lifetime of the QOF, patients in the UK now find it harder to obtain continuity of care.19 Other evidence from the UK suggests that there were positive spillovers to unremunerated disease areas.20,21 A practice that provides high-quality care in one disease area is also likely to provide high-quality care in other disease areas.

Gravelle and colleagues found that UK GPs who failed to score maximum QOF points in the first year “gamed” the system by increasing their exception-reported patients (patients who would not count in their QOF scores) in the following years.22 “Patient dumping” is therefore another risk in pay-for-performance schemes.18 There is also a risk that external incentives may crowd out intrinsic motivation (the desire to do a task well for its own sake), especially if the external incentives are not closely aligned to doctors’ views of their role.23 Current evidence suggests that financial incentives are most likely to be effective in influencing professional behaviour when performance measures and rewards are aligned to the values of the staff being rewarded.24

In the UK, practice nurses have absorbed a higher proportion of the clinical workload associated with the QOF.23 One unintended consequence is that nurses do not benefit directly from the incentives that drive their work.25 Payments to individual professionals may not encourage team work or coordination of care (and thus may not improve quality of care when team-based coordinated care is needed) if there are large differences in payments between team members.25

Proportion of revenue paid

A balance needs to be achieved in deciding how much funding will be allocated to pay-for-performance schemes. The QOF substantially overspent initially, because GP performance was underestimated before the scheme was introduced.26 Additional government spending on health care was used to fund the scheme, including a substantial increase in doctors’ incomes of 35% over 2 years, when the scheme was introduced. The 20%–25% of doctor income that comes from the QOF contrasts sharply with the experience of using pay-for-performance in the US, where rewards were less than 10% of revenue, which may not have been large enough to cover the costs of changing behaviour.6-8 Incentives were funded from within existing budgets or savings, and so for some schemes no new resources were invested. Australian Medicare data from 2003 suggest that the PIP represented an average of 9% of GPs’ revenue from Medicare,27 though only a proportion of this would have been used for the pay-for-performance elements (service incentive payments [SIPs]28 and outcome payments). There is little evidence to suggest what proportion of revenue should be paid using pay-for-performance, but the 20%–25% of revenue in the QOF is likely to be too high.

Team incentives

There should be a mix of payments to the practice and to individual health professionals for quality improvements. There is little evidence to suggest that one or the other should be targeted.29 Paying teams raises issues of how a team is defined, and how the financial rewards are used by the team.3,30 These issues may mitigate the intended effect of the financial incentives, though it does give discretion to the team to use the rewards in a number of ways, which might include investing in further quality improvements, or directly rewarding team members, or a combination.17 Any payments to team members should be equitable with respect to their skill and effort, or those who feel unfairly treated may lose motivation to change behaviour.

Conclusion

If pay-for-performance is to be introduced into Australia, key lessons should be learned from the experiences of other countries (Box 2). In particular, pay-for-performance should be used only as one part of a wider, multiple-systems-based strategy for quality improvement, and should not be seen as a panacea. Pay-for-performance should be used explicitly to drive quality improvement, and not simply to reward those who are already providing high-quality care. Before such a scheme is contemplated, the method of data entry and extraction should be considered a key priority, with IT specialists included early in discussions.

  • Stephen M Campbell1
  • Anthony Scott2
  • Rhian M Parker3
  • Lucio Naccarella2
  • John S Furler2
  • Doris Young2
  • Peter M Sivey2

  • 1 National Primary Care Research and Development Centre, University of Manchester, Manchester, UK.
  • 2 University of Melbourne, Melbourne, VIC.
  • 3 Australian Primary Health Care Research Institute, Australian National University, Canberra, ACT.


Correspondence: Rhian.Parker@anu.edu.au

Acknowledgements: 

Some of this research is a project of the Australian Primary Health Care Research Institute, which is supported by a grant from the Australian Government Department of Health and Ageing under the Primary Health Care Research, Evaluation and Development Strategy. The information and opinions are ours and do not necessarily reflect the views or policies of the Australian Government Department of Health and Ageing.

Competing interests:

John Furler has been supported by an Australian Primary Health Care Research Institute (APHCRI) Stream 13 grant and he has received several other grants from the APHCRI. Anthony Scott has been funded by an APHCRI Stream 13 grant. Peter Sivey has been supported by the APHCRI, which is supported by the Australian Government Department of Health and Ageing. Doris Young has been funded by an APHCRI Stream 13 grant.

  • 1. Australian Government Department of Health and Ageing. Primary health care reform in Australia. Report to support Australia’s first national primary health care strategy. Canberra: Commonwealth of Australia, 2009. http://www.yourhealth.gov.au/internet/yourhealth/publishing.nsf/Content/nphc-draftreportsupp-toc/$FILE/NPHC-supp.pdf (accessed Aug 2010).
  • 2. Australian Government. A healthier future for all Australians — final report. Commonwealth of Australia: Canberra, 2009. http://www.health.gov.au/internet/nhhrc/publishing.nsf/Content/nhhrc-report (accessed Aug 2010).
  • 3. Campbell SM, McDonald R, Lester H. The experience of pay for performance in English family practice: a qualitative study. Ann Fam Med 2008; 6: 228-234.
  • 4. Roland M. Linking physicians’ pay to the quality of care — a major experiment in the United Kingdom. N Engl J Med 2004; 351: 1448-1454.
  • 5. Campbell SM, Reeves D, Kontopantelis E, et al. Effects of pay for performance on the quality of primary care in England. N Engl J Med 2009; 361: 368-378.
  • 6. Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. JAMA 2005; 294: 1788-1793.
  • 7. Rosenthal MB, Landon BE, Normand SL, et al. Pay for performance in commercial HMOs. N Engl J Med 2006; 355: 1895-1902.
  • 8. Mullen K, Frank RG, Rosenthal MB. Can you get what you pay for? Pay-for-performance and the quality of healthcare providers. Rand J Econ 2010. In press.
  • 9. Leavitt MO. Report to Congress: Physician Group Practice Demonstration first evaluation report. Washington, DC: United States Department of Health and Human Services, 2006.
  • 10. Christianson JB, Leatherman S, Sutherland K. Financial incentives, healthcare providers and quality improvements: a review of the evidence. London: Quest for Quality and Improved Performance, The Health Foundation, 2007. http://www.health.org.uk/publications/research_reports/financial.html (accessed Aug 2010).
  • 11. Scott A, Sivey P, Ait Ouakrim D, et al. The effect of financial incentives on the quality of health care provided by primary care physicians (protocol). Cochrane Database Syst Rev 2010; (4): CD008451.
  • 12. Scott A, Nacarella L, Furler J, et al. Using financial incentives to improve the quality of primary care in Australia. Final report. Canberra: Australian Primary Health Care Research Institute, Australian National University, 2010.
  • 13. Campbell SM, Steiner A, Robison J, et al. Is the quality of care in general medical practice improving? Results of a longitudinal observational study. Br J Gen Pract 2003; 53: 298-304.
  • 14. Rosenthal MB, Landon BE, Howitt K, et al. Climbing up the pay-for-performance learning curve: where are the early adopters now? Health Aff 2007; 26: 1674-1682.
  • 15. Department of Health (UK). Investing in general practice: the new general medical services contract. London: National Health Service Confederation and the British Medical Association, 2003. http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4071966 (accessed Sep 2010).
  • 16. Bokhour BG, Burgess JF Jr, Hook JM, et al. Incentive implementation in physician practices: a qualitative study of practice executive perspectives on pay for performance. Med Care Res Rev 2006; 63: 73S-95S.
  • 17. Rosenthal MB, Fernandopulle R, Song HR, Landon B. Paying for quality: providers’ incentives for quality improvement. Health Aff 2004; 23: 127-141.
  • 18. McDonald R, Roland M. Pay for performance in primary care in England and California: comparison of unintended consequences. Ann Fam Med 2009; 7: 121-127.
  • 19. Campbell SM, Kontopantelis E, Reeves D, et al. Changes in patient experiences of primary care during health service reforms in England between 2003 and 2007. Ann Fam Med 2010. In press.
  • 20. Sutton M, Elder R, Guthrie B, Watt G. Record rewards: the effects of targeted quality incentives on the recording of risk factors by primary care providers. Health Econ 2010; 19: 1-13.
  • 21. Steel N, Maisey S, Clark A, et al. Quality of clinical primary care and targeted incentive payments: an observational study. Br J Gen Pract 2007; 57: 449-454.
  • 22. Gravelle H, Sutton M, Ma A. Doctor behaviour under a pay for performance contract: further evidence from the quality and outcomes framework. York: Centre for Health Economics, University of York, 2008.
  • 23. McDonald R, Campbell S, Lester HE. Practice nurses and the effects of the new general practitioner contract in the English National Health Service: the extension of a professional project? Soc Sci Med 2009; 68: 1206-1212.
  • 24. Marshall M, Smith P. Rewarding results: using financial incentives to improve quality. Qual Saf Health Care 2003; 12: 397-398.
  • 25. McDonald R, Harrison S, Checkland K, et al. Impact of financial incentives on clinical autonomy and internal motivation in primary care: ethnographic study. BMJ 2007; 334: 1333-1334.
  • 26. National Audit Office (UK). NHS pay modernisation: new contracts for general practice services in England. London: Stationery Office, 2008.
  • 27. Senate Select Committee on Medicare. Medicare: healthcare or welfare? Canberra: Senate Printing Unit, Parliament House, 2003.
  • 28. Richardson J, Walsh J, Pegram R. Financing general practice, health services and expenditures. In: Pegram R, editor. General practice in Australia: 2004. Canberra: Department of Health and Ageing, 2005.
  • 29. Naccarella L, Scott A, Furler J, et al. Narrative literature review on incentives for primary health care team service provision: learning and working together in primary health care. Canberra: Australian Primary Health Care Research Institute, Australian National University, 2010.
  • 30. Forrest CB, Villagra VV, Pope JE. Managing the metric vs managing the patient: the physician’s view of pay for performance. Am J Manag Care 2006; 12: 83-85.

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.