Valuing the benefits of new anticancer drugs
Authors: Nicola J Lawrence, Glenn Salkeld, Martin R Stockler and Deme Karikios
Published online: 20 June 2016
Improvements in survival and cancer-related symptoms must be weighed up against treatment-related adverse effects and financial burden
Annual expenditure on anticancer drugs by the Pharmaceutical Benefits Scheme (PBS) has risen from $65 million in 1999–00 to $466 million in 2011–12 — an average annual increase of 19%.1 This is more than double Australia’s average annual increase in health expenditure of 8% over the same period.2 New techniques in radiation oncology and surgical oncology have also increased expenditure on cancer. It has never been more important to assess the value of new cancer treatments, weighing up the balance between benefits, harms and costs. In oncology, clinical benefit is defined by improvements in survival and cancer-related symptoms, and must be traded off against treatment-related adverse effects and financial burden. In Australia, evaluation of the trade-offs for new anticancer drugs has been predominantly a matter of health care policy, and determined by the Pharmaceutical Benefits Advisory Committee (PBAC).
People affected by cancer also face decisions about paying for unfunded treatments and need to understand the degree of benefit a treatment may offer. This is not straightforward, as illustrated by an American study published in 2012, which reported that 69% of patients with metastatic lung cancer and 81% of patients with metastatic colorectal cancer did not understand that their treatment was “not at all likely to cure” their cancer.3 It is even more difficult to balance modest benefits in survival against toxicity and cost, especially when new treatments are portrayed in the media as major breakthroughs.
The world’s two leading medical oncology organisations, the American Society of Clinical Oncology (ASCO) and the European Society for Medical Oncology (ESMO), have recently formulated the first objective, validated and reproducible frameworks to assess the value of anticancer drugs.4,5 These frameworks aim to improve transparency and provide independent measures of the degree of benefit a treatment offers. Both frameworks use data from individual trials to assess the value of a new treatment in comparison with the standard of care used in the trial. Important similarities between the frameworks include separate scoring systems for treatments given with curative intent versus palliative intent; higher value given to improvements in overall survival than to improvements in surrogate endpoints such as progression-free survival (PFS) or response rate; and upward adjustments for improvements in quality of life or reductions in toxicity. In this article, we summarise and compare the frameworks using two examples, and discuss their relevance to clinical practice and health care policy.
The ASCO has developed two instruments — one for potentially curable disease (adjuvant setting) and another for advanced disease — that yield a net health benefit (NHB) score for a new treatment in comparison with the standard of care, using published trial data. In advanced disease, the maximum NHB score is 130, indicating substantial improvements in overall survival, toxicity, cancer-related symptoms and treatment-free interval. The primary outcome contributes a maximum of 80 points to NHB, with higher scores for bigger improvements and benefits in overall survival rather than PFS or objective tumour response rate. The adjustment for toxicity ranges from − 20 for much more toxic to + 20 for much less toxic. Significant improvements in cancer-related symptoms contribute an additional 10 points. An improvement in the treatment-free interval (from completion of the new treatment to initiation of the next treatment) contributes a maximum of 20 points. The total NHB score is judged against the cost of acquiring the drug and patient copayments. The ASCO framework does not define benchmarks for the NHB indicating high value, or a level that justifies funding, leaving individuals and policy makers to draw their own conclusions.
The ASCO framework is summarised with two worked examples in the Box. An evaluation of erlotinib versus chemotherapy as first-line treatment for metastatic non-small cell lung cancer with a driver mutation of the epidermal growth factor receptor (EGFR-mutated)6 yielded an NHB score of 44/130 using the ASCO framework, indicating moderate benefit. In contrast, an evaluation of bevacizumab used in addition to chemotherapy in unselected patients with metastatic non-small cell lung cancer7 yielded an NHB score of 16/130, indicating modest benefit. The ASCO framework can also be used to compare the prices of two treatment strategies; however, in Australia, determining the additional costs of the new treatments is complex. Erlotinib is listed on the PBS for the indication above and, in 2016, costs patients $38.30 per month ($6.20 per month for concession-card holders), with an approximate price paid by the PBS of $1500/month. Bevacizumab is not listed on the PBS for the indication above, and would cost patients about $8000 per month.
The ESMO instruments categorise the benefits of anticancer drugs compared with current standard of care. The instruments yield an alphabetic grade (A, B or C) for treatments that are potentially curative, and a numerical grade (5, 4, 3, 2 or 1) for treatments unlikely to be curative, both ranked in diminishing order of benefit. The grades are assigned based on the observed benefits in survival or PFS in both relative terms (hazard ratios [HRs]) and absolute terms (numbers of months). This ensures an emphasis on benefits that are clinically important rather than just statistically significant. The ESMO framework evaluates the survival benefit first, and then adjusts the benefit grade for toxicity and quality of life. Financial cost was deliberately excluded from the ESMO framework because of differences between countries in costs and health service delivery. ESMO proposes that each health care jurisdiction make its own independent judgements about value for money and willingness to pay after considering the grade of clinical benefit.
The ESMO framework is summarised using the same two worked examples in the Box. Erlotinib compared with standard chemotherapy as first-line treatment for metastatic EGFR-mutated non-small cell lung cancer6 was assigned a grade 4 benefit using the ESMO framework, the highest possible grade for a non-curative treatment with PFS as the primary endpoint. Erlotinib received a high clinical value rating as it substantially reduced the rate of progression (HR, 0.37), improved median PFS by 4.5 months, and had less toxicity than standard-of-care chemotherapy. In contrast, bevacizumab in combination with chemotherapy for unselected metastatic non-small cell lung cancer7 was assigned a grade of 2, because the survival benefits were judged modest (HR for death, 0.79, with an absolute improvement in median survival of 2 months), and were not associated with improvements in toxicity or quality of life.
The ASCO and ESMO frameworks led to similar conclusions in the two examples, yielding higher benefit ratings for erlotinib in EGFR-mutated non-small cell lung cancer than for bevacizumab in unselected non-small cell lung cancer. The conclusions are consistent with the PBAC decision to fund erlotinib, but not bevacizumab, for the indications specified.
The simultaneous development of these frameworks highlights the global recognition that health care costs are increasing rapidly while resources are limited, and the need to establish rigorous assessments of the value of new treatments. This is important regardless of whether it is a jurisdiction or an individual deciding whether to pay for a new expensive anticancer drug.
In Australia, the Therapeutic Goods Administration (TGA) approves the marketing of new drugs based on safety and efficacy, but it is the PBAC that makes recommendations to the Health Minister, based on clinical and economic considerations, about which drugs should be PBS listed and hence funded by the government. In the United States, the Food and Drug Administration is the sole agency responsible for the approval of new drugs for marketing, but it is not permitted to consider cost or cost-effectiveness in its deliberations. The ASCO and ESMO frameworks allow policy makers and health care funders from different health care systems to consider the value of a new treatment together with local considerations such as costs, disease prevalence and competing priorities. These frameworks provide an independent, objective and structured approach that could increase the transparency of decisions made by the PBAC and similar agencies.
Clinicians should find the frameworks useful when assessing and explaining the value of new anticancer drugs, because they provide standardised metrics for expressing benefit. This should allow clearer communication with patients, particularly in situations where new treatments are unfunded, expensive and have modest benefits. The ESMO framework is probably easier to use and expresses value in simple grades. The ASCO framework is more complex, and expresses value with a numerical score that requires more explanation and interpretation. The ASCO plans further development of its framework to facilitate doctor–patient communication and shared decision making.4 An important enhancement would be the capacity for individuals and groups to assign weights to the factors that are most important to them. For example, some prioritise survival benefits regardless of cost or toxicity, whereas others prioritise quality of life over survival time. The incorporation of such weights would help communities, patients and doctors make decisions that better reflect their preferences.
The costs of health care are burgeoning and this approach warrants consideration beyond oncology. All treatments require rigorous assessments of efficacy, safety and cost-effectiveness. These frameworks provide important first steps towards standard definitions, metrics and criteria for assessing the value of new anticancer drugs.
Box – American Society of Clinical Oncology (ASCO) and European Society for Medical Oncology (ESMO) frameworks for evaluating clinical benefit in advanced cancer: worked examples
Domain |
ASCO framework |
ESMO framework |
|||||||||||||
Description |
Erlotinib v chemotherapy for EGFR-mutated NSCLC6 |
Bevacizumab + chemotherapy v chemotherapy alone for NSCLC7 |
Description |
Erlotinib v chemotherapy for EGFR-mutated NSCLC6 |
Bevacizumab + chemotherapy v chemotherapy alone for NSCLC7 |
||||||||||
Main outcome |
Maximum scores of 80 for doubling OS; 55 for doubling PFS; 40 for OTRR of 80%; lower scores for more modest improvements |
PFS prolonged by 4.3 months (87%) from 5.2 months in control group to 9.7 months in erlotinib group: score, 44 |
OS prolonged by 2.0 months (19%) from 10.3 months in control group to 12.3 months in bevacizumab group: score, 16 |
Preliminary grade from 1 (smallest improvement in OS or PFS) to 4 (biggest improvement in OS or PFS) |
PFS prolonged by 4.3 months from 5.2 months in control group to 9.7 months in erlotinib group (HR, 0.37): grade 3 |
OS prolonged by 2.0 months from 10.3 months in control group to 12.3 months in bevacizumab group (HR, 0.79): grade 2 |
|||||||||
Toxicity |
The number of severe toxicities differs between the treatment groups by 50% or more: score, − 20 to + 20 |
33% reduction from 12 in control group to 8 in erlotinib group: score, 0 |
46% increase from 15 in control group to 22 in bevacizumab group: score, 0 |
Upgrade one level if there is a statistically significant reduction in severe toxicities affecting daily wellbeing |
15% fewer severe toxicities: upgrade from preliminary grade 3 to grade 4 |
No significant reduction in severe toxicities: remains at preliminary grade 2 |
|||||||||
Other |
Significant palliation of symptoms: maximum score, 10 |
Symptoms no better: score, 0 |
Symptoms no better: score, 0 |
Upgrade one level if QOL improved |
QOL not improved: no upgrade |
QOL not improved: no upgrade |
|||||||||
TFI prolonged by ≥ 20%: maximum score, 20 |
TFI not prolonged by ≥ 20%: score, 0 |
TFI not prolonged by ≥ 20%: score, 0 |
|||||||||||||
Total score |
Net health benefit score: − 12 (more toxic and no benefit) to 130 (substantially better OS, TFI, symptoms and toxicity) |
44/130 |
16/130 |
Final adjusted clinical benefit grade: 1 (least benefit) to 5 (greatest benefit) |
Grade 4 |
Grade 2 |
|||||||||
HR = hazard ratio. NSCLC = non-small cell lung cancer. OS = overall survival. OTRR = overall tumour response rate. PFS = progression-free survival. QOL = quality of life. TFI = treatment-free interval. | |||||||||||||||
Competing interests
References
- Karikios DJ, Schofield D, Salkeld G, et al. Rising cost of anticancer drugs in Australia. Intern Med J 2014; 44: 458-463.
- Australian Institute of Health and Welfare 2012. Health expenditure Australia 2010–11 (Cat. No. HWE 56; Health and Welfare Expenditure Series No. 47). Canberra: AIHW.
- Weeks JC, Catalano PJ, Cronin A, et al. Patients’ expectations about effects of chemotherapy for advanced cancer. N Engl J Med 2012; 367: 1616-1625.
- Schnipper LE, Davidson NE, Wollins DS, et al. American Society of Clinical Oncology Statement: a conceptual framework to assess the value of cancer treatment options. J Clin Oncol 2015; 33: 2563-2577.
- Cherny NI, Sullivan R, Dafni U, et al. A standardised, generic, validated approach to stratify the magnitude of clinical benefit that can be anticipated from anti-cancer therapies: the European Society for Medical Oncology Magnitude of Clinical Benefit Scale (ESMO-MCBS). Ann Oncol 2015; 26: 1547-1573.
- Rosell R, Carcereny E, Gervais R, et al. Erlotinib versus standard chemotherapy as first-line treatment for European patients with advanced EGFR mutation-positive non-small-cell lung cancer (EURTAC): a multicentre, open-label, randomised phase 3 trial. Lancet Oncol 2012; 13: 239-246.
- Sandler A, Gray R, Perry MC, et al. Paclitaxel-carboplatin alone or with bevacizumab for non-small-cell lung cancer. N Engl J Med 2006; 355: 2542-2550.
Provenance: Not commissioned; externally peer reviewed.
Uneven Ground: Survival Differences Among Victorian Lung Cancer Patients by Location of Residence (2011–2023): A Retrospective Cohort Study
Evangeline Samuel, Eldho Paul, Mike Lloyd, Sanuki Tissera, Craig Underhill, Sagun Parakh, Phillip Parente, Inger Olesen, Javier Torres, Katharine See, Gavin M. Wright, David Langton, Thomas John, Matthew Conron, James Bartlett, Nicola Atkin, Nikolajs Zeps, Susan V. Harden, Wasek Faisal, John R. Zalcberg, Rob G. Stirling
Early-Onset Colorectal Cancer With Liver-Only Metastases: A Retrospective Cohort Study Integrating Prospectively Collected Real-World Clinical and Molecular Data From an Australian National Database (2009–2024) to Guide Treatment Planning
Savio G. Barreto, Christos S. Karapetis, Shahid Ullah, Matthew Burge, Susan Caird, Angus Campbell, Azim Jalali, Ross Jennens, Muhammad A. Khattak, Belinda Lee, Stephanie H. Lim, Shehara Mendis, Louise Nott, Timothy J. Price, Jeremy D. Shapiro, Jeanne Tie, Javier Torres, Colin Williams, Rachel Wong, Vanessa Wong, Peter Gibbs
Australian Pathways for Specialist Pain Management and Early Palliative Care for People With Pancreatic Cancer: Developed Using a Community Consensus Approach
Jennifer Philip, Melanie R. Lovell, Kylee Bellingham, Gail Garvey, Gregory B. Crawford, Nicole M. Rankin, Kara Burns, Isabel Young, Vivienne Milch, Dorothy Keefe, Katrina Anderson, James Lawson, Meinir Krishnasamy
Program Guidelines for the National Lung Cancer Screening Program: Targeted Lung Cancer Screening in High-Risk Individuals in Australia
Nicole M. Rankin, Rebecca Zosel, Lisa J. Whop, Raglan Maddox, Annette McWilliams, Miranda Siemienowicz, Jon Emery, Maria A. R. Lantin, Georgia Bartlett, Mikayla Wolfe, Abbey Diaz, Katrina Anderson, Lillian Liu, Cindy Toms, Sarah McDermott, Peter Bligh, Jeremy Chalke, Stephen Melsom, Claire E. Nightingale, Alison Brown, Sam Pope, Julia Brotherton, Anne Fidler, Michel Itel, Mark Brooke, Diane M. Pascoe, Fraser Brims, Tracy L. Leong, Emily Stone, Dorothy Keefe, Vivienne Milch
Beyond Mammography: Sovereignty and Relational Breast Care With Aboriginal and Torres Strait Islander Women
Devaleena Das, Jessica Gildersleeve, Amy Thomson, Aunty Gracelyn Smallwood, Lorelle Holland
Striving for Racial Equity in Oral Cancer Research: A Case Study
Sneha Sethi, Simon Naylor, Catherine Leane (Dharug/Gabrigal), Gail Garvey (Kamilaroi), Joanne Hedges (Yamatji), Lisa M. Jamieson, Nicolas Reid (Dharug/Gabrigal)