Introduction
The Cancer Drugs Fund (CDF) was established in 2010 by the UK government to provide patients with access to cancer drugs not available through the NHS, because the drugs had not been appraised, were in the process of being appraised, or had been appraised but not recommended by the National Institute of Health and Care Excellence (NICE). As well as reducing delays and improving access to cancer drugs within the NHS it also offered an opportunity to provide funding for orphan indications or rare conditions that NICE would ordinarily not appraise [1].
The CDF had an initial budget of £50 million per annum with the plan to move towards a value-based pricing scheme by 2014. However, the costs of maintaining the fund rapidly increased, with the budget set at £200 million in 2013/2014, £280 million in 2014/2015, and £340 million in 2015/2016. At the time of its unification with NICE (see Figure 1), the CDF had cost of UK taxpayer a total of £1.27 billion [2], the equivalent of 1 year’s total spend on all cancer drugs in the NHS [3].
Figure 1.
Current status of the CDF Nov 2016.
Despite an extensive public consultation, fundamental issues about whether the CDF was a beneficial and fair public policy decision that actually delivered value have been absent from the discourse. Such analysis is essential to inform pharmaceutical policy in other countries contemplating such patient access pathways for high-cost cancer drugs.
Methods
In this policy analysis, we review the utility of such patient access funds for pharmaceutical agents by assessing the value delivered to both individuals and society by the CDF. Six value criteria have been used in our analysis. This includes an assessment of:
- The index trial data that provided the evidence for the drugs’ efficacy
- Observational studies assessing the effectiveness of selected CDF approved drugs in ‘real world’ populations
- The value of approved drugs according to validated clinical benefit scales developed by The American Society of Clinical Oncology (ASCO) and The European Society for Medical Oncology (ESMO)
- Whether the drugs would meet cost-effectiveness thresholds set by NICE
- The CDF committee’s own review (in January and November 2015) of drugs they had approved
- The value delivered by CDF-approved drugs to NHS patients based on utilization patterns
These criteria were chosen as they provide a multi-dimensional approach to assessing value in the absence of clinical data on outcomes for patients receiving drugs through the CDF. The first measures clinical efficacy based on the index clinical trial data, and the second, the translation of trial efficacy to a real world population in light of the socio-demographic make-up of trial participants. The third criteria goes beyond a simple evaluation of absolute study end-points to assess meaningful benefit according to value scales developed by two professional bodies, ASCO and ESMO.
The fourth looks at the issue of distributive justice by assessing cost-effectiveness according to health technology assessment frameworks, in this case NICE. The fifth criteria, represents an evaluation of the CDF committee’s own audit of each of the approved drugs and indications using their own value framework undertaken in January and November 2015. The sixth and final criteria collates the evidence for value based on patterns of use of CDF drugs (dose, volume) where data is available and the likely benefits that have been derived when considering the index trial data.
We focus on the systemic therapies that were made available and could be prescribed through the CDF prior to the January 2015 update when the fund was first rationalized [4]. Up to this point, 29 drugs had been approved for 47 indications, three of which—bevacizumab (9), cetuximab (4), and everolimus (3)—had been approved for more than two indications.
Results
Did sufficient clinical evidence exist to suggest patients would benefit from CDF approved drugs?
On review of the index trial data for the 47 drug indications approved by the CDF [5–53], only 18 (38%) reported a statistically significant overall survival (OS) benefit (Table 1) [5–7, 9, 13, 14, 18, 20, 23, 26, 27, 38, 41, 44, 45, 47, 50, 51] The median OS benefit was 3.2 months, ranging from 1.4 months (hazard ratio 0.82) for aflibercept in metastatic bowel cancer [6] to 15.7 months (HR 0.68) for pertuzumab in first line metastatic Her-2 positive breast cancer [44].
Table 1
Details of the cancer drugs available through the NHS Cancer Drugs Fund prior to the first update in January 2015
Drug |
Site |
Indication |
Author of index trial [REF] |
Primary endpoint (s) |
Median age |
PS 0/1 (%) |
PFS (HR) |
OS (HR) |
Approval on ASCO criteria |
ESMO score |
NICE status Jan 2015 |
CDF status Jan 2015 |
CDF status Nov 2015 |
Abiraterone |
Prostate |
1st line CRPC (pre chemo) |
Ryan 2014 [5] |
PFS/OS |
71 |
100 |
8.3 (0.53) |
4.3 (0.80) |
Yes |
3 |
Not approved |
Approved |
Approved |
Aflibercept |
Bowel |
2nd line metastastic CRC with irinotecan/5FU |
Van Cutsem 2012 [6] |
OS |
61 |
98 |
2.2 (0.76) |
1.4 (0.82) |
No |
1 |
Not approved |
Removed |
Removed |
Albumin bound paclitaxel |
Pancreas |
1st line metastatic pancreatic cancer with gemcitabine |
Von Hoff 2013 [7] |
OS |
63 |
KS > 80 = 92% |
1.8 (0.69) |
1.8 (0.72) |
No |
3 |
Not approved |
Approved |
Removed |
Axitinib |
Renal |
2nd line advanced RCC |
Motzer 2013 [8] |
PFS |
61 |
99 |
2.6 (0.66) |
NS |
No |
3 |
Awaiting appraisal |
Approved |
Approved by NICE therefore removed |
Bevacizumab |
Cervix |
1st line Metastatic cervical ca |
Tewari 2014 [9] |
OS/Toxicity |
46 |
96 |
2.3 (0.67) |
3.7 (0.71) |
Yes |
3 |
Awaiting appraisal |
Approved |
Approved |
Bevacizumab |
Breast |
Metastatic triple negative breast cancer |
Miller 2007 [10] |
PFS |
56 |
98 |
5.9 (0.6) |
NS |
No |
2 |
Not approved |
Approved |
Removed |
Bevacizumab |
Bowel |
1st line advanced CRC with 5FU |
Cunningham 2013 [11] |
PFS |
76 |
91 |
4 (0.53) |
NS |
No |
2 |
Not appraised |
Removed |
Removed |
Bevacizumab |
Bowel |
1st line metastatic CRC with oxaliplatin based regimen |
Saltz 2008 [12] |
PFS |
60 |
100 |
1.4 (0.83) |
NS |
No |
1 |
Not approved |
Removed |
Removed |
Bevacizumab |
Bowel |
1st line metastatic CRC with irinotecan based regimen |
Hurwitz 2004 [13] |
OS |
59 |
99 |
4.4 (0.54) |
4.7 (0.66) |
Yes |
3 |
Not approved |
Removed |
Removed |
Bevacizumab |
Bowel |
2nd line/3rd line metastatic CRC with oxaliplatin based chemo |
Giantonio 2007 [14] |
OS |
61 |
96 |
2.6 (0.61) |
2.1 (0.75) |
No |
2 |
Not approved |
Approved |
Removed |
Bevacizumab |
Bowel |
3rd line in low grade gliomas of childhood with irinotecan |
Gururangan 2013 [15] |
PFS |
8.4 |
KS > 50 = 100% |
PFS 85% at 6 months, 48% at 2 yrs |
NR |
Uncertain |
2 |
Not appraised |
Approved |
Approved |
Bevacizumab |
Ovarian |
1st line advanced ovarian, peritoneal or fallopian cancer |
Burger 2011 [16] |
PFS |
60 |
93 |
3.8 (0.72) |
NS |
No |
3 |
Not approved |
Approved |
Approved |
Bevacizumab |
Ovarian |
2nd line advanced ovarian, fallopian or primary peritoneal cancers (platinum sensitive) |
Aghajanian 2012 [17] |
PFS |
61 |
99.5 |
4 (0.48) |
NS |
No |
3 |
Not approved |
Removed |
Removed |
Cabazitaxel |
Prostate |
Metastatic CRPC previously treated with docetaxel |
De bono 2010 [18] |
OS |
67 |
93 |
1.4 (0.7) |
2.4 (0.7) |
No |
2 |
Not approved |
Removed |
Reinstated |
Cabozantinib |
Thyroid |
1st line advanced medullary thyroid cancer |
Elisei 2013 [19] |
PFS |
55 |
56% PS = 0 |
7.2 (0.28) |
NS |
Yes |
2 |
Awaiting appraisal |
Approved |
Approved |
Cetuximab |
Head and Neck cancer |
Advanced Head and Neck Cancer |
Vermoken 2008 [20] |
OS |
57 |
KS > 80 = 80% |
2.3 (0.54) |
2.7 (0.8) |
No |
3 |
Not approved |
Approved |
Approved |
Cetuximab |
Bowel |
1st line metastatic CRC (K ras wild type) with oxaliplatin or irinotecan based regimens |
Tejpar 2012 [21] |
Pooled subgroup analysis |
60 |
95 |
1.4 (0.47) |
NS |
Yes |
3 |
Not approved for all indications |
Approved |
Approved |
Cetuximab |
Bowel |
2nd or 3rd line treatment of metastatic CRC (K ras wild type) with irinotecan |
Sobrero 2008 [22] |
OS |
61 |
94 |
2.4 (0.69) |
NS |
No |
1 |
Not approved |
Removed |
Removed |
Cetuximab |
Bowel |
3rd or 4th line metastatic CRC (K ras wild type) as single agent |
Karapetis 2008 [23] |
OS |
63 |
80 |
1.8 (0.40) |
4.7 (0.55) |
Yes |
4 |
Not approved |
Approved |
Removed |
Crizotinib |
Lung |
2nd line ALK +ve advanced/metastastic NSCLC |
Shaw 2013 [24] |
PFS |
51 |
92 |
4.7 (0.49) |
NR |
Yes |
4 |
Not approved |
Approved |
Approved |
Dabrafenib |
Melanoma |
Unresectable or metastatic melanoma with a BRAF V600 mutation and intolerance to Vemurafenib |
Hauschild 2014 [25] |
PFS |
52 |
66% PS = 0 |
2.4 (0.3) |
NR |
Yes |
4 |
Appraisal ongoing |
Approved |
Approved by NICE therefore removed |
Enzalutamide |
Prostate |
1st line CRPC (pre-chemo) |
Beer 2014 [26] |
PFS/OS |
72 |
100 |
>12 months (0.19) |
2.2 (0.71) |
Uncertain |
3 |
Awaiting appraisal |
Approved |
Approved |
Eribulin |
Breast |
3rd line metastatic breast cancer |
Cortes 2011 [27] |
OS |
55 |
92 |
1.5 (0.87) |
2.5 (0.81) |
No |
2 |
Not approved |
Removed |
Reinstated |
Everolimus |
Breast |
Metastatic breast cancer in combination with exemestane |
Baselga 2012 [28]/Piccart 2014 [29] |
PFS |
62 |
96 |
4.6 (0.43) |
NS |
No |
2 |
Not approved |
Removed |
Reinstated |
Everolimus |
PNET |
1st or 2nd line moderately differentiated PNET |
Yao 2011/2014 [30,31] |
PFS |
58 |
97 |
6.4 (0.27) |
NS |
No |
2 |
Awaiting appraisal |
Approved |
Removed |
Everolimus |
PNET |
Well differentiated PNET |
Yao 2011/2014 [30,31] |
PFS |
58 |
97 |
6.4 (0.27) |
NS |
No |
2 |
Awaiting appraisal |
Removed |
Removed |
Everolimus |
Renal |
Metastatic RCC |
Motzer 2010 [32] |
PFS |
61 |
KS > 80 = 91% |
3 (0.33) |
NS |
No |
3 |
Not approved |
Removed |
Reinstated |
Imatinib |
Sarcoma (GIST) |
Adjuvant therapy for completely resected GIST at high relapse risk |
Dematteo 2009 [33] |
RFS |
59 |
99 |
RFS gain 13% |
NR |
Yes |
A |
Awaiting appraisal |
Approved |
Approved by NICE therefore removed |
Lapatinib |
Breast |
Advanced breast cancer, Her 2 +ve |
Geyer 2006 [34]/cameron 2008 [35] |
PFS |
54 |
100 |
4 (0.47) |
NS |
No |
3 |
Not approved |
Removed |
Removed |
Panitumimab |
Bowel |
3rd or 4th line metastatic CRC (Kras wild type) as single agent |
Van Cutsem 2007 [36] |
PFS |
62 |
82 |
1.1 (0.54) |
NS |
No |
2 |
Not approved |
Approved |
Removed |
Panitumimab |
Bowel |
1st line metastatic CRC with Folofox 4 or irinotecan (Kras wild type) |
Douillard 2010 [37]/Douillard 2014 [38] |
PFS |
62 |
94 |
1.4 (0.80) |
4.4 (0.88) |
Yes |
3 |
Awaiting appraisal |
Approved |
Approved |
Pazopinib |
Sarcoma |
Advanced non-adipocytic soft tissue carcinoma |
van der Graaf 2012 [39] |
PFS |
56 |
100 |
3 (0.31) |
NS |
No |
2 |
Not appraised |
Removed |
Removed |
Pegylated liposomal doxirubicin |
Sarcoma |
1st or 2nd line for angiosarcoma |
Judson 2001 [40] |
Toxicity/RR |
52 |
86 |
NA |
NA |
Uncertain |
Uncertain |
Not appraised |
Removed |
Removed |
Pegylated liposomal doxirubicin |
Sarcoma |
For patients with sarcoma with cardiac impairment or contraindication to doxorubicin |
Judson 2001 [40] |
Toxicity/RR |
52 |
86 |
NA |
NA |
Uncertain |
4 |
Not appraised |
Approved |
Approved |
Pemtrexed |
Lung |
Maintenance post 4 cycles cisplatin/pemetrexed for NSCLC |
Ciuleanu 2009 [41] |
PFS |
60 |
100 |
1.7 (0.5) |
2.8 (0.79) |
Yes |
2 |
Not approved |
Removed |
Reinstated |
Pemetrexed |
Lung |
2nd line NSCLC |
Hanna 2004 [42] |
OS |
59 |
88 |
NS |
NS |
No |
1 |
Not approved |
Removed |
Removed |
Lutetium Octreotate/Yttrium Octreotide |
NETs |
For inoperable well-differentiated neuroendocrine tumours (NETs) with progressive disease |
Kam 2012 [43] |
Symptoms/tumour regression |
NR |
NR |
NA |
NA |
No |
1 |
Not appraised |
Approved |
Removed |
Pertuzumab |
Breast |
1st line locally advanced Her2 +ve breast cancer |
Swain 2013 [44] |
PFS |
54 |
99 |
6.3 (0.69) |
15.7 (0.68) |
Yes |
4 |
Not approved |
Approved |
Approved |
Radium 223 |
Prostate |
CRPC and bone mets, no visceral mets |
Parker 2013 [45] |
OS |
71 |
87 |
NR |
3.6 (0.7) |
Yes |
5 |
Awaiting appraisal |
Approved |
Approved by NICE therefore removed |
Regorafinib |
Sarcoma (GIST) |
Imatinib and sunitinib resistant GIST |
Demetri 2013 [46] |
PFS |
60 |
100 |
3.9 (0.27) |
NR |
No |
3 |
Not appraised |
Removed |
Reinstated |
Sorafenib |
Liver |
1st line HCC |
Llovet 2008 [47] |
OS/Time to symptom progression |
65 |
92 |
2.7 (0.58) |
2.8 (0.69) |
Yes |
3 |
Not approved |
Approved |
Approved |
Sorafenib |
Thyroid |
Metastatic/inoperable thyroid cancer refractory to radioiodine |
Brose 2014 [48] |
PFS |
63 |
97 |
5 (0.8) |
NR |
Yes |
2 |
Not appraised |
Approved |
Approved |
Sunitinib |
PNET |
well differentiated PNET |
Raymond 2011 [49] |
PFS |
56 |
100 |
5.9 (0.42) |
Trial stopped early |
Uncertain |
2 |
Not appraised |
Approved |
Approved |
Temsirolimus |
Renal |
Advanced RCC |
Hudes 2007 [50] |
OS |
59 |
KS > 70 = 17% |
2.4 |
3.6 (0.73) |
Yes |
4 |
Not approved |
Approved |
Approved |
Trastuzumab emtansine (Kadcyla) |
Breast |
Relapsed Her 2 +ve breast cancer |
Verma 2012 [51] |
PFS/OS and safety |
53 |
99 |
3.2 (0.65) |
5.8 (0.68) |
Yes |
5 |
Not approved |
Approved |
Approved |
Vandetinib |
Thyroid |
Medullary thyroid ca |
Wells 2012 [52] |
PFS |
51 |
96 |
11.2 (0.46) |
NR |
Yes |
2 |
Not appraised |
Approved |
Approved |
Vismodegib |
Skin |
Metastatic basal cell cancer |
Sekulic 2012 [53] |
Objective response rate |
62 |
NR |
NA |
NA |
Uncertain |
2 |
Not appraised |
Approved |
Approved |
Of the remaining 29 indications in the CDF, 17 were approved despite no statistically significant OS benefit being observed in the index trials. These included axitinib [8] bevacizumab (five indications) [10–12, 16, 17], cabozantinib [19], cetuximab (two indications) [21, 22], everolimus (four indications) [29–32], lapatinib [35], panitumimab [36], pazopanib [39], and pemetrexed [42]. The primary end-point of 14 of these studies was PFS, of which five allowed cross-over of the control population at progression to the intervention arm [30–32, 35, 36] and one had significant post-study utilization (49.6%) of the intervention drug among the control arm [22].
12 further indications had been approved without OS data being available. The primary end-point in the index trial for eight of these indications was PFS [15, 24, 25, 33, 36, 46, 48, 49, 52] of which five allowed cross-over of the control population at progression [24, 25, 46, 48, 52]. The other four indications were not able to report any PFS or OS benefit as they were based on noncomparator studies [40, 43, 53].
Given that over half of the drug indications (n = 29) approved by the CDF lacked any OS benefit, it is valid to ask whether a gain in PFS is a meaningful surrogate endpoint for OS. While we acknowledge this is a subject of much debate as there are differences of opinion as to what constitutes benefit, there is unanimity that prolongation of OS is an unequivocal benefit and desired [54–57]. From a patient’s perspective, a gain in PFS may not equate to a clinical benefit given the serious toxicities that arise from many of these therapies, including those classified as ‘targeted’ and the fact that progression often occurs without any symptoms such that delaying progression is not delaying symptoms [58].
Furthermore, the extent to which benefits claimed in clinical trials are true can be debated. For end-points such as OS and PFS, it is expected that all patients randomized at the start of the study are followed up until either the end point is reached or the study is completed (intention-to-treat analysis). If a patient is censored prior to the end point being reached, their outcome is estimated based on other patients in the same arm who have not reached the end point, but have been under longer follow-up. This will result in an over-estimation of benefit if their reason for being censored is linked to their prognosis, i.e. toxicity, low participation in follow-up, or the initiation of an alternative therapy [59]. This type of censoring is more common in the assessment of PFS compared with OS where censoring predominantly occurs as a result of a death [60].
In PFS analyses, censoring is often driven by drug toxicity and the extent of censoring as regards PFS has been increasing in many trials (disproportionately so in the experimental arm) rendering the results questionable as to the true benefit observed [61, 62]. Several of the indications for drug funding on the CDF were based on trials in which excessive censoring was a feature [19, 28, 30]. For everolimus plus exemestane in breast cancer, the 4.4 months difference in OS was not significant although the PFS difference of 4.6 months was highly significant albeit in the setting of excessive censoring in the everolimus arm due to toxicity [28, 62].
Could the reported clinical trial benefits be realized in the ‘real world’?
Randomized control trials (RCTs), have strong internal validity through randomization, pre-specified end points and blinding, however their external validity is limited [63]. This is because patients similar to those frequently encountered in a clinical practice are often excluded, raising questions as to the generalizability of clinical trial results to populations, settings or conditions not reflected in the trial [64, 65].
For example, the median age of study participants in the index trials of CDF approved drugs was 60 (Table 1). Over 90% of the study populations had an Eastern cooperative oncology group (ECOG) performance status score of 0 or 1 (or equivalent) in the majority of the trials. The under-representation of men and women over 65 in RCTs is a long-standing issue [66, 67]. As a result, decision-makers are expressing interest in ‘real world data’ [68].
In metastatic renal cell carcinoma (mRCC), data from the ‘real world’ provide a sobering assessment of outcomes. The International Metastatic Renal Cell Carcinoma Database consortium study found that the 35% of patients that did not meet trial eligibility criteria had a disappointing 12.3 months survival compared with 28.4 months survival in those that would have been deemed trial-eligible [69]. A recent study that analysed the SEER 18 (Surveillance, Epidemiology and End Results) registry database to calculate the relative survival rates for advanced RCC patients during 2001–2005, 2006–2007 and 2008–2009 concluded there was no significant improvement in relative survival rates among patients with mRCC in the era of targeted agents [70].
Increased rates of toxicity are also observed in real world populations. A US SEER database study evaluated the effectiveness of adding bevacizumab to first-line combination chemotherapy for Medicare patients (aged 65 years and over) with metastatic colorectal cancer (mCRC) [71]. The data showed unequivocally there was no benefit to adding bevacizumab to FOLFOX-based regimens in this Medicare population, but importantly the addition of bevacizumab increased the risk of stroke (4.9% versus 2.5%, respectively; P<0.01) and GI perforation (2.3% versus 1.0%, respectively; P<0.01).
From a clinical standpoint would oncologists consider the predicted benefits of the CDF approved drugs to be clinically meaningful?
In many cases, the answer appears to be no. In 2014, The American Society of Clinical Oncology (ASCO) published what it considered meaningful clinical benefit in the hopes the design of future clinical trials would produce results that would be valuable for patients, i.e. meaningful improvements in survival, quality of life or both [72]. The ASCO Cancer Research Committee (CRC) that developed the criteria deliberately chose modest threshold to ensure their relevance and attainability. OS was chosen as the primary clinical end-point of interest and minimum gains in survival and HR thresholds were defined for each tumour type, virtually all in the metastatic setting. Secondary end-points included PFS, and thresholds for OS and PFS were adjusted depending on the toxicity profile of the drug.
An analysis of drugs approved by the FDA between 2002 and 2014 for the treatment of solid tumours found that only 42% of the 71 approved drugs met the ASCO or comparable standards [73]. Similarly, only 23 (48%) of the 47 CDF approved drug indications met the very modest ASCO criteria with uncertainty regarding six drug indications (see Table 1).
In 2015, The European Society for Medical Oncology (ESMO), produced further guidelines (following consultation with over 250 of its expert membership) to stipulate the boundaries for meaningful clinical benefit [74]. The scoring scheme was based on:
- Treatment intent (curative versus noncurative)
- Expected duration of PFS and OS in the control arm
- PFS or OS benefit including the hazard ratios
- Evidence of improved or worsening toxicity profiles
- Evidence for improvement in quality of life
Cancer drugs indicated in the noncurative setting are scored 1 (lowest) to 5 (highest), and those in the curative setting are graded A (highest) or B (lowest). Drugs scoring 4, 5 or A are considered to provide a high level of proven clinical benefit according to the criteria. Our analysis of the 47 drug indications on the CDF found that only 9 (18%) indications achieved scores of 4, 5 or A, (see Table 1) while 23 (50%) of drug indications scored 2 or less on the ESMO scale, i.e. they were based on study data which had demonstrated limited evidence of clinical benefit. The nine indications that met ESMO criteria for meaningful clinical benefit included, cetuximab for colorectal cancer [23], crizotinib for lung cancer [24], dabrafenib for metastatic melanoma [25], imatinib as adjuvant therapy for GIST [33], pertuzumab and trastuzumab emtansine for breast cancer [44, 51], temsirolimus for renal cell cancer [50], radium 223 for prostate cancer [45] and pegylated doxorubicin for sarcoma [40].
Would an HTA body, in this instance NICE, consider the benefits of drugs on CDF of sufficient value to be reimbursed?
In the UK, NICE is responsible for ensuring rational and fair decisions are made on resource allocations by performing cost effectiveness analyses for new health interventions. The advantage of the cost per QALY is its universality when making decisions regarding the entire spectrum of health care interventions across all specialities [75]. NICE focus on both short and long-term outcomes of treatment and direct patient benefits [76].
We found that 26 (55%) CDF approved drugs had previously been rejected by NICE on the grounds of not meeting cost effectiveness criteria. Three (dabrafenib, imatinib and radium 223) were due to receive approval in early 2015 (Table 1). Seven were awaiting appraisal but draft consultation advice had been issued. Eleven indications had not been appraised and no plans for their assessment were evident. In some cases, this was due to the rarity of the disease (e.g. regorafenib, in soft tissue sarcoma) or their off-label use (bevacizumab third line in paediatric low-grade glioma).
What the CDF committee considered the value of CDF approved drugs to be?
The CDF committee undertook detailed assessment of each of the drugs listed in its access scheme in January and November 2015 using a bespoke framework to assess its value. This included, but was not limited to, PFS, OS, quality of life, toxicity, unmet need and cost [77]. In total, 24 indications (51% of all indications) for 14 drugs were removed from the CDF list following this appraisal, of which six were later reinstated.
Table 2 summarizes details about four drugs whose value to the NHS can be debated: bevacizumab, lapatinib, cetuximab, and everolimus. These four drugs were approved by the CDF for 18 separate indications—bevacizumab (9), cetuximab (4), everolimus (4) and lapatinib (1). Following the initial review of the CDF in January 2015, nine of these indications were delisted. A further four indications were delisted in November 2015, following a subsequent review. The value delivered by bevacizumab in particular is debatable given that six of the nine indications were delisted. Only one of these indications would have met ASCO criteria and none would have achieved the ESMO meaningful clinical benefit criteria, or NICE cost-effective thresholds.
Table 2
Details of four drugs—bevacizumab, cetuximab, everolimus and lapatinib—which were approved by the CDF for 18 separate indications prior to January 2015
Drug |
Site |
Indication |
Author of index trial [REF] |
PFS (HR) |
OS (HR) |
Approval on ASCO criteria |
ESMO score |
NICE status Jan 2015 |
CDF status Jan 2015 |
CDF status Nov 2015 |
Bevacizumab |
Cervix |
1st line metastatic cervical ca |
Tewari 2014 [9] |
2.3 (0.67) |
3.7 (0.71) |
Yes |
3 |
Awaiting appraisal |
Approved |
Approved |
Bevacizumab |
Breast |
Metastatic triple negative breast cancer |
Miller 2007 [10] |
5.9 (0.6) |
NS |
No |
2 |
Not approved |
Approved |
Removed |
Bevacizumab |
Bowel |
1st line advanced CRC with 5FU |
Cunningham 2013 [11] |
4 (0.53) |
NS |
No |
2 |
Not appraised |
Removed |
Removed |
Bevacizumab |
Bowel |
1st line metastatic CRC with oxaliplatin-based regimen |
Saltz 2008 [12] |
1.4 (0.83) |
NS |
No |
1 |
Not approved |
Removed |
Removed |
Bevacizumab |
Bowel |
1st line metastatic CRC with irinotecan-based regimen |
Hurwitz 2004 [13] |
4.4 (0.54) |
4.7 (0.66) |
Yes |
3 |
Not approved |
Removed |
Removed |
Bevacizumab |
Bowel |
2nd line/3rd line metastatic CRC with oxaliplatin-based chemo |
Giantonio 2007 [14] |
2.6 (0.61) |
2.1 (0.75) |
No |
2 |
Not approved |
Approved |
Removed |
Bevacizumab |
Bowel |
3rd line in low-grade gliomas of childhood with irinotecan |
Gururangan 2013 [15] |
PFS 85% at 6 months, 48% at 2 yrs |
NR |
Uncertain |
2 |
Not appraised |
Approved |
Approved |
Bevacizumab |
Ovarian |
1st line advanced ovarian, peritoneal or fallopian cancer |
Burger 2011 [16] |
3.8 (0.72) |
NS |
No |
3 |
Not approved |
Approved |
Approved |
Bevacizumab |
Ovarian |
2nd line advanced ovarian, fallopian or primary peritoneal cancers (platinum sensitive) |
Aghajanian 2012 [17] |
4 (0.48) |
NS |
No |
3 |
Not approved |
Removed |
Removed |
Cetuximab |
Head and Neck cancer |
Advanced head and neck cancer |
Vermoken 2008 [20] |
2.3 (0.54) |
2.7 (0.8) |
No |
3 |
Not approved |
Approved |
Approved |
Cetuximab |
Bowel |
1st line metastatic CRC (K ras wild-type) with oxaliplatin or irinotecan-based regimens |
Tejpar 2012 [21] |
1.4 (0.47) |
NS |
Yes |
3 |
Approved for specific indications |
Approved |
Approved |
Cetuximab |
Bowel |
2nd or 3rd line treatment of metastatic CRC (K ras wild-type) with irinotecan |
Sobrero 2008 [22] |
2.4 (0.69) |
NS |
No |
1 |
Not approved |
Removed |
Removed |
Cetuximab |
Bowel |
3rd or 4th line metastatic CRC (K ras wild-type) as single agent |
Karapetis 2008 [23] |
1.8 (0.40) |
4.7 (0.55) |
Yes |
4 |
Not approved |
Approved |
Removed |
Everolimus |
Breast |
Metastatic breast cancer in combination with exemestane |
Baselga 2012 [28]/Piccart 2014 [29] |
4.6 (0.43) |
NS |
No |
2 |
Not approved |
Removed |
Reinstated |
Everolimus |
PNET |
1st or 2nd line moderately differentiated PNET |
Yao 2011/2014 [30, 31] |
6.4 (0.27) |
NS |
No |
2 |
Awaiting appraisal |
Approved |
Removed |
Everolimus |
PNET |
Well differentiated PNET |
Yao 2011/2014 [30, 31] |
6.4 (0.27) |
NS |
No |
2 |
Awaiting appraisal |
Removed |
Removed |
Everolimus |
Renal |
Metastatic RCC |
Motzer 2010 [32] |
3 (0.33) |
NS |
No |
3 |
Not approved |
Removed |
Reinstated |
Lapatinib |
Breast |
Advanced breast cancer, Her 2 +ve |
Geyer 2006 [34]/Cameron 2008 [35] |
4 (0.47) |
NS |
No |
3 |
Not approved |
Removed |
Removed |
In this respect, the criteria and value judgements initially used by the CDF has been criticized for its lack of rigour and relevance for prioritizing drugs for reimbursement through the fund [78]. The tabulation also underscores the fluid nature of the CDF and raises questions as to whether approvals were occurring too quickly or are being driven by factors other than academic/scientific considerations.
Is there any evidence that the CDF has been of value to NHS cancer patients?
At the time of commencement in 2010, it was expected that basic outcome data would be collected from April 2012 including the date of treatment cessation, side effects observed, 30-day mortality and date of death/next relapse. However, even after audit data collection became mandatory in 2014, 93% of outcome data was incomplete for 2014–2015 [79].
We therefore have no evidence as to whether recipients of drugs from the CDF derived any meaningful benefit in terms of survival, improved quality of life or decreased episodes of toxicity. As a proxy, we have attempted to define the value achieved by NHS cancer patients receiving cancer drugs through the CDF by assessing actual patterns of drug utilization, in conjunction with their anticipated benefits according to the original trial data.
Stephens and Thomson in 2012 [80] using IMS health dispensing data demonstrated that between April and December 2011, 59% of CDF applications were for five drugs: bevacizumab, lapatinib, sorafenib, cetuximab, and everolimus; a prescribing pattern confirmed by Chamberlain et al. in a subsequent analysis examining the period from October 2007 to October 2012 [81]. No data on the volume of drugs utilized has since been made available, nor information on patient weight or number of cycles completed by each patient.
The study reported that following the introduction of the CDF there were statistically significant increases in utilization of bevacizumab (2-fold), and lapatinib (3-fold), and these together with sorafenib, cetuximab, and sunitinib constituted a significant proportion of drug prescriptions. The exact indication for which these drugs were prescribed remains unknown. Analysis of the volume data found that the growth in drug utilization was lower than expected when compared with the doses and duration of treatment received by patients enrolled in the original RCTs. This is therefore likely to reflect earlier disease progression, or the occurrence of intolerable adverse events, suggesting their clinical effectiveness and tolerability do not match results in the RCTs [82]. In addition, there was evidence of inequitable access to the fund across English regions (2010–2013) and according to age and sex [79, 83].
This then raises concerns that the ‘real benefits’ in fact are not benefits at all since they would never have achieved statistical validity in a RCT or if they did, may not have been of sufficient magnitude to warrant the added toxicity that invariably occurs. Keeping in mind the median OS benefit of CDF-approved indications was 3.1 months can we be sure that 1 month less than this would be statistically better or better enough to favourably tip the risks to benefits scale?
Discussion and policy recommendations
Because some argued that UK lagged behind other Western countries in delivering therapies to cancer patients and this could lead to disparity in outcomes, the CDF was established to ensure access to drugs available in other countries [84]. In this respect, the CDF has delivered its intended aims. However, we would argue from this analysis that the CDF has not provided meaningful value to cancer patients and wider society because the supporting data has been wanting.
The majority of CDF-approved indications have been based on studies that reported minimal to no benefit in survival. Other endorsements have relied on surrogate endpoints such as PFS that remain controversial given inherent flaws in trial design and the increasing abuse of censoring. The thresholds for meaningful clinical benefit proposed by ASCO or ESMO support our argument since the majority of CDF-approved indications were unable to meet these modest levels of efficacy (Table 1).
Patients would find many of the approved indications wanting as regards actual benefit, even before considering the burden of the associated toxicities [85]. Current evidence suggests the majority of cancer patients with a life expectancy ≤4 months prefer treatment that relieves pain and discomfort rather than extending life [86] and that they expect a minimum survival benefit of 3 months in this setting and potentially longer if the therapy is associated with more severe side effects [87, 88].
We must also consider the welfare loss to society from the CDF after expenditure of over one billion pounds [79]. An impact equality assessment of the CDF has been undertaken for patients receiving cancer drugs through the CDF in 2013/2014 (n = 19 560)[79]. It reported that the potential benefit of the CDF to cancer patients, estimated at 3500 QALYS, has resulted in overall net harm to population health when one considers the health opportunity costs, with nearly 18 000 QALYS being displaced from patients elsewhere in the NHS [89, 90]. It is important therefore, to tread with caution when arguments are forwarded that all cancer drugs offering meaningful clinical benefit should be funded irrespective of price, without considering issues of value, distributive justice, and fairness. In the NHS, waiting times for diagnostic interventions and elective procedures continue to rise, many of which are directly affecting cancer patients [91].
At its inception, critics argued that the introduction of the CDF would reduce the negotiating power of the NHS, specifically the ability to negotiate fair prices of cancer drugs with pharmaceutical companies [81]. This is no more evident than when one considers the reversals of six indications delisted in January 2015 (see Table 3). None of the reinstated indications meet the criteria for clinical benefit according to the ESMO scale. However, negotiations were prompted by the threat of the drug being delisted, suggesting that the creation of a ring fenced access fund for cancer drugs provides a negative incentive for drug price negotiation. This is especially pertinent given recent evidence that the price of drugs is based on what the market will bear as opposed to the level of its clinical benefit [92]. Cabazitaxel, eribulin, and everolimus (for breast cancer) have all since been approved by NICE as a result of discounts being applied by pharmaceutical companies through the patient access scheme [93–95].
Table 3
Details of the six de-listed drugs, which were re-approved by the CDF following a second review in November 2015
Drug |
Site |
Indication |
Author of index trial [REF] |
PFS (HR) |
OS (HR) |
Approval on ASCO criteria |
ESMO score |
NICE status Jan 2015 |
CDF status Jan 2015 |
CDF status Nov 2015 |
Cabazitaxel |
Prostate |
Metastatic CRPC previously treated with docetaxel |
De bono 2010 [18] |
1.4 (0.7) |
2.4 (0.7) |
No |
2 |
Not approved |
Removed |
Reinstated |
Eribulin |
Breast |
3rd line metastatic breast cancer |
Cortes 2011 [27] |
1.5 (0.87) |
2.5 (0.81) |
No |
2 |
Not approved |
Removed |
Reinstated |
Everolimus |
Breast |
Metastatic breast cancer in combination with exemestane |
Baselga 2012 [28]/Piccart 2014 [29] |
4.6 (0.43) |
NS |
No |
2 |
Not approved |
Removed |
Reinstated |
Everolimus |
Renal |
Metastatic RCC |
Motzer 2010 [32] |
3 (0.33) |
NS |
No |
3 |
Not approved |
Removed |
Reinstated |
Pemtrexed |
Lung |
Maintenance post 4 cycles cisplatin/pemetrexed for NSCLC |
Ciuleanu 2009 [41] |
1.7 (0.5) |
2.8 (0.79) |
Yes |
2 |
Not approved |
Removed |
Reinstated |
Regorafinib |
Sarcoma (GIST) |
Imatinib and sunitinib resistant GIST |
Demetri 2013 [46] |
3.9 (0.27) |
NR |
No |
3 |
Not appraised |
Removed |
Reinstated |
Given the evidence set forth, decisions regarding access appear politically motivated. The CDF was created following intense public and political pressure to provide access no matter what the cost or the evidence for their benefit. There was no stated estimation of the ‘number of lives that could be saved’, nor, more realistically, of the number of lives that may be extended. This was a debate played out in the media, limiting the role of NICE as the final arbiter for deciding what constitutes optimal value for society [82]. However, 6 years later, and after considerable expenditure we are now reverting to a pre-existing format, namely an independent health technology appraisal service (i.e. NICE) providing recommendations for NHS commissioning (see Figure 1).
Indeed, the evidence used by the CDF committee to re-appraise the value of drugs in January 2015 was in most cases available prior to the approval process, especially in circumstances where NICE had already undertaken an HTA appraisal. Of the 17 indications delisted in January 2015, 13 were for indications that were previously deemed not cost-effective by NICE (Table 1). A further seven indications were delisted in November 2015 of which five had been rejected following NICE appraisal. While these reversals may seem innocent, if a drug approved for an indication is subsequently deemed of insufficient value as data become available and its benefit is questioned we must acknowledge that it has then been given to patients who may have endured toxicity without any benefit.
Finally, while the stated goal of the CDF was to ‘empower clinicians, and to enable them to use the cancer drugs that they and their patients agree are needed to extend or improve life’, it is reasonable to ask why so many clearly ineffective drugs were prescribed in the first place. The issues are complex and cannot be answered without in-depth qualitative research. However, two factors may be important. The first is the so-called ‘moral hazard’. When patients and providers are shielded from the costs associated with an intervention (through insurance per se), they will be more willing to accept/deliver health care interventions even if the benefits are marginal [96]. Second, decision-making in the context of illness has been shown to be prone to biases resulting in an over-estimation of the level of risk of disease or potential benefits of treatment [97, 98].
Future options
One lesson from this costly saga is the need to strengthen regulatory and reimbursement processes and ensure they remain free from political interference. The use of clinically meaningful benefit thresholds such as that proposed by ASCO and ESMO seems enormously prudent. The ASCO metric in effect calls for minimum OS gains of 2.5–4.5 months or 25–50% gain over existing time scales and the ESMO threshold essentially prioritizes gains in survival (> 3 months with hazard ratios < 0.65), quality of life and reduction in toxicity compared with current standards of care.
We would suggest other countries considering a patient access scheme for drugs awaiting formal health technology appraisal use value frameworks that determine the likely benefit from reimbursement as part of the appraisal process. If drugs are made available pending an appraisal process, this should be accompanied by rigorous collection of outcome data through coverage with evidence development schemes. However, they should not replace assessment of the overall cost-effectiveness, which seeks to ascertain the societal benefit gained from drug reimbursements relative to other health technologies across the disease spectrum.
Improvements on the current system could also be achieved through new payment systems based on the attainment of pre-determined outcomes [99–101] or the introduction of value-based co-payments [102]. Another option would be to link HTA appraisal of the benefits and costs of new drugs with national rebate agreements [89]. The rebate would cover the difference between the manufacturers intended price of the drug and how much the NHS can afford to pay for its intended benefits. This would highlight to pharmaceutical companies of the price the NHS is willing to pay for the benefits offered by a new drug. Companies charging high prices for drugs with limited efficacy, would be expected to pay higher rebates. This would encourage research funders to support cancer clinical trials whose design and end points genuinely look for therapeutic advances that deliver meaningful clinical benefit rather than a low bar for response.
Conclusions
Despite significant expenditure, there remains no evidence that the CDF has delivered meaningful value to NHS cancer patients. We have analysed the value of CDF approved drugs according to six criteria including validated clinical benefit scales, and health technology appraisal from organizations such as NICE. From this, it is clear that the decision-making tools used by the CDF for prioritization of new drugs have failed given that a number of drugs were approved and subsequently delisted based on evidence that previously existed.
We recommend the avoidance of similar ‘ring-fenced’ drug access funds in other countries. The lack of empirical evidence that prioritizing drug expenditure (the greatest cancer care costs after inpatient care) will improve outcomes for cancer patients over and above greater investment in the whole cancer management pathway (screening, diagnostics, radiotherapy, surgery) and reducing access barriers (e.g. co-payments) argue against its widespread adoption. Ultimately, what is most important is that reimbursement decisions for all drugs, procedures and interventions within cancer care are made through appropriate health technology appraisal processes, which use the best available evidence to ensure decisions maximize value for cancer patients and society as a whole.
None declared.
The authors have declared no conflicts of interest.
© The Author 2017. Published by Oxford University Press on behalf of the European Society for Medical Oncology.