Inclusion of patients in clinical trial analysis: the intention-to-treat principle
Authors: Stephane R Heritier, Val J Gebski and Anthony C Keech
Published online: 20 October 2003
Determining the sample of participants to be analysed is a crucial step in reporting clinical trials. For such analyses, the gold standard is the “intention-to-treat” principle. The question of which participants are included in the analysis appears as Item 16 of the CONSORT statement (Box 1).1
Analysis by ITT is a strategy that compares the study groups in terms of the treatment to which they were randomly allocated, irrespective of the treatment they actually received or other trial outcomes. Regardless of protocol deviations and participant compliance or withdrawal, analysis is performed according to the assigned treatment group.2,3
Random allocation aims to ensure that trial participants’ risk factors that may affect the outcome under investigation are balanced between the allocated treatments. This is to ensure that any differences in outcomes observed between groups are actually a result of the trial interventions. Importantly, there can be no guarantee that participants from each group who do not comply with the allocated treatment have the same risk-factor profile. Any analysis other than an ITT analysis (eg, one that excludes non-compliant participants) will potentially compromise the balance of these factors and introduce bias into the treatment comparisons.
Thus, the ITT strategy generally gives a conservative estimate of the treatment effect compared with what would be expected if there was full compliance. By accepting that non-compliance and protocol deviations are likely to occur in actual clinical practice,3,4 ITT essentially tests a treatment policy or strategy, and avoids overoptimistic estimates of the efficacy of an intervention resulting from the removal of non-compliers.
The reality of conducting clinical trials means that the ITT principle is not usually fully met, especially when outcome data are missing for some participants. However, clinical trial researchers should consider this principle an ideal, and steps to achieve it should be considered in both the design and conduct of a trial.
Firstly, eligibility errors can be avoided by careful scrutiny before random allocation. Indeed, allocation of ineligible patients should be the exception, unless eligibility cannot be assessed quickly. Secondly, all efforts should be pursued to ensure minimal dropouts from treatment, crossover of participants between groups and losses to follow-up. An active run-in phase may be feasible to identify patients who are likely to drop out. A thorough consent process for participants and education of investigators will also minimise the number of dropouts. During the trial, adequate warning of the potential side effects of treatment, together with ongoing clinical support and reassurance, should be available to all participants. When a proportion of participants are expected to receive a treatment different from the assigned one, a dilution effect generally results. The subsequent potential loss of study power can be accounted for by increasing the planned sample size.5
Box 2 details the advantages and limitations of ITT analyses.
There is a view that only patients who sufficiently complied with the trial’s protocol should be considered in the analysis.6 Compliance covers exposure to treatment, availability of measurements, and absence of major protocol violations. Such an analysis is often referred to as a “per-protocol” or “on treatment” analysis. The main issue arising from this approach is that it might introduce bias related to excluding participants from analysis. Therefore, the ITT analysis should always be considered as the ideal primary analysis, possibly supplemented by a secondary analysis using the PP approach. However, if investigators decide differently, their choice must be justified and should be subject to strict rules.7-9
Another approach is to analyse all participants according to the treatment they actually received, regardless of what treatment they were originally allocated. While this may have some initial appeal, once again the effect of random allocation is compromised, making the interpretation of the results difficult.
The impact of various approaches is illustrated in Box 3.
A number of strategies can be adopted if the assumptions underpinning ITT are not satisfied.
If the crossover/non-compliance rates are small, then an ITT analysis should be the principal method of analysis. There is still some debate about whether ineligible subjects can legitimately be omitted from the final analysis.2 For instance, in a study involving a potentially life-threatening condition, such as severe acute respiratory syndrome, treatment may be routinely commenced before laboratory confirmation of the diagnosis. If the patients subsequently are not diagnosed with the condition, there may be a case for excluding them from the ITT population. In these instances, a “modified” or “quasi” ITT population may be defined, allowing for such exclusions. The following principles should be followed to allow participants to be excluded from such an analysis:
the criteria for exclusion from the analysis should be pre-specified in the protocol, be objective and clearly defined;7,8 and,
to remain unbiased, decisions to exclude participants need to be made (i) by researchers blinded to treatment allocation, and (ii) on the basis of information not related to either the allocated treatment or to events or outcomes that occur after random allocation.
In all circumstances, all patients randomly allocated to a study arm should be followed up, as exposure to study treatment may still influence their safety and place them at risk of serious adverse events. All efforts must be made to ensure maximum compliance and that patients continue to take their allocated treatments, and that all patients are accounted for in the trial report.9
The modified or quasi ITT population may also be useful when outcomes are not assessed in all participants. For example, outcomes requiring colonoscopic follow-up can result in no information for patients who, for any reason, did not undergo colonoscopy during the study, requiring an analysis based on a subset of the patient population.10 In such a case, modifying the ITT population allows some clinical interpretation of the results.
A more extreme example is a study evaluating hip protectors, in which only around 50% of those in the intervention arm were wearing a hip protector at the time of their fracture.11 In this situation, neither an ITT or per-protocol analysis would necessarily provide reliable information about the value of hip protectors when actually worn.
There has been debate about the appropriateness of imputing missing values.4 If missing data are imputed, it is recommended that some sensitivity analysis be performed to ensure that study conclusions are not misleading.4,12
ITT analysis gives unbiased and consistent estimates of a treatment policy, and should, wherever possible, be the analysis of choice. Deviations from this principle compromise the balance between groups that is achieved by random allocation, and are rarely justifiable as a principal analysis.
1: CONSORT checklist of items to include when reporting a trial
Selection and topic |
Item no. |
Descriptor |
|||||||||
Numbers analysed |
16 |
Number of participants (denominator) in each group included in each analysis, and whether the analysis was by “intention to treat”. State results in absolute numbers (eg, 10/20, not 50%). |
|||||||||
2: Advantages and limitations of an intention-to-treat (ITT) analysis
Advantages
Retains balance in prognostic factors arising from the original random treatment allocation
Gives an unbiased estimate of treatment effect
Admits non-compliance and protocol deviations, thus reflecting a real clinical situation
Limitations
Estimate of treatment effect is generally conservative because of dilution due to non-compliance
In equivalence trials (attempting to prove that two treatments do not differ by more than a certain amount), this analysis will favour equality of treatments
Interpretation becomes difficult if a large proportion of participants cross over to opposite treatment arms
Requirements for an ideal ITT analysis
Full compliance with randomised treatment
No missing responses
Follow-up on all participants
ITT analysis is highly desirable unless:
there is overwhelming justification for a different analysis policy (eg, an unacceptably high proportion of ineligible participants — those without the disease under study, for whom there is no potential benefit from the intervention. In these circumstances a “quasi” ITT approach (in which ineligible patients are excluded) is more appropriate.
3: Example illustrating the impact of intention-to-treat, per-protocol and treatment-received analyses in a placebo-controlled trial*
|
Treatment group (n = 1000) |
Control group (n = 1000) |
|
||||||||
Compliers |
Non-compliers (drop-outs) |
Compliers |
Non-compliers (drop-ins)‡ |
||||||||
Compliance 80%†‡ |
800† |
200† |
800‡ |
200‡ |
|
||||||
Untreated baseline risk |
10% |
10% |
7.5% |
20% |
|
||||||
Number of events without any treatment |
80 |
20 |
60 |
40 |
|
||||||
Overall event rate |
100/1000 = 10% |
100/1000 = 10% |
|
||||||||
Expected number of events |
|
|
|
|
Expected benefit (relative risk reduction) |
||||||
Full compliance |
80 |
100 |
20% benefit (1 – [80/100]) |
||||||||
Intention-to-treat analysis |
64 |
20 |
60 |
32 |
9% benefit (1 – [84/92]) |
||||||
Per-protocol analysis |
64 |
— |
60 |
— |
7% detriment (1 – [64/60]) |
||||||
Treatment-received analysis |
80 |
20 |
60 |
32 |
40% detriment (1 – [112/80]§) |
||||||
Trial assumptions * The average risk of each group is 10% over the long term trial duration, and active treatment, when taken, reduces the risk by 20%. † 20% of those allocated to receive the active drug do not take it because of early side-effects unrelated to the study outcome. ‡ 20% of those allocated to receive the matching placebo medication are prescribed the active therapy because of early clinical deterioration of their condition directly related to their risk of study outcome (these participants are a high-risk subset and have double the average risk [ie, 20%]). § This comprises expected events in those taking the active drug (treatment group compliers and control group non-compliers) divided by those not taking the active drug (control group compliers and treatment group non-compliers). A simple adjustment factor to obtain a better estimate of what might happen with full compliance (100%) compared with observed compliance (80% for each group) can be applied to the ITT benefit (ie, 9% x 100/80 x 100/80 = 13% benefit). |
|||||||||||
Competing interests
References
- Moher D, Schulz KF, Altman DG, et al, for the CONSORT group. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001; 134: 663-694. i1083064
- Fisher L, Dixon D, Jerson J, et al. Intention to treat in clinical trials. In: Peace K, editor. Statistical issues in drug research and development. New York: Marcel Dekker, 1990. i1083066
- Gillings D, Koch G. The application of the principle of intention-to-treat to the analysis of clinical trials. Clinical Research Bulletin. Basle: Santoz Pharma, September, 1990. i1083068
- Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomized controlled trials. BMJ 1999; 319: 670-674. i1083070
- Kirby A, Gebski VJ, Keech AC. Determining the sample size in a clinical trial. Med J Aust 2002; 177: 256-257. <eMJA full text>
- Sackett D, Gent M. Controversy in counting and attributing events in clinical trials. N Engl J Med 1979; 301: 1410-1412. i1083074
- Peto R, Pike MC, Armitage P, et al. Design and analysis of randomized clinical trials requiring prolonged observation of each patient. Br J Cancer 1976; 34: 585-612. i1083076
- Armitage P. Exclusions, losses to follow-up and withdrawals in clinical trials. In: Shapiro SH, Louis TA, editors. Clinical trials. New York: Marcel Dekker, 1983. i1083078
- Gail MH. Eligibility, exclusions, losses to follow-up, removal of randomised patients and uncounted events in cancer clinical trials. Cancer Treat Rep 1985; 69: 1107-1113. i1083080
- Sandler R, Halabi S, Baron J, et al. A randomized trial of aspirin to prevent colorectal adenomas in patients with previous colorectal cancer. N Engl J Med 2003; 348: 883-890. i1083082
- Cameron ID, Cumming RG, Kurrle SE, et al. A randomised trial of hip protector use by frail older women living in their own homes. Injury Prevention 2003; 9: 138-141. i1083084
- Cakir B, Gebski V, Keech AC. Flow of participants in randomised studies. Med J Aust 2003; 178: 347-349. <eMJA full text>