eMJA     The Medical Journal of Australia

Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search   

EBM: Trials on Trial

Inclusion of patients in clinical trial analysis: the intention-to-treat principle

Stephane R Heritier, Val J Gebski and Anthony C Keech
MJA 2003; 179 (8): 438-440

Determining the sample of participants to be analysed is a crucial step in reporting clinical trials. For such analyses, the gold standard is the “intention-to-treat” principle. The question of which participants are included in the analysis appears as Item 16 of the CONSORT statement (Box 1).1

Intention-to-treat (ITT)

Analysis by ITT is a strategy that compares the study groups in terms of the treatment to which they were randomly allocated, irrespective of the treatment they actually received or other trial outcomes. Regardless of protocol deviations and participant compliance or withdrawal, analysis is performed according to the assigned treatment group.2,3

Random allocation aims to ensure that trial participants’ risk factors that may affect the outcome under investigation are balanced between the allocated treatments. This is to ensure that any differences in outcomes observed between groups are actually a result of the trial interventions. Importantly, there can be no guarantee that participants from each group who do not comply with the allocated treatment have the same risk-factor profile. Any analysis other than an ITT analysis (eg, one that excludes non-compliant participants) will potentially compromise the balance of these factors and introduce bias into the treatment comparisons.

Thus, the ITT strategy generally gives a conservative estimate of the treatment effect compared with what would be expected if there was full compliance. By accepting that non-compliance and protocol deviations are likely to occur in actual clinical practice,3,4 ITT essentially tests a treatment policy or strategy, and avoids overoptimistic estimates of the efficacy of an intervention resulting from the removal of non-compliers.

Ensuring ITT produces meaningful answers

The reality of conducting clinical trials means that the ITT principle is not usually fully met, especially when outcome data are missing for some participants. However, clinical trial researchers should consider this principle an ideal, and steps to achieve it should be considered in both the design and conduct of a trial.

Firstly, eligibility errors can be avoided by careful scrutiny before random allocation. Indeed, allocation of ineligible patients should be the exception, unless eligibility cannot be assessed quickly. Secondly, all efforts should be pursued to ensure minimal dropouts from treatment, crossover of participants between groups and losses to follow-up. An active run-in phase may be feasible to identify patients who are likely to drop out. A thorough consent process for participants and education of investigators will also minimise the number of dropouts. During the trial, adequate warning of the potential side effects of treatment, together with ongoing clinical support and reassurance, should be available to all participants. When a proportion of participants are expected to receive a treatment different from the assigned one, a dilution effect generally results. The subsequent potential loss of study power can be accounted for by increasing the planned sample size.5

Box 2 details the advantages and limitations of ITT analyses.

Alternatives to ITT analysis
Per-protocol (PP) analysis

There is a view that only patients who sufficiently complied with the trial’s protocol should be considered in the analysis.6 Compliance covers exposure to treatment, availability of measurements, and absence of major protocol violations. Such an analysis is often referred to as a “per-protocol” or “on treatment” analysis. The main issue arising from this approach is that it might introduce bias related to excluding participants from analysis. Therefore, the ITT analysis should always be considered as the ideal primary analysis, possibly supplemented by a secondary analysis using the PP approach. However, if investigators decide differently, their choice must be justified and should be subject to strict rules.7-9

Treatment-received (TR) analysis

Another approach is to analyse all participants according to the treatment they actually received, regardless of what treatment they were originally allocated. While this may have some initial appeal, once again the effect of random allocation is compromised, making the interpretation of the results difficult.

The impact of various approaches is illustrated in Box 3.

When ITT requirements are not fully met

A number of strategies can be adopted if the assumptions underpinning ITT are not satisfied.

If the crossover/non-compliance rates are small, then an ITT analysis should be the principal method of analysis. There is still some debate about whether ineligible subjects can legitimately be omitted from the final analysis.2 For instance, in a study involving a potentially life-threatening condition, such as severe acute respiratory syndrome, treatment may be routinely commenced before laboratory confirmation of the diagnosis. If the patients subsequently are not diagnosed with the condition, there may be a case for excluding them from the ITT population. In these instances, a “modified” or “quasi” ITT population may be defined, allowing for such exclusions. The following principles should be followed to allow participants to be excluded from such an analysis:

  • the criteria for exclusion from the analysis should be pre-specified in the protocol, be objective and clearly defined;7,8 and,

  • to remain unbiased, decisions to exclude participants need to be made (i) by researchers blinded to treatment allocation, and (ii) on the basis of information not related to either the allocated treatment or to events or outcomes that occur after random allocation.

In all circumstances, all patients randomly allocated to a study arm should be followed up, as exposure to study treatment may still influence their safety and place them at risk of serious adverse events. All efforts must be made to ensure maximum compliance and that patients continue to take their allocated treatments, and that all patients are accounted for in the trial report.9

The modified or quasi ITT population may also be useful when outcomes are not assessed in all participants. For example, outcomes requiring colonoscopic follow-up can result in no information for patients who, for any reason, did not undergo colonoscopy during the study, requiring an analysis based on a subset of the patient population.10 In such a case, modifying the ITT population allows some clinical interpretation of the results.

A more extreme example is a study evaluating hip protectors, in which only around 50% of those in the intervention arm were wearing a hip protector at the time of their fracture.11 In this situation, neither an ITT or per-protocol analysis would necessarily provide reliable information about the value of hip protectors when actually worn.

There has been debate about the appropriateness of imputing missing values.4 If missing data are imputed, it is recommended that some sensitivity analysis be performed to ensure that study conclusions are not misleading.4,12

Conclusion

ITT analysis gives unbiased and consistent estimates of a treatment policy, and should, wherever possible, be the analysis of choice. Deviations from this principle compromise the balance between groups that is achieved by random allocation, and are rarely justifiable as a principal analysis.

1: CONSORT checklist of items to include when reporting a trial

Selection and topic

Item no.

Descriptor


Numbers analysed

16

Number of participants (denominator) in each group included in each analysis, and whether the analysis was by “intention to treat”. State results in absolute numbers (eg, 10/20, not 50%).

2: Advantages and limitations of an intention-to-treat (ITT) analysis

Advantages

  • Retains balance in prognostic factors arising from the original random treatment allocation

  • Gives an unbiased estimate of treatment effect

  • Admits non-compliance and protocol deviations, thus reflecting a real clinical situation

Limitations

  • Estimate of treatment effect is generally conservative because of dilution due to non-compliance

  • In equivalence trials (attempting to prove that two treatments do not differ by more than a certain amount), this analysis will favour equality of treatments

  • Interpretation becomes difficult if a large proportion of participants cross over to opposite treatment arms

Requirements for an ideal ITT analysis

  • Full compliance with randomised treatment

  • No missing responses

  • Follow-up on all participants

ITT analysis is highly desirable unless:

  • there is overwhelming justification for a different analysis policy (eg, an unacceptably high proportion of ineligible participants — those without the disease under study, for whom there is no potential benefit from the intervention. In these circumstances a “quasi” ITT approach (in which ineligible patients are excluded) is more appropriate.

3: Example illustrating the impact of intention-to-treat, per-protocol and treatment-received analyses in a placebo-controlled trial*

Treatment group (n = 1000)


Control group (n = 1000)


Compliers

Non-compliers (drop-outs)

Compliers

Non-compliers (drop-ins)


Compliance 80%†‡

800

200

800

200

Untreated baseline risk

10%

10%

7.5%

20%

Number of events without any treatment

80

20

60

40

Overall event rate

100/1000 = 10%

100/1000 = 10%

Expected number of events

Expected benefit (relative risk reduction)


Full compliance

80

100

20% benefit (1 – [80/100])

Intention-to-treat analysis

64

20

60

32

9% benefit (1 – [84/92])

Per-protocol analysis

64

60

7% detriment (1 – [64/60])

Treatment-received analysis

80

20

60

32

40% detriment (1 – [112/80]§)


Trial assumptions

* The average risk of each group is 10% over the long term trial duration, and active treatment, when taken, reduces the risk by 20%.

† 20% of those allocated to receive the active drug do not take it because of early side-effects unrelated to the study outcome.

‡ 20% of those allocated to receive the matching placebo medication are prescribed the active therapy because of early clinical deterioration of their condition directly related to their risk of study outcome (these participants are a high-risk subset and have double the average risk [ie, 20%]).

§ This comprises expected events in those taking the active drug (treatment group compliers and control group non-compliers) divided by those not taking the active drug (control group compliers and treatment group non-compliers).

A simple adjustment factor to obtain a better estimate of what might happen with full compliance (100%) compared with observed compliance (80% for each group) can be applied to the ITT benefit (ie, 9% x 100/80 x 100/80 = 13% benefit).

Competing interests

None identified.

References
  1. Moher D, Schulz KF, Altman DG, et al, for the CONSORT group. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 2001; 134: 663-694. <PubMed>
  2. Fisher L, Dixon D, Jerson J, et al. Intention to treat in clinical trials. In: Peace K, editor. Statistical issues in drug research and development. New York: Marcel Dekker, 1990.
  3. Gillings D, Koch G. The application of the principle of intention-to-treat to the analysis of clinical trials. Clinical Research Bulletin. Basle: Santoz Pharma, September, 1990.
  4. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomized controlled trials. BMJ 1999; 319: 670-674. <PubMed>
  5. Kirby A, Gebski VJ, Keech AC. Determining the sample size in a clinical trial. Med J Aust 2002; 177: 256-257. <PubMed><eMJA full text>
  6. Sackett D, Gent M. Controversy in counting and attributing events in clinical trials. N Engl J Med 1979; 301: 1410-1412. <PubMed>
  7. Peto R, Pike MC, Armitage P, et al. Design and analysis of randomized clinical trials requiring prolonged observation of each patient. Br J Cancer 1976; 34: 585-612. <PubMed>
  8. Armitage P. Exclusions, losses to follow-up and withdrawals in clinical trials. In: Shapiro SH, Louis TA, editors. Clinical trials. New York: Marcel Dekker, 1983.
  9. Gail MH. Eligibility, exclusions, losses to follow-up, removal of randomised patients and uncounted events in cancer clinical trials. Cancer Treat Rep 1985; 69: 1107-1113. <PubMed>
  10. Sandler R, Halabi S, Baron J, et al. A randomized trial of aspirin to prevent colorectal adenomas in patients with previous colorectal cancer. N Engl J Med 2003; 348: 883-890. <PubMed>
  11. Cameron ID, Cumming RG, Kurrle SE, et al. A randomised trial of hip protector use by frail older women living in their own homes. Injury Prevention 2003; 9: 138-141. <PubMed>
  12. Cakir B, Gebski V, Keech AC. Flow of participants in randomised studies. Med J Aust 2003; 178: 347-349. <PubMed><eMJA full text>

(Received 3 Sep 2003, accepted 16 Sep 2003)

NHMRC Clinical Trial Centre, University of Sydney, Camperdown, NSW.

Stephane R Heritier, PhD, Senior Lecturer in Statistics; Val J Gebski, BA, MStat, Principal Research Fellow; Anthony C Keech, MScEpid FRACP, Deputy Director.

Correspondence: Associate Professor Anthony C Keech, NHMRC Clinical Trial Centre, University of Sydney, Locked Bag 77, Camperdown, NSW 1450. enquiryATctc.usyd.edu.au

AntiSpam note: To avoid spam, authors' email addresses are written with AT in place of the usual symbol, and we have removed "mail to" links. Replace AT with the correct symbol to get a valid address.

©The Medical Journal of Australia 2003 www.mja.com.au ISSN: 0025-729X

Other articles have cited this article:

Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search

The Medical Journal of Australia    eMJA