|
Home | Issues | eMJA shop | My account | Classifieds | Contact | More... | Topics | Search |
→ Previous article in this issue
→ Contents list for this issue
→ More articles on Journalology and publishing
EBM: Trials on Trial
Introduction
—Allocation concealment
—Failed concealment from the investigator or clinician
—Failed concealment from the patient
—Blinding (masking)
—Consequences of treatment knowledge after randomisation
—To blind or not to blind?
—Masking data and intermediate outcomes during the study
—Blinded outcome assessment
—Effect of allocation concealment and blinding on the interpretation of trial results
—When and how to unblind participants and investigators during the trial
—Acknowledgements
—Competing interests
—References
—Author details
Good study design involves minimising all possible sources of bias. Two important sources of bias arise through failure to mask (ie, conceal), first, the randomisation process and, second, the treatments after randomisation. Allocation concealment is the term used to describe the procedure for protecting the randomisation process so that the treatment to be allocated is not known before the patient is entered into the study. Blinding relates to the masking of the treatments after randomisation — from the patient, the investigator or the outcomes assessor. Without exception, allocation concealment is achievable in all randomised clinical trials. In contrast, it is not always possible to blind people to study treatments received. The CONSORT statement strongly encourages detailed reporting of the allocation concealment process and the measures taken to preserve blinding (Box 1).1
Failure to conceal the process of random allocation will potentially result in a non-randomised trial, while successful allocation concealment will reduce selection bias. No matter what method is chosen to randomly allocate patients (eg, by simple random numbers, permuted blocks or minimisation), if the investigator or clinician (or the patient) is able to identify the impending treatment allocation and is able to influence the enrolment (or selection) of participating patients, the value of randomisation is compromised. Selection bias may have been introduced, whereby the treatment assignment is no longer truly random and an imbalance in prognostic factors between treatment groups occurs. If this arises, assessment of the treatment comparison is compromised.
Single-centre trials in which randomisation is conducted on site and the randomisation method is known to the participating investigators are at high risk of this problem. If an investigator has influence over the number of patients enrolling in a trial, or the order in which they are randomised, he or she has the potential to introduce selection bias into the study by directing particular patients into preferred treatment groups while excluding others. However, even if the investigator knows the allocation sequence, the problem will not arise if all consecutive eligible patients are being enrolled in order of presentation, as is often the case in trials in emergency departments, intensive care units or any acute care setting. Ideally, a successful allocation concealment process is ensured when all investigators are ignorant of future treatment allocations and have no control over the order of patients randomised into the trial.
Patients may change their willingness to participate in a trial if they know or suspect which treatment they will receive. If patients are aware of their allocation before randomisation, they may be influenced to withdraw before randomisation or wait until their preferred treatment is available before entering the study.
Baseline imbalances as a direct result of concealment violation may not be evident across the whole trial, although patients from particular sites or patients from particular investigators may show consistent differences between treatment groups in various baseline prognostic factors. In practice, the method of allocation concealment is often not reported or is poorly described.2-7 Any trial report should provide enough detail to describe the quality of both allocation concealment and blinding strategies. The use of sequentially numbered, opaque, sealed envelopes, pharmacy-controlled allocations, coded identical containers or kits, and central randomisation systems (telephone or web based) are considered adequate concealment methods and are often implemented to protect the randomisation.8 Allocation lists that can be prepared in advance or may be guessed because of a known pattern (eg, permuted blocks of fixed size) are more susceptible to deciphering. No strategy is entirely tamper-proof, although remote systems are generally more secure.9
Blinding describes the status of the patient and/or the clinician-investigator after randomisation:
Single blind: Either the patient or clinician (usually the patient) remains unaware of the treatment assignment.
Double blind: Both the patient and investigator are unaware of the allocated treatment.
Open label: All parties are aware of treatment being received after randomisation.
Triple blind: The patient, the investigator and either those who adjudicate the study outcomes (the outcomes assessment committee) or those who monitor the study safety (the safety and data monitoring committee) are unaware of the allocated treatment. A blinded safety committee will see the data from the treatment groups in coded form (ie, labelled as X and Y), and so are also blinded to treatment allocation.
Unblinding: The disclosure, planned or unintended, of the allocation of one, a group, or all of the participants.
Failure or inability to blind people to the treatment assignment in a trial potentially introduces important biases. These include reporting bias (by either the patient or investigator), assessment bias (where assessment is part of an investigator’s role), and concomitant treatment bias by either the patient or investigator; all such biases contribute to differences between groups other than those resulting from the allocated study treatment. In open-label trials, all of these biases might occur.
It is recommended that the study’s blinding be explicitly detailed when trial design and results are reported.1,10 In particular, authors should report how blinding was maintained for patients, investigators or clinicians and outcomes assessment committees.
If patients are not blinded to their allocated treatment, then knowledge of treatment may influence their responses to the intervention and their reporting. Commonly, patients assume that the new intervention will be more beneficial than the control or standard treatment. Compared with clinical event outcomes, patient-rated outcomes (for example, quality of life, pain and discomfort) are particularly sensitive to patients’ knowledge of the intervention to which they have been allocated. Similarly, if investigators are aware of the patients’ study treatment, their knowledge may influence, first, their management of the patient and, second, their classification of responses and events.
For example, in the Aspirin Myocardial Infarction Study,11 men and women who experienced a myocardial infarction were randomised to receive 1 g aspirin a day or matching placebo. If they or their doctors had been aware that they were taking aspirin, they might have ascribed all their gastrointestinal symptoms to aspirin. Symptoms suggesting peptic ulcer, gastritis or erosion of gastric mucosa occurred in 23.7% of the aspirin group but also 14.9% of the placebo group. Because the study was well blinded, it was possible to attribute only 8.8% of the symptoms to the aspirin treatment.
Generally, drug trials involving oral, topical or intravenous administration can be set up as a double-blind study by the use of a matching placebo. Many surgical trials comparing intraoperative techniques with an identical external incision can be designed as single-blind trials, but comparisons between medical and surgical interventions are inevitably unblinded — that is, open-label trials. When a treatment has a distinctive side effect which is likely to be expressed in most patients (such as toxic effects from chemotherapy), the use of a placebo may be futile.
A double-blind design is desirable for any trial. When there is an active comparator in a drug evaluation trial, blinding can be ensured by the use of a so-called double-dummy design. This involves giving all patients two formulations: one group receives the active treatment plus a placebo of the alternative treatment, and the other group receives the opposite combination (see Box 2). To successfully mask the treatment, a placebo treatment should be identical in appearance (size, colour, weight, feel, odour, etc) and route of administration, and should be tested to make certain that its benign nature cannot be detected.
Patients’ or investigators’ preconceptions about the value of the treatment may affect a trial’s results. For example, in a trial of the effect of vitamin C on symptoms of colds, volunteers took vitamin C or a placebo for 9 months, with an increase in the dose at the onset of a cold.12 Because of the differences in taste between the vitamin and the placebo, some of the participants became aware of their treatment. In this group, the vitamin C had a reported benefit, but vitamin treatment did not appear to help those who remained blinded. The breakdown of the blinding led to inconclusive results, illustrating the importance of ensuring that blinding is done with care.
When routine collection of clinical data during a trial (eg, blood tests) may potentially unblind investigators, providing investigators with summary information should be considered. For example, in a long-term cardiovascular trial assessing the effect of cholesterol-lowering treatment on the incidence of cardiovascular events, knowing individual lipid profiles during follow-up may unblind the clinician and patient. If the blood tests are performed by a central laboratory, it may be possible to provide a summary report simply stating that a patient’s values do or do not fall within a prespecified range, without compromising the patient’s safety, masking the individual data and preserving the blinded status of the investigator.
Blinded assessment of outcomes is possible in most trials, regardless of whether the clinician or the patient is aware of the treatment allocation. Clinical outcomes should be assessed by people who are not aware of the patient’s treatment allocation (and preferably not involved in the patient’s clinical management) so that all patients are assessed identically. In this way, outcomes will not be influenced by beliefs about the study treatments being compared. In general, blinding becomes less important for reducing observer or information bias as the outcomes become less subjective and more objective (that is, bias is more prevalent with a subjective outcome such as degree of pain or extent of depression, but is eliminated with an outcome such as death from any cause). For outcomes such as biochemical or pathology result markers, assessment by calibrated, accurate instruments is often sufficient to ensure no bias is present. If patients are required to provide their own assessment of an outcome, it is recommended that more than one item of the same type be reported to allow reliability to be measured.
An open-label trial with successful allocation concealment and blinded assessment may provide more reliable and more valid results than a double-blind trial with unsuccessful allocation concealment or compromised outcome assessment. Blinding does not guarantee an absence of bias, although empirical evidence does endorse a reduction of bias when adequate blinding strategies have been implemented. Allocation concealment (before randomisation) is thought to have a stronger influence on the reduction of bias than blinding (after randomisation).3,5 A checklist for successful allocation concealment and blinding is provided in Box 3.
Procedures should be established at the start of any randomised controlled trial for possible unblinding of the investigator and patient to an individual patient’s data during the trial. In most cases, unblinding would be carried out when the patient’s safety is at risk and this knowledge is required for emergency treatment. Often, however, if simply ceasing study treatment is a viable option for the patient’s care, it should not be necessary for unblinding to occur. Whenever possible, the chief investigator’s agreement should be sought before requests for individual unblinding are made. The process of unblinding should be such that only the data for one patient should be disclosed at any one time, and an audit trail maintained of all requests and their justifications.
1 CONSORT checklist of items to report when reporting a randomised trial1
Section and topic |
Item no. |
Descriptor |
|||||||||||||
Allocation concealment |
9 |
Method used to implement the random allocation sequence (eg, numbered containers or central telephone), clarifying whether the sequence was concealed until interventions were assigned. |
|||||||||||||
Implementation |
10 |
Who generated the allocation sequence, who enrolled participants and who assigned participants to their groups? |
|||||||||||||
Blinding (masking) |
11 |
Whether or not participants, those administering the interventions and those assessing the outcomes were blinded to group assignment. If done, how the success of blinding was evaluated. |
|||||||||||||
2 Double-blind double-dummy trial design
Randomised allocation |
Patient receives |
||||||||||||||
Active treatment 1: Tablet
Active treatment 2: Capsule |
|||||||||||||||
3 Checklist for successful allocation concealment and blinding
Allocation concealment
Investigator-clinicians are unaware of exact details of how the chosen randomisation method is being implemented (eg, ignorant of block sizes used in a permuted block randomisation scheme).
All staff responsible for providing allocations have adequate training.
An audit trail is maintained to ensure the integrity of the allocation process.13
If possible, a centralised or remote randomisation service is used (either by telephone, fax, email, the internet, a coordinating centre or site pharmacy). Remote randomisation can mean telephoning or faxing another person or clinic department to receive the next allocation.
Blinding
Appropriateness of blinding of patients and investigators (double-blind or single-blind) is ascertained.
The implementation process for blinding is planned, including deciding whether a placebo treatment is to be used, and ensuring the process maintains the relevant parties’ ignorance of the treatment after randomisation.
Evaluation of outcomes ensures objective assessment of all patients.
Unblinding
Ceasing study medication, if this is an option, is preferable to unblinding.
A method of unblinding is available quickly in a genuine emergency.
Specific methods
If envelopes are used, there is an audit trail recording each envelope opened (date and time) and envelopes are numbered, tamper-proof and opaque so that the contents remain concealed unless the envelope is destroyed or damaged.13
If kits or containers are used, they are identical (weight, size, appearance), numbered and tamper-proof.
The allocation process is reproducible.
We thank Rhana Pike, Editor in the Life Sciences (ELS), for expert assistance in preparing this manuscript.
NHMRC Clinical Trials Centre, University of Sydney, Sydney, NSW.
Peta M Forder, BSc, MPH, Statistician; Val J Gebski, BA, MStat, Associate Professor, and Senior Research Fellow; Anthony C Keech, FRACP, MScEpid, Deputy Director.Correspondence: Associate Professor Anthony C Keech, NHMRC Clinical Trials Centre, University of Sydney, Locked Bag 77, Camperdown, Sydney, NSW 1450. enquiryATctc.usyd.edu.au
AntiSpam note: To avoid spam, authors' email addresses are written with AT in place of the usual symbol, and we have removed "mail to" links. Replace AT with the correct symbol to get a valid address.
©The Medical Journal of Australia 2005 www.mja.com.au PRINT ISSN: 0025-729X ONLINE ISSN: 1326-5377
Vance W Berger || Harri Hemilä || Peta M Forder, Val J Gebski and Anthony C Keech. Allocation concealment
and blinding: when
ignorance is bliss Med J Aust 2005; 183 (3): 165-166. [Letters] <http://www.mja.com.au/public/issues/183_03_010805/letters_010805_fm-5.html>
|
Home | Issues | eMJA shop | My account | Classifieds | More... | Contact | Topics | Search |