Justification for CRT design

CRTs always require more participants than an individually randomised trial because the outcomes of participants within the same cluster are correlated with one another.2 CRTs are also more prone to bias, including baseline imbalances between clusters, recruitment bias, performance bias and attrition bias.12 13 Accordingly, the Ottawa Statement requires that researchers explicitly justify the use of a cluster-randomised design.

Analysis of PURE Malawi trial. In the PURE Malawi trial, several factors supported the cluster-randomised design.14 First, as the interventions involve peer support, an individually randomised design would have been prone to contamination, as control and intervention patients would interact. Second, the recruitment of mentor and expert mothers involved training, and it was convenient and less costly to conduct training only in intervention institutions. Third, it may have been perceived as unfair to prevent women from receiving peer support conducted within their own health facility or community. Finally, there was need for a pragmatic evaluation to assess the effectiveness of peer-support strategies as they would be delivered in practice. Therefore, the use of a cluster-randomised design in the PURE Malawi trial is justified.

Gaps/recommendations for the Ottawa Statement. None.

Research ethics committee review

All research involving human participants must be reviewed by a REC. The Ottawa Statement concludes that all health-related CRTs, including those with quality improvement, health services or implementation interventions, are research involving human participants and, accordingly, must be reviewed by a REC.3 Other international documents require that research which is externally funded and conducted in low-resource settings be approved by a REC in both host and sponsor countries.4

Analysis of PURE Malawi trial. Malawi’s National Health Sciences Research Committee (host country), the University of North Carolina Institutional Review Board (US sponsor), the University of Toronto Research Ethics Board (Canadian sponsor) and the WHO Ethics REC (international sponsor) approved the PURE Malawi trial through full board reviews.11 The PURE Malawi trial was designed and implemented by the PURE Malawi Consortium, whose members fulfilled various roles in the project. All members involved in the recruitment and follow-up of participants sought or were ‘covered’ by approvals from their home institution’s REC. Thus, all required REC approvals were obtained.

Gaps/recommendations for the Ottawa Statement. The Ottawa Statement is silent on the need for host country and sponsor country review when a CRT is conducted in a low-resource setting. Additional guidance on when a protocol must be submitted for sponsor country review is needed. Following what happened in the PURE Malawi trial, is home institution REC approval necessary for investigators at other institutions, if host and sponsor countries have approved the study? If so, does it matter what role the investigator is playing in the study? For instance, if an investigator’s role is limited to protocol development or the analysis of study data, must approval from her institution be sought? Too many full board REC reviews add needless burdens to CRTs.15 Minimising the number of full board REC reviews required (perhaps to a single host and sponsor REC), consistent with adequate protections for participants, would promote the efficient conduct of CRTs.

Identifying research participants

In CRTs, different groups of people may be affected by different parts of the study. Thus, identifying research participants in CRTs may not be straightforward. The Ottawa Statement defines a research participant as ‘an individual whose interests may be affected as a result of study interventions or data collection procedures'.3 This definition is operationalised by four criteria, any one of which is sufficient. A research participant is someone: (1) who is the recipient of the study or control intervention; (2) who is the direct target of an environmental manipulation; (3) with whom researchers interact for study purposes or (4) about whom identifiable private information is obtained.3

Analysis of PURE Malawi trial. HIV-positive pregnant or breastfeeding women eligible for Option B+ in participating centres ought to be considered research participants. The peer-support interventions targeted these women (criterion 1). Furthermore, women interacted with researchers for study purposes (criterion 3), and their data on missed appointments and attendance at support group meetings were recorded (criterion 4). Finally, their routinely collected health data, including clinical visits and HIV viral load, were obtained (criterion 4).

The male partners of participating women are research participants. They were invited to participate in the study and encouraged to undergo HIV testing (criterion 1), and their test results were accessed (criterion 4). The newborn children of women participating in the study are also research participants, as their routinely collected health data, including HIV test results, were accessed (criterion 4).

Gaps/recommendations for the Ottawa Statement. More guidance is required to determine if lay workers involved in the delivery of health interventions ought to be considered research participants. When health workers merely deliver the study intervention, they are not research participants; when they are the intended recipients of the intervention, however, they are research participants. Difficult cases lie in the middle. Consider the role of the mentor and expert mothers in the PURE Malawi trial. They delivered peer support to pregnant and breastfeeding women in the trial. But, they were recruited and trained by the investigators for this role, and one of the study objectives examined the impact of task shifting on health facilities. Health services and implementation CRTs commonly train health providers to deliver study interventions. More guidance is needed on the proper classification of health workers as research participants in CRTs.

Obtaining informed consent

Informed consent is a central protection for research participants. The Ottawa Statement says: ’Researchers must obtain informed consent from human research participants in a CRT, unless a waiver of consent is granted by a REC’.3 A REC may approve a waiver of consent when (1) the trial is not feasible if informed consent is required and (2) study participation poses no more than minimal risk.3 Provided they pose only minimal risk, interventions delivered to the cluster as a whole commonly qualify for a waiver of consent; as all cluster members will receive the intervention, refusal of consent in such cases is meaningless. A waiver of consent should not be used solely for one study arm as it may lead to differential recruitment across arms. This can seriously undermine study validity as outcomes may be driven by baseline health differences between groups rather than the study interventions. The Ottawa Statement urges researchers to get consent where possible: ’If obtaining informed consent is feasible for some but not all study interventions or data collection procedures, then researchers should obtain separate informed consent, where possible, for each procedure’.3

Analysis of PURE Malawi trial. HIV-positive pregnant or breastfeeding women who had been screened for eligibility were invited to participate by a trained clinical staff member.11 The consent document explained the trial’s purpose, the intervention to which their health facility had been randomised, data collection procedures and the risks and benefits of participation. Women were asked to provide consent on behalf of their infants. This recruitment procedure was used across all randomised health facilities. Women who provided written informed consent were enrolled. Of the 1756 women who were screened for eligibility, 395 were deemed ineligible (primarily because they were already on antiretroviral treatment).11 Of the 1361 eligible women approached for consent, 1272 (93.4%) agreed to participate. The acceptance rates were similar among the facility intervention (92.6%), community intervention (97.9%) and routine care arms (90%). Written informed consent was also sought from male partners of the enrolled women.

In the PURE Malawi trial, consent could have been handled differently. Following the guidance of both the Council for International Organizations of Medical Sciences (CIOMS) and the Ottawa Statement, a waiver of consent for study interventions would have been permissible. Peer-support interventions in health facilities and communities were integrated into the care received by all HIV-positive pregnant or breastfeeding women. While women could have chosen not to attend peer-support group meetings, they nonetheless would have been exposed to one-on-one peer support, home visits and follow-up for missed visits. As a result, women who declined participation were nonetheless exposed to the interventions (although their data were not included in the analysis). As peer support has been studied in other contexts and found to be safe and efficacious, it poses no more than minimal risk to participants.16 17 One consequence of a waiver of consent is that notification of the ongoing trial (eg, posters in health clinics) would be required.

There is, however, an impediment to the use of a waiver of consent in Malawi. Malawian RECs do not allow a waiver of consent for studies involving identifiable participants. They base this on section 19(5) of the Constitution of Malawi: ‘No person shall be subjected to medical or scientific experiment without his or her consent’.18 How should investigators proceed when national standards seem to prohibit waivers of consent?

Gaps/recommendations for the Ottawa Statement. The Ottawa Statement should address conflicts between its recommendations and relevant national law and guidelines on waivers of consent. Resolving these conflicts will be essential to obtain waivers of consent for cluster-level interventions. Furthermore, the Ottawa Statement is silent on whether multiple REC approvals are needed for a waiver of consent. We suggest the host country REC should approve waivers of consent and notify sponsor country RECs reviewing the CRT.

Gatekeepers

The Ottawa Statement defines gatekeepers as ‘individuals or bodies who may be called on to protect the group-based interests that are affected by enrolment in a CRT’.3 Gatekeepers may include directors of health facilities, community leaders or government officials. While each has a role in protecting group interests, the Ottawa Statement mandates that gatekeepers should not provide consent on behalf of cluster members. When CRT enrolment may substantially affect group interests, researchers should obtain the gatekeeper’s permission for group enrolment. Moreover, researchers should seek to protect group interests through consultations to inform study design, conduct and reporting.3

Analysis of PURE Malawi trial. Gatekeeper permission was obtained at multiple levels, although at different times. The Malawi Ministry of Health was a member of the PURE Malawi Consortium; accordingly, it was involved in the trial’s design and provided permission at the national level. After the trial was funded, permission for enrolment and implementation was sought from local gatekeepers. Permission was obtained from 7 health districts responsible for 18 of the health facilities. Separate permission was obtained from two hospitals and a clinic that fell outside the aegis of the health districts.

Permission was also obtained from community leaders within the catchment areas of the health facilities. Village heads were invited to a meeting to be informed about the trial and discuss implementation and barriers. Important changes were made to the PURE Malawi trial at this stage. For instance, rather than interacting only with HIV-positive mothers, it was agreed that peer-support workers reach out to all pregnant or breastfeeding women by integrating elements of safe motherhood programmes. In this way, confidentiality protections for HIV-positive mothers were enhanced.

Gaps/recommendations for the Ottawa Statement. The Ottawa Statement recognises the need to engage multiple levels of gatekeepers. More guidance is needed on the timing of gatekeeper engagement. Practically, the trial may need to be funded before extensive engagement can occur. Furthermore, gatekeeper involvement may differ in protocol design, enrolment, implementation or reporting. More guidance on which gatekeepers to include in each of these roles would be helpful. Finally, we recommend that the Ottawa Statement take on the language of ‘community engagement’, as it encompasses community involvement, consultation and partnership.19

Assessing benefits and harms

The Ottawa Statement sets out three recommendations for analysing the benefits and harms of CRTs. First, researchers must ensure that the study interventions are adequately justified, and that there is evidence to support the claim that the interventions are ‘consistent with competent practice in the field of study relevant to the CRT'.3 Second, researchers must adequately justify the choice of the control intervention. When the control arm is routine care, ’individuals in the control arm must not be deprived of the effective care or programmes to which they would have access, were there no trial'.3 Third, and finally, researchers must ensure that the risks of data collection procedures are minimised consistent with sound scientific design, and reasonable in relation to the knowledge gained.3 The Ottawa Statement requires that, when reviewing study protocols, the REC consider whether and when the control clusters will receive the study intervention if it is shown to be effective.3

Analysis of PURE Malawi trial. The two study interventions were justified. In Malawi, since 2009, a project called Mothers2Mothers has been providing facility-based peer support to HIV-positive women in select sites. Another Malawian study showed that shifting tasks to lay community health workers improved antiretroviral therapy retention and service delivery.20 A pilot initiative in Malawi’s Zomba district showed that the identification and involvement of ‘expert patients’ can improve treatment uptake and the tracing of clients on antiretroviral therapy.17 Yet, without a rigorously conducted trial, it was unknown whether the addition of facility-based or community-based peer support to the Option B+ programme would be effective or affordable.11

The justification of the control arm in the PURE Malawi trial is complex. Participants in the routine care arm received HIV care in accordance with Malawian Ministry of Health Option B+ guidelines.11 According to these guidelines, women who do not attend the clinic after 60 days of a missed appointment are to be traced, contacted and encouraged to return to the clinic. Unfortunately, tracing rarely occurs and the quality of care varies across facilities.14 Transport, staffing and resource shortages all contribute to quality-of-care challenges.21

Was the routine care control arm in the PURE Malawi trial justified? Recall that the Ottawa Statement requires that participants in the control arm not be deprived of ‘programmes to which they would have access’.3 On one reading of this requirement, the control arm is justified. Had the PURE Malawi trial not been conducted, women attending control facilities would have received the same care and follow-up. Thus, they were not denied access to existing programmes.

Another reading of the requirement leads to a different conclusion. London draws a distinction between two different types of local standard of care: de facto and de jure.22 The de facto standard of care is the care actually delivered in local facilities; the de jure standard is the care that should be delivered as defined by national policy. London argues that the control arms ought to be held to the latter standard, as the former allows inefficiencies in care delivery to justify exploitation. As the PURE Malawi trial did not add resources to strengthen care in control facilities, the control arm was not justified.

How should the PURE Malawi trial investigators have proceeded? One option was to add resources to control facilities to ensure women received follow-up as defined by Option B+. As the trial sought to determine whether the addition of peer support would improve adherence and retention of women receiving antiretroviral treatment, this would have undermined the trial’s validity. Another option was to exclude the worst performing facilities, enrolling only those centres with reasonably good performance. But this would have undermined the trial’s generalisability, as the results would not be applicable to all facilities. A third option was what the researchers did: address the efficiency and affordability of peer support under real-world conditions. The result of the study as designed seems most informative to health system managers.

Given the limited funding the researchers could not guarantee access to peer support after the trial’s completion. Instead, they provided the study results to the Ministry of Health and advocated for the peer-support programmes.

Gaps/recommendations for the Ottawa Statement. Further guidance is required on the appropriate selection of control conditions in trials that seek to improve delivery of care defined by national policies. We suggest that when implementation or health services CRTs are seeking to improve treatment delivery and affordability, that control conditions should be permitted to violate the de jure standard so long as they pass the de facto standard.

Ensuring access to effective study interventions would mitigate concerns about care received in the control arm. Post-trial access in low-resource setting remains a critical issue. Most often CRT designs are employed in health systems and implementation research, therefore, post-trial access ought to be planned before study commencement. Further guidance from the Ottawa Statement should define the role of sponsors and other parties in low-resource settings in sustaining effective interventions past the completion date of the trial.

Protecting vulnerable participants

Vulnerable participants require additional protections. The Ottawa Statement defines vulnerable participants as (1) children, (2) incapable adults, (3) people at undue risk of harm as a result of study participation and (4) people in subordinate positions within social or organisational structures.3 The Ottawa Statement includes two recommendations for research involving vulnerable participants. First, it cautions that clusters may contain ‘hidden’ vulnerable participants, and researchers should be careful to ensure these individuals receive needed protections. Second, when cluster members are part of a hierarchy, such as employees within a healthcare institution, special attention must be paid to ‘recruitment, privacy and consent procedures for those participants’.3

Analysis of PURE Malawi trial. Due to prevalent HIV stigma and discrimination, all participants in the PURE Malawi trial were vulnerable. As a result, researchers and gatekeepers agreed to provide additional measures to protect confidentiality. Regardless of HIV status the mentor mothers and expert mothers approached every pregnant or breastfeeding woman in the facility and community.

Gaps/recommendations for the Ottawa Statement. More recent ethical guidance has moved away from classifying groups as vulnerable, and focuses on individual characteristics and contextual factors. For instance, CIOMS defines vulnerable persons as those who ‘may have an increased likelihood of being wronged’.4 Broadly, there are three types of wrongs: autonomy wrongs (eg, failing to identify decisionally incapable participants); welfare wrongs (eg, failing to protect participants who are at greater risk) and justice wrongs (eg, exposing the socially marginalised to greater stigmatisation).23 The emphasis on contextual factors is particularly relevant in low-resource settings, as individuals may be vulnerable simply because they are poor, illiterate or have inadequate access to healthcare. An updated version of the Ottawa Statement should adopt this approach to vulnerability because of its relevance to low-resource settings.