Skip to main content

Scarce quality assurance documentation in major clinical trial registries for approved medicines used in post-marketing clinical trials

Abstract

Background

This research reviewed major Clinical Trial Registries (CTRs) and assessed the availability of fields on quality assurance for approved medicines used as Investigational Medicinal Products (IMPs) in phase IV clinical trials.

Methods

Two reviewers independently assessed CTRs of the International Committee of Medical Journal Editors (ICJME) and of World Health Organization (WHO) platforms. Each CTR was checked by two reviewers on availability of fields on brand name, manufacturer’s name, approval status, approving authority, compliance with Good Manufacturing Practices, and quality testing. In case of discrepancy, consensus was sought between the two reviewers.

Results

Of 19 identified CTRs, 8 and 6 belonged to WHO and ICMJE, respectively, while 5 were equally part of both platforms. All CTRs had an ‘intervention’ field where data on IMPs and IMP comparators are captured. The Canadian CTR used ‘drug name’ rather than ‘intervention’. The EU, Peruvian, and UK CTRs had fields for ‘brand name’. However, only the EU CTR had fields for ‘manufacturer’s name’, ‘approval status’, and ‘approving authority’. None of the CTRs had fields on ‘compliance with Good Manufacturing Practices’ or ‘quality testing’.

Conclusion

This study demonstrates that none of the CTRs of ICMJE and WHO platforms has adequate fields to establish that the source of post-marketing IMPs is of assured quality. This is astonishing given the lengthy requirements in WHO and ICMJE guidelines. Considering the relation between IMP quality and safety of clinical trial participants, the gap of quality assurance fields should be bridged at CTRs concurrently to adjustments of WHO and ICMJE guidelines on CTRs. Specifically, IMP quality testing addressing issues on IMP appearance, impurities, microbial contamination, and dosing should be conducted and reported before, during, and after clinical trial conduct. Until adoption of these measures, the EU CTR should be preferred for registration of phase IV clinical trials conducted in countries lacking stringent regulatory capacities.

Peer Review reports

Background

Randomized clinical trials (RCTs) are the gold standard among research designs for assessing the efficacy and safety of medicines before they enter the market; they lead the therapeutic choice in healthcare [1]. The strength of RCTs lies in their ability to control for confounders like differences among patient baseline characteristics, concurrent diseases, and concurrent treatments that may distort the effect of the interventions under investigation [2]. The randomization of RCTs equally distributes potential confounders between the study groups, making the study medications the unique difference. Therefore, the therapeutic effect that is observed between the treatment group and the control group is attributed to the investigational medicinal product (IMP). An IMP may be a new chemical entity in development when used in phase I–III clinical trials, and it can also be an approved medicine that is further investigated to assess its effect in real-life when used in phase IV clinical trials.

To deliver the therapeutic effect, avoid drug resistance and harm to patients, and to ensure reliability of the clinial study results, the IMP must comply with quality standards [3,4,5]. Unfortunately, measures to comply with these quality standards seem to be lacking in non-commercial clinical trial protocols [6].

Medicines of poor quality are Substandard and Falsified (SF) medicines that are described by three terms. Firstly, substandard medicines, also called out-of-specification, are authorized medical products that fail to meet either their quality standards or specifications, or both. Secondly, unregistered or unlicensed medicines are those that have not undergone evaluation and approval by the National or Regional Regulatory Authority for the market in which they are marketed or used. Lastly, falsified medicines, which deliberately or fraudulently misrepresent their identity, composition or source [7]. All three types of SF medicines are assessed by drug regulatory authorities (DRAs) based on criteria determining their quality (Table 1). Falsified medicines especially will need involvement of law and security enforcement authorities. Unfortunately, that assessment requires sophisticated equipment and reagents and high technical abilities which most DRAs in low- and middle-income countries (LMICs) cannot afford [8]. Research on the quality of marketed medicines has shown worryingly high rates of SF medicines in LMICs [9,10,11,12,13,14]. In some African countries, for instance, substandard antimalarials were associated to 122,000 deaths of children under-five years [7].

Table 1 Factors determining quality of medicines

While regulatory-approved medicines of poor quality may be used as IMPs in post-marketing clinical trials, attention has not been sufficiently given to the quality of approved IMPs as they were considered exempt from quality compliance issues until publications of product quality defect reports in clinical trials in 2016 [15]. One of these reports described vitamin A capsules, manufactured in Canada and Italy and supplied by WHO, which were used in a clinical trial in Tanzanian infants; owing to quality checks, the product was proved degraded by 32% toward the clinical trial completion [16]. Another report indicates that clopidogrel of brand Plavix, which prevents heart attacks and strokes, could not be used in the US as an IMP comparator in 2007 after quality testing detected only 50–80% of the active ingredient in the product [17]. These two facts suggest that approved IMPs should not be exempted from quality compliance issues.

The Good Clinical Practice guidelines make clinical trial sponsors accountable for IMP quality [18, 19]. The same guidelines require clinical trial sponsors to describe quality assurance measures of IMPs in a clinical trial protocol, which must be registered in a Clinical Trial Registry (CTR) for approval [19]. While commercial study sponsors might be used to the quality assurance requirements of an IMP, non-commercial sponsor-investigators may not [6, 20]. Yet, non-commercial clinical trials are essential for the development and the post-marketing monitoring of medicines of global public health interest.

In this paper, we present an assessment of documentations in major CTRs regarding product quality, argue for assessment of the quality of approved IMPs and propose recommendations for enhancing relevant regulation updates.

Methods

For the assessment of the CTRs, a checklist of eight items as highlighted in Table 2, was developed using criteria that determine a pharmaceutical product’s quality. The most common quality attributes of IMPs are the appearance, impurities, microbial contamination, and dosing. However, other items, namely the product brand name, manufacturer’s name, and regulatory approval status, were added to that checklist as they may impact product quality. The CTRs of interest in this study were those fulfilling international guidelines. CTRs of the WHO International Clinical Trial Registries platform (WHO-ICTRP) or those recommended by the International Committee of Medical Journals Editors (ICMJE) were targeted [21, 22]. Only the English versions of these CTRs were screened. For each CTR, the data fields were viewed by displaying a registered study protocol owing to the search functionality. ‘Phase IV clinical trial’ was used as the search term, entered in the search window and a search was subsequently launched to display a list of registered study protocols. One of the displayed study protocols was then opened randomly and the product quality-related data fields were assessed. The data was further collected by a reviewer in line with the checklist and entered in a spreadsheet for analysis. To ensure accuracy, the collected data was reassessed by a second reviewer. In case of discrepancies, a consensus was sought between the two reviewers.

Table 2 Clinical Trial Registry checklist for product quality

Results

IMP quality-related data of CTRs are displayed in Table 3. Nineteen CTRs meeting the selection criteria were screened to assess the availability of quality-related data for IMPs; eight and six of these CTRs belonged to the WHO-ICTRP and ICMJE platforms, respectively, while the remaining five were equally part of both platforms (these were the CTRs of the European Union,

Table 3 Quality-related data field for IMPs in clinical trial registry of ICJMEa and WHO-ICTRPb

Japan, Brazil, China, and of the Korean Republic). All CTRs had a search functionality enabling the display of the registered clinical trial protocols.

All CTRs had an ‘intervention’ data field where data on the IMPs and the IMP comparators are captured. Health Canada’s CTR used ‘drug name’ rather than ‘intervention’. Three CTRs, namely the European, Peruvian, and that of United Kingdom’s BioMed Central, had a data field for ‘brand name’. Only the European CTR had data fields for ‘manufacturer name’, ‘product approval status’, and ‘approving DRA’. Of all CTRs that were screened, neither data fields were available on ‘compliance with good manufacturing practices’ (cGMP) nor on ‘product quality testing’.

Discussion

This study demonstrates that none of the CTRs in the WHO-ICTRP and ICMJE platforms have sufficient data fields to establish that the source of IMPs used in phase IV clinical trials is of assured quality. These findings are astonishing since they contrast the lengthy quality requirements outlined in WHO as well as International Conference on Harmonisation guidelines [4, 5].

Three patterns, namely the product’s regulatory approval status, cGMP, and quality testing, directly impact product quality. A regulatory approval is evidenced either by a listing of medicinal products in a regulatory approval database or a certificate of pharmaceutical product. It shows the legal source of a pharmaceutical product. However, proving the legal source of an IMP based on listing in a regulatory database may be a challenge in regions of the globe such as Africa, where only few regulatory databases are available [23]. A certificate of pharmaceutical product is therefore a valuable proof of registration. Moreover, it is relevant to have information on the approving regulatory authority since only regulatory approvals provided by a stringent DRA have high quality standards [24]. Unfortunately, as it can be seen from the results, data fields on the regulatory approval status of the IMP as well as the approving DRAs are lacking in most major CTRs except the European CTR. That gap should therefore be bridged by adding proof of registration and the approving authority in CTRs to prevent use of falsified IMPs by clinical trial participants.

When the regulatory approval status is unspecified, the brand and the manufacturer’s name may serve as starting points towards investigating whether an IMP is approved or falsified. However, as shown by the results, only a few CTRs have data fields on brand and manufacturer name. Brand and manufacturer name alone, including those of global companies, cannot guarantee quality assurance of approved IMPs since reports exist on quality defects of US-approved products of trusted and reputable global manufacturers [15, 25]. When combined with a brand and manufacturer name, the regulatory approval is a better indicator of the IMP legal source [5]. Nevertheless, the results of this study showed a data gap on brand and manufacturer name, which must be included in CTRs.

A regulatory approval suggests that the approving DRA acknowledges the manufacturer’s cGMP. However, like the regulatory approval status, only a certificate of cGMP provided by a stringent DRA assures the quality of approved IMPs used in LMICs in line with the reported regulatory weaknesses in these countries. A cGMP certificate and quality testing provide the highest quality assurance for approved IMPs.

Indeed, a cGMP certificate sustains the quality standards of the manufacturing process and allows identification of substandard medicines. In turn, quality testing provides information on the integrity of the active ingredient and equally assures a conformant dosing. Thus, when the analytical method is valid, a quality testing enables the identification of product degradation. Nevertheless, none of the CTRs had data fields on cGMP and quality testing, as shown by the study results. Therefore, the gap of data on cGMP and quality testing at CTRs should also be bridged to prevent the use of substandard and degraded IMPs in phase IV clinical trials.

Conclusion

Currently, none of the major CTRs has sufficient data fields on quality assurance of an approved IMP and consequently do not promote the quality of IMPs in post-marketing phase IV clinical trials. Considering the potential impact of product quality on the safety and wellbeing of clinical trial participants but also on the validity of clinical trial results, these gaps represent a concern for public health. This warrants that data fields on product brand name, manufacturer name, cGMP, regulatory approval status, and quality testing be added to CTRs. It is especially relevant that prior quality testing be conducted for IMPs before, during, and at completion of non-commercial clinical trials and sponsor-investigators should specifically report on these testing results. To this end, WHO international standards on CTRs and the ICMJE clinical trial registration policy should be adjusted. However, for an efficient implementation of these guidelines, a concurrent adjustment of WHO and International Conference on Harmonisation clinical trial regulations and the CONSORT guidelines is also necessary, as previously suggested [15]. Nevertheless, until these are completed and the identified gaps in product quality assurance data are bridged in CTRs, the European CTR should be preferred for post-marketing non-commercial clinical trials conducted in LMICs lacking stringent DRAs (Additional file 1).

References

  1. Hannan EL. Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. JACC Cardiovasc Interv. 2008;1:211–7.

    Article  Google Scholar 

  2. Juni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001;323:42–6.

    Article  CAS  Google Scholar 

  3. Newton PN, Green MD, Mildenhall DC, Plancon A, Nettey H, Nyadong L, et al. Poor quality vital anti-malarials in Africa - an urgent neglected public health priority. Malar J. 2011;10:352.

    Article  Google Scholar 

  4. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. ICH Harmonized Tripartite Guideline. Guideline for Good Clinical Practice E6(R1). 1996. www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf. Accessed 10 Oct 2017.

  5. World Health Organization. Forty-ninth Report of the WHO Expert Committee on Specifications for Pharmaceutical Preparations. 2015. http://apps.who.int/iris/handle/10665/176954. Accessed 10 Oct 2017.

  6. Ravinetto R, De NK, Boelaert M, Diro E, Meintjes G, Adoke Y, et al. Sponsorship in non-commercial clinical trials: definitions, challenges and the role of Good Clinical Practices guidelines. BMC Int Health Hum Rights. 2015;15:34.

    Article  Google Scholar 

  7. Renschler JP, Walters KM, Newton PN, Laxminarayan R. Estimated under-five deaths associated with poor-quality antimalarials in sub-Saharan Africa. Am J Trop Med Hyg. 2015;92:119–26.

    Article  Google Scholar 

  8. World Health Organization. Assessment of Medicines Regulatory Systems in Sub-Saharan African Countries. An Overview of Findings from 26 Assessment Reports. WHO/EMP/QSM/2010.4, 2014. http://apps.who.int/medicinedocs/documents/s17577en/s17577en.pdf. Accessed 10 Oct 2017.

  9. Tabernero P, Fernandez FM, Green M, Guerin PJ, Newton PN. Mind the gaps--the epidemiology of poor-quality anti-malarials in the malarious world--analysis of the WorldWide Antimalarial Resistance Network database. Malar J. 2014;13:139.

    Article  Google Scholar 

  10. Amin AA, Kokwaro GO. Antimalarial drug quality in Africa. J Clin Pharm Ther. 2007;32:429–40.

    Article  CAS  Google Scholar 

  11. Bate R, Coticelli P, Tren R, Attaran A. Antimalarial drug quality in the most severely malarious parts of Africa - a six country study. PLoS One. 2008;3:e2132.

    Article  Google Scholar 

  12. Dondorp AM, Newton PN, Mayxay M, Van DW, Smithuis FM, Yeung S, et al. Fake antimalarials in Southeast Asia are a major impediment to malaria control: multinational cross-sectional survey on the prevalence of fake antimalarials. Tropical Med Int Health. 2004;9:1241–6.

    Article  CAS  Google Scholar 

  13. WHO Essential Medicines and Pharmaceutical Policies. Survey of the Quality of Selected Antimalarial Medicines Circulating in Six Countries of Sub-Saharan Africa. WHO/EMP/QSM/2011.1. 2011. http://www.who.int/medicines/publications/WHO_QAMSA_report.pdf. Accessed 10 Oct 2017.

    Google Scholar 

  14. Nayyar GM, Breman JG, Newton PN, Herrington J. Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. Lancet Infect Dis. 2012;12:488–96.

    Article  Google Scholar 

  15. Newton PN, Schellenberg D, Ashley EA, Ravinetto R, Green MD, ter Kuile FO, et al. Quality assurance of drugs used in clinical trials: proposal for adapting guidelines. BMJ. 2015;350:h602.

    Article  Google Scholar 

  16. Idindili B, Masanja H, Urassa H, Bunini W, van JP, Aponte JJ, et al. Randomized controlled safety and efficacy trial of 2 vitamin A supplementation schedules in Tanzanian infants. Am J Clin Nutr. 2007;85:1312–9.

    Article  CAS  Google Scholar 

  17. Medicines and Healthcare Products Regulatory Agency. 2011. http://www.mhra.gov.uk/NewsCentre/Pressreleases/CON114481. Accessed 10 Oct 2017.

  18. International Conference on Harmonisation. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. ICH Harmonized Tripartite Guideline. Guideline for Good Clinical Practice E6(R1). 1996. www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf.

    Google Scholar 

  19. World Health Organization. International Standards for Clinical Trial Registries. 2012. http://apps.who.int/iris/bitstream/10665/76705/1/9789241504294_eng.pdf?ua=1. Accessed 24 Sep 2017.

    Google Scholar 

  20. Ravinetto R, Tinto H, Diro E, Okebe J, Mahendradhata Y, Rijal S, et al. It is time to revise the international good clinical practices guidelines: recommendations from non-commercial North-South collaborative trials. BMJ Glob Health. 2016;1:e000122.

    Article  Google Scholar 

  21. World Health Organization. International Clinical Trials Registry Platform. 2017. http://www.who.int/ictrp/network/primary/en/. Accessed 15 Aug 2017.

    Google Scholar 

  22. International Committee of Medical Journals Editors. Clinical Trial Registration. 2017. http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html. Accessed 24 Sep 2017.

    Google Scholar 

  23. Dominicus H, Doua J, Verstraeten T, Hergarden E. Online Availability of Regulatory Documents and Safety Information. In: 3rd Biennial Scientific Conference on Medical Products Regulation in Africa Book of Abstracts. Africa: African Medicines Regulatory Harmonisation program; 2017. p. 24–5.

  24. WHO Prequalification. Clarification with Respect to a Stringent Regulatory Organization as Applicable to the Stringent Regulatory Authority (SRA) Guideline. 2017. https://extranet.who.int/prequal/sites/default/files/documents/75%20SRA%20clarification_February2017_0.pdf. Accessed 30 Sep 2017.

    Google Scholar 

  25. Dutton G. cGMP Issues are Increasing in Pharma. Pharmaceutical Online. 2014. https://www.pharmaceuticalonline.com/doc/cgmp-issues-are-increasing-in-pharma-0001. Accessed 20 Oct 2017.

    Google Scholar 

Download references

Acknowledgements

We are grateful to prof Jean-Pierre Van Geertruyden, Head of the University of Antwerp’s Global Health Institute, Belgium; Dr. Raffaella Ravinetto, Head of the Clinical Trial Unit, Institute of Tropical Medicine of Antwerp, Belgium; and Dr. Ken Anujuo, PhD researcher at the Department of Public Health, Academic Medical Centre, University of Amsterdam, The Netherlands. We are thankful to our colleagues of the Consortium for African Regulatory Expertise Development (CARED), Voorburg, The Netherlands, for their support.

Funding

No funding was received for this research.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

YJD, JPVG, and RR conceived the original idea and discussed the initial study approach. MSG, JM, and JN contributed to study methods adjustment. YJD and HD collected the data. YJD and JM wrote the manuscript. HB, JM, MSG, and JN reviewed and corrected the manuscript. KA contributed to the writing. JN supervised the work. All authors and contributors have seen the final manuscript and agreed with submission. YJD is the guarantor of the article. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yorokpa Joachim Doua.

Ethics declarations

Author information

YJD was affiliated to the Benelux Pharmacovigilance Department, Janssen Global Medical Organisation of Johnson&Johnson as Deputy Cluster Safety Team Lead at the start of this research. He shifted later to the Janssen Infectious Diseases and Vaccines, Crucell Holland BV, in June 2018.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Reporting specific parameters to increase reproducibility of database studies. (DOCX 20 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Doua, Y.J., Dominicus, H., Mugwagwa, J. et al. Scarce quality assurance documentation in major clinical trial registries for approved medicines used in post-marketing clinical trials. Trials 20, 212 (2019). https://doi.org/10.1186/s13063-019-3277-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-019-3277-8

Keywords