Characteristics to consider when selecting a positive control material for an in vitro assay
Main Article Content
Abstract
The use of in vitro assays to inform decision-making requires robust and reproducible results across studies, laboratories, and time. Experiments using positive control materials are an integral component of an assay procedure to demonstrate the extent to which the measurement system is performing as expected. This paper reviews ten characteristics that should be considered when selecting a positive control material for an in vitro assay: 1) the biological mechanism of action, 2) ease of preparation, 3) chemical purity, 4) verifiable physical properties, 5) stability, 6) ability to generate responses spanning the dynamic range of the assay, 7) technical or biological interference, 8) commercial availability, 9) user toxicity, and 10) disposability. Examples and a case study of the monocyte activation test are provided to demonstrate the application of these characteristics for identification and selection of potential positive control materials. Because specific positive control materials are often written into testing standards for in vitro assays, selection of the positive control material based on these characteristics can aid in ensuring the long-term relevance and usability of these standards.
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
Articles are distributed under the terms of the Creative Commons Attribution 4.0 International license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is appropriately cited (CC-BY). Copyright on any article in ALTEX is retained by the author(s).
Alexopoulou, L., Holt, A. C., Medzhitov, R. et al. (2001). Recognition of double-stranded RNA and activation of NF-κB by Toll-like receptor 3. Nature 413, 732-738. doi:10.1038/35099560
Aliprantis, A. O., Yang, R. B., Mark, M. R. et al. (1999). Cell activation and apoptosis by bacterial lipoproteins through toll-like receptor-2. Science 285, 736-739. doi:10.1126/science.285.5428.736
Avila, A. M., Bebenek, I., Bonzo, J. A. et al. (2020). An FDA/CDER perspective on nonclinical testing strategies: Classical toxicology approaches and new approach methodologies (NAMs). Regulatory Toxicology and Pharmacology 114, 104662. doi:10.1016/j.yrtph.2020.104662
Barosova, H., Maione, A. G., Septiadi, D. et al. (2020). Use of EpiAlveolar Lung Model to Predict Fibrotic Potential of Multiwalled Carbon Nanotubes. ACS Nano 14, 3941-3956. doi:10.1021/acsnano.9b06860
Basketter, D., Azam, P., Casati, S. et al. (2019). Applying non-animal strategies for assessing skin sensitisation report from an EPAA/cefic-LRI/IFRA Europe cross sector workshop, ECHA, February 7th and 8th 2019. Regulatory Toxicology and Pharmacology 109, 104477. doi:10.1016/j.yrtph.2019.104477
Borrel, A., Huang, R., Sakamuru, S. et al. (2020a). High-Throughput Screening to Predict Chemical-Assay Interference. Scientific Reports 10, 3986. doi:10.1038/s41598-020-60747-3
Borrel, A., Mansouri, K., Nolte, S. et al. (2020b). InterPred: a webtool to predict chemical autofluorescence and luminescence interference. Nucleic Acids Research 48, W586-W590. doi:10.1093/nar/gkaa378
Borton, L. K. and Coleman, K. P. (2018). Material-Mediated Pyrogens in Medical Devices: Applicability of the In Vitro Monocyte Activation Test. ALTEX 35, 453-463. doi:10.14573/altex.1709221
Brown, J., Clippinger, A. J., Fritz Briglia, C. et al. (2021) “Using the monocyte activation test as a stand-alone release test for medical devices”, ALTEX 38, 151-156. doi:10.14573/altex.2012021
Browne, P., Judson, R. S., Casey, W. M. et al. (2015). Screening Chemicals for Estrogen Receptor Bioactivity Using a Computational Model. Environmental Science & Technology 49, 8804-8814. doi:10.1021/acs.est.5b02641
Chipinda, I., Ajibola, R. O., Morakinyo, M. K. et al. (2010). Rapid and Simple Kinetics Screening Assay for Electrophilic Dermal Sensitizers Using Nitrobenzenethiol. Chemical Research in Toxicology 23, 918-925. doi:10.1021/tx100003w
Coleman, K. P., Grailer, T. P., McNamara, L. R. et al. (2018). Preparation of irritant polymer samples for an in vitro round robin study. Toxicology in Vitro 50, 401-406. doi:10.1016/j.tiv.2018.01.018
Dahlin, J. L., Nelson, K. M., Strasser, J. M. et al. (2017). Assay interference and off-target liabilities of reported histone acetyltransferase inhibitors. Nature Communications 8, 1527. doi:10.1038/s41467-017-01657-3
de Oliviera Nascimento, L., Massari, P. and Wetzler, L. (2012). The Role of TLR2 in Infection and Immunity. Frontiers in Immunology 3, doi:10.3389/fimmu.2012.00079
Deininger, S., Stadelmaier, A., von Aulock, S. et al. (2003). Definition of structural prerequisites for lipoteichoic acid-inducible cytokine induction by synthetic derivatives. Journal of Immunology 170, 4134-4138. doi:10.4049/jimmunol.170.8.4134
Deininger, S., Figueroa-Perez, I., Sigel, S. et al. (2007). Use of synthetic derivatives to determine the minimal active structure of cytokine-inducing lipoteichoic acid. Clinical and Vaccine Immunology 14, 1629-1633. doi:10.1128/CVI.00007-07
EDQM – European Directorate for the quality of Medicines and HealthCare (2010). General Chapter 2.6.30. Monocyte-activation test. European Pharmacopoeia.
Elliott, J. T., Rosslein, M., Song, N. W. et al. (2017). Toward Achieving Harmonization in a Nanocytotoxicity Assay Measurement Through an Interlaboratory Comparison Study. ALTEX 34, 201-218. doi:10.14573/altex.1605021
EPA – Environmental Protection Agency (2014). SW-846 Test Method 4435: Screening For Dioxin-Like Chemical Activity In Soils And Sediments Using The Calux Bioassay And Toxic Equivalents (TEQs) Determinations. Available at https://www.epa.gov/hw-sw846/sw-846-test-method-4435-screening-dioxin-chemical-activity-soils-and-sediments-using-calux.
EC – European Commission (2020). 2019 report on the statistics on the use of animals for scientific purposes in the Member States of the European Union in 2015-2017. Available at https://ec.europa.eu/environment/chemicals/lab_animals/pdf/Statistical%20report_SWD_p1_EN.pdf.
Figueiredo, R. T., Carneiro, L. A. M. and Bozza, M. T. (2011). Fungal surface and innate immune recognition of filamentous fungi. Frontiers in Microbiology 2, doi:10.3389/fmicb.2011.00248
Groff, K., Allen, D., Casey, W. et al. (2020). Increasing the use of animal-free recombinant antibodies. ALTEX 37, 309-311. doi:10.14573/altex.2001071
Guadagnini, R., Kenzaoui, B. H., Walker, L. et al. (2015). Toxicity screenings of nanomaterials: challenges due to interference with assay processes and components of classic in vitro tests. Nanotoxicology 9, 13-24. doi:10.3109/17435390.2013.829590
Hanna, S. K., Montoro Bustos, A. R., Peterson, A. W. et al. (2018). Agglomeration of Escherichia coli with Positively Charged Nanoparticles Can Lead to Artifacts in a Standard Caenorhabditis elegans Toxicity Assay. Environmental Science & Technology 52, 5968-5978. doi:10.1021/acs.est.7b06099
Hartmann, G. and Krieg, A. M. (1999). CpG DNA and LPS induce distinct patterns of activation in human monocytes. Gene Ther 6, 893-903. doi:10.1038/sj.gt.3300880
Hartung, T., Balls, M., Bardouille, C. et al. (2002). Good Cell Culture Practice. ECVAM Good Cell Culture Practice Task Force Report 1. Altern Lab Anim 30, 407-414. doi:10.1177/026119290203000404
Hartung, T. (2015). The Human Whole Blood Pyrogen Test - Lessons Learned in Twenty Years. ALTEX 32, 79-100. doi:10.14573/altex.1503241
Hartung, T. (2021) “Pyrogen testing revisited on occasion of the 25th anniversary of the whole blood monocyte activation test”, ALTEX 38, 3-19. doi:10.14573/altex.2101051
Hasiwa, N., Daneshian, M., Bruegger, P. et al. (2013). Evidence for the Detection of Non-Endotoxin Pyrogens by the Whole Blood Monocyte Activation Test. ALTEX 30, 169-208. doi:10.14573/altex.2013.2.169
Hayashi, F., Smith, K. D., Ozinsky, A. et al. (2001). The innate immune response to bacterial flagellin is mediated by Toll-like receptor 5. Nature 410, 1099-1103. doi:10.1038/35074106
Holland-Letz, T. and Kopp-Schneider, A. (2015). Optimal experimental designs for dose-response studies with continuous endpoints. Archives of toxicology 89, 2059-2068. doi:10.1007/s00204-014-1335-2
Holland-Letz, T. (2017). On the combination of c- and D-optimal designs: General approaches and applications in dose–response studies. Biometrics 73, 206-213. doi:10.1111/biom.12545
Huth, J. R., Mendoza, R., Olejniczak, E. T. et al. (2005). ALARM NMR: A Rapid and Robust Experimental Method To Detect Reactive False Positives in Biochemical Screens. Journal of the American Chemical Society 127, 217-224. doi:10.1021/ja0455547
ICCVAM – Interagency Coordinating Committee on the Validation of Alternative Methods (2008). ICCVAM Test Method Evaluation Report:Validation Status of Five In Vitro Test Methods Proposed for Assessing Potential Pyrogenicity of Pharmaceuticals and Other Products.
ISO– International organization for standardization (2010). 10993-10:2010: Biological evaluation of medical devices — part 10: Tests for irritation and skin sensitization.
ISO (2012). 10993-12:2012: Biological evaluation of medical devices — part 12: Sample preparation and reference materials
ISO (2015). Guide 30: 2015: Reference materials - selected terms and definitions.
Keene, A. M., Bancos, S. and Tyner, K. M. (2014). Considerations for In Vitro Nanotoxicity Testing. In (eds.), Handbook of Nanotoxicology, Nanomedicine and Stem Cell Use in Toxicology. doi:10.1002/9781118856017.ch2
Kleinstreuer, N. C., Ceger, P., Watt, E. D. et al. (2017). Development and Validation of a Computational Model for Androgen Receptor Activity. Chem Res Toxicol 30, 946-964. doi:10.1021/acs.chemrestox.6b00347
Kleinstreuer, N. C., Karmaus, A., Mansouri, K. et al. (2018). Predictive Models for Acute Oral Systemic Toxicity: A Workshop to Bridge the Gap from Research to Regulation. Computational toxicology (Amsterdam, Netherlands) 8, 21-24. doi:10.1016/j.comtox.2018.08.002
Kolle, S. N., Hil, E., Raabe, H. et al. (2019). Regarding the references for reference chemicals of alternative methods. Toxicology in Vitro 57, 48-53. doi:10.1016/j.tiv.2019.02.007
Leibrock, L., Jungnickel, H., Tentschert, J. et al. (2020). Parametric optimization of an air-liquid interface system for flow-through inhalation exposure to nanoparticles: assessing dosimetry and intracellular uptake of CeO2 nanoparticles. Nanomaterials 10, article number 2369. doi:10.3390/nano10122369
Mansouri, K. (2017). OPERA: command line application providing QSAR models predictions and accuracy assessment for physicochemical properties and environmental fate endpoints. Available at: https://github.com/kmansouri/OPERA. doi:10.1186/s13321-018-0263-1
Molenaar-de Backer, M. W. A., Gitz, E., Dieker, M. et al. (2020). Performance of monocyte activation test supplemented with human serum compared to fetal bovine serum. ALTEX Epub ahead of print. doi:10.14573/altex.2008261
Morath, S., Stadelmaier, A., Geyer, A. et al. (2002). Synthetic lipoteichoic acid from Staphylococcus aureus is a potent stimulus of cytokine release. Journal of Experimental Medicine 195, 1635-1640. doi:10.1084/jem.20020322
Morath, S., von Aulock, S. and Hartung, T. (2005). Structure/function relationships of lipoteichoic acids. Journal of Endotoxin Research 11, 348-356. doi:10.1179/096805105X67328
Nelson, B. C., Petersen, E. J., Marquis, B. J. et al. (2013). NIST gold nanoparticle reference materials do not induce oxidative DNA damage. Nanotoxicology 7, 21-29. doi:10.3109/17435390.2011.626537
Netea, M. G., Kullberg, B. J. and Van der Meer, J. W. M. (2000). Circulating cytokines as mediators of fever. Clinical Infectious Diseases 31, S178-S184. doi:10.1086/317513
Nomura, Y., Lee, M., Fukui, C. et al. (2018). Proof of concept testing of a positive reference material for in vivo and in vitro skin irritation testing. Journal of Biomedical Materials Research Part B-Applied Biomaterials 106, 2807-2814. doi:10.1002/jbm.b.34061
OECD – Organization for Economic Cooperation and Development (2005). Guidance document 34: Guidance document on the validation and international acceptance of new or updated test methods for hazard assessment. http://www.oecd.org/officialdocuments/displaydocument/?cote=env/jm/mono(2005)14&doclanguage=en
OECD (2018). Guidance Document on Good In Vitro Method Practices (GIVIMP), OECD Series on Testing and Assessment, No. 286, OECD Publishing, Paris, doi:10.1787/9789264304796-en
OECD (2019). Test No. 442C: In Chemico Skin Sensitisation. doi:10.1787/9789264229709-en
Park, B. S. and Lee, J. O. (2013). Recognition of lipopolysaccharide pattern by TLR4 complexes. Experimental and Molecular Medicine 45, doi:10.1038/emm.2013.97
Petersen, E. J., Henry, T. B., Zhao, J. et al. (2014). Identification and Avoidance of Potential Artifacts and Misinterpretations in Nanomaterial Ecotoxicity Measurements. Environmental Science & Technology 48, 4226-4246. doi:10.1021/es4052999
Petersen, E. J., Hirsch, C., Elliott, J. T. et al. (2020a). Cause-and-Effect Analysis as a Tool To Improve the Reproducibility of Nanobioassays: Four Case Studies. Chemical Research in Toxicology 33, 1039-1054. doi:10.1021/acs.chemrestox.9b00165
Petersen, E. J., Hirsch, C., Elliott, J. T. et al. (2020b). Cause-and-Effect Analysis as a Tool To Improve the Reproducibility of Nanobioassays: Four Case Studies. Chemical Research in Toxicology in press. doi:10.1021/acs.chemrestox.9b00165
Plant, A. L., Locascio, L. E., May, W. E. et al. (2014). Improved reproducibility by assuring confidence in measurements in biomedical research. Nat Meth 11, 895-898. doi:10.1038/nmeth.3076
Poole, S., Desai, T., Findlay, L. et al. (2012). WHO International Standard for endotoxin Report of an international collaborative study to evaluate three preparations of endotoxin for their suitability to serve as the third international standard for bacterial endotoxin, (October), pp. 1–40. Available at: http://www.who.int/about/licensing/copyright_form/en/index.html.
Roesslein, M., Hirsch, C., Kaiser, J. P. et al. (2013). Comparability of in Vitro Tests for Bioactive Nanoparticles: A Common Assay to Detect Reactive Oxygen Species as an Example. International Journal of Molecular Sciences 14, 24320-24337. doi:10.3390/ijms141224320
Rösslein, M., Elliott, J. T., Salit, M. et al. (2015). Use of Cause-and-Effect Analysis to Design a High-Quality Nanocytotoxicology Assay. Chemical Research in Toxicology 28, 21-30. doi:10.1021/tx500327y
Rudbach, J. A., Akiya, F. I., Elin, R. J. et al. (1976). Preparation and properties of a national reference endotoxin. Journal of Clinical Microbiology 3, 21-25.
Schwandner, R., Dziarski, R., Wesche, H. et al. (1999). Peptidoglycan- and lipoteichoic acid-induced cell activation is mediated by toll-like receptor 2. Journal of Biological Chemistry 274, 17406-17409. doi:10.1074/jbc.274.25.17406
Stadelmaier, A., Morath, S., Hartung, T. et al. (2003). Synthesis of the first fully active lipoteichoic acid. Angewandte Chemie-International Edition 42, 916-+. doi:10.1002/anie.200390243
Urbisch, D., Mehling, A., Guth, K. et al. (2015). Assessing skin sensitization hazard in mice and men using non-animal test methods. Regulatory Toxicology and Pharmacology 71, 337-351. doi:10.1016/j.yrtph.2014.12.008
United States (1973). Federal hazardous substances act. In: Title 16 Code of Federal Regulations
Part 1500: United States Code.
US FDA – United States Food and Drug Administration (2012). Guidance for Industry Pyrogen and Endotoxins Testing: Questions and Answers. Available at: https://www.fda.gov/media/83477/download.
US FDA (2016). Use of International Standard ISO 10993-1, ‘Biological evaluation of medical devices - Part 1: Evaluation and testing within a risk management process’, Department of Health and Human Services Food and Drug Administration. doi: https://www.fda.gov/media/85865/download.
US FDA (2018). Bioanalytical Method Validation Guidance for Industry.
US Pharmacopeia (2012). Bacterial Endotoxins Test - Chapter 85, United States Pharmacopeia, 37(85), pp. 1–5.