Applying evidence-based methods to the development and use of adverse outcome pathways

Main Article Content

Rob B. M. de Vries
Michelle Angrish
Patience Browne
Jan Brozek
Andrew A. Rooney
Daniele S. Wikoff
Paul Whaley
Stephen W. Edwards
Rebecca L. Morgan
Ingrid L. Druwe
Sebastian Hoffmann
Thomas Hartung
Kristina Thayer
Marc T. Avey
Brandiese E. J. Beverly
Maicon Falavigna
Catherine Gibbons
Katy Goyak
Andrew Kraft
Fernando Nampo
Amir Qaseem
Meg Sears
Jasvinder A. Singh
Catherine Willett
Erin Y. Yost
Holger Schünemann
Katya Tsaioun


The workshop “Application of evidence-based methods to construct mechanistic frameworks for the development and use of non-animal toxicity tests” was organized by the Evidence-based Toxicology Collaboration and hosted by the Grading of Recommendations Assessment, Development and Evaluation Working Group on June 12, 2019. The purpose of the workshop was to bring together international regulatory bodies, risk assessors, academic scientists, and industry to explore how systematic review methods and the adverse outcome pathway framework could be combined to develop and use mechanistic test methods for predicting the toxicity of chemical substances in an evidence-based manner. The meeting covered the history of biological frameworks, the way adverse outcome pathways are currently developed, the basic principles of systematic methodology, including systematic reviews and evidence maps, and assessment of certainty in models, and adverse outcome pathways in particular. Specific topics were discussed via case studies in small break-out groups. The group concluded that adverse outcome pathways provide an important framework to support mechanism-based assessment in environmental health. The process of their development has a few challenges that could be addressed with systematic methods and automation tools. Addressing these challenges will increase the transparency of the evidence behind adverse outcome pathways and the consistency with which they are defined; this in turn will increase their value for supporting public health decisions. It was suggested to explore the details of applying systematic methods to adverse outcome pathway development in a series of case studies and workshops.

Article Details

How to Cite
de Vries, R. B. M., Angrish, M., Browne, P., Brozek, J., Rooney, A. A., Wikoff, D. S., Whaley, P., Edwards, S. W., Morgan, R. L., Druwe, I. L., Hoffmann, S., Hartung, T., Thayer, K., Avey, M. T., Beverly, B. E. J., Falavigna, M., Gibbons, C., Goyak, K., Kraft, A., Nampo, F., Qaseem, A., Sears, M., Singh, J. A., Willett, C., Yost, E. Y. ., Schünemann, H. and Tsaioun, K. (2021) “Applying evidence-based methods to the development and use of adverse outcome pathways”, ALTEX - Alternatives to animal experimentation. doi: 10.14573/altex.2101211.
Meeting Reports

Beronius, A., Molander, L., Zilliacus, J. et al. (2018). Testing and refining the science in risk assessment and policy (SciRAP) web-based platform for evaluating the reliability and relevance of in vivo toxicity studies. J Appl Toxicol 38, 1460-1470. doi:10.1002/jat.3648

Browne, P., Judson, R. S., Casey, W. M. et al. (2015). Screening chemicals for estrogen receptor bioactivity using a computational model. Environ Sci Technol 49, 8804-8814. doi:10.1021/acs.est.5b02641

Brozek, J. L., Canelo-Aybar, C., Akl, E. A. et al. (2021). GRADE guidelines 30: The GRADE approach to assessing the certainty of modeled evidence-an overview in the context of health decision-making. J Clin Epidemiol 129, 138-150. doi:10.1016/j.jclinepi.2020.09.018

Collier, Z. A., Gust, K. A., Gonzalez-Morales, B. et al. (2016). A weight of evidence assessment approach for adverse outcome pathways. Regul Toxicol Pharmacol 75, 46-57. doi:10.1016/j.yrtph.2015.12.014

EFSA (2010). Application of systematic review methodology to food and feed safety assessments to support decision making. EFSA J 8, 1637. doi:10.2903/j.efsa.2010.1637

EPA (2018). Application of Systematic Review in TSCA Risk Evaluations.

Griesinger, C., Hoffmann, S., Kinsner, A. et al. (2008). The emerging concept of evidence-based toxicology (EBT) – Results of the 1st international forum towards EBT. ALTEX 25, Suppl 1.

Groh, K. J., Carvalho, R. N., Chipman, J. K. et al. (2015). Development and application of the adverse outcome pathway framework for understanding and predicting chronic toxicity: I. Challenges and research needs in ecotoxicology. Chemosphere 120, 764-777. doi:10.1016/j.chemosphere.2014.09.068

Guyatt, G., Oxman, A. D., Akl, E. A. et al. (2011). Grade guidelines: 1. Introduction-grade evidence profiles and summary of findings tables. J Clin Epidemiol 64, 383-394. doi:10.1016/j.jclinepi.2010.04.026

Guyatt, G. H., Webber, C. E., Mewa, A. A. et al. (1984). Determining causation – A case study: Adrenocorticosteroids and osteoporosis: Should the fear of inducing clinically important osteoporosis influence the decision to prescribe adrenocorticosteroids? J Chronic Dis 37, 343-352. doi:10.1016/0021-9681(84)90100-0

Hill, A. B. (1965). The environment and disease: Association or causation? Proc R Soc Med 58, 295-300.

Hoffmann, S., de Vries, R. B. M., Stephens, M. L. et al. (2017). A primer on systematic reviews in toxicology. Arch Toxicol 91, 2551-2575. doi:10.1007/s00204-017-1980-3

Hoffmann, S., Kleinstreuer, N., Alepee, N. et al. (2018). Non-animal methods to predict skin sensitization (I): The Cosmetics Europe database. Crit Rev Toxicol 48, 344-358. doi:10.1080/10408444.2018.1429385

Hooijmans, C. R., Rovers, M. M., de Vries, R. B. M. et al. (2014). Syrcle’s risk of bias tool for animal studies. BMC Med Res Methodol 14, 43. doi:10.1186/1471-2288-14-43

Howard, B. E., Phillips, J., Miller, K. et al. (2016). Swift-review: A text-mining workbench for systematic review. Syst Rev 5, 87. doi:10.1186/s13643-016-0263-z

Jadad, A. R., Moore, R. A., Carroll, D. et al. (1996). Assessing the quality of reports of randomized clinical trials: Is blinding necessary? Control Clinl Trials 17, 1-12. doi:10.1016/0197-2456(95)00134-4

Judson, R. S., Magpantay, F. M., Chickarmane, V. et al. (2015). Integrated model of chemical perturbations of a biological pathway using 18 in vitro high-throughput screening assays for the estrogen receptor. Toxicol Sci 148, 137-154. doi:10.1093/toxsci/kfv168

Kleinstreuer, N. C., Ceger, P. C., Allen, D. G. et al. (2016). A curated database of rodent uterotrophic bioactivity. Environ Health Perspect 124, 556-562. doi:10.1289/ehp.1510183

Kleinstreuer, N. C., Hoffmann, S., Alepee, N. et al. (2018). Non-animal methods to predict skin sensitization (II): An assessment of defined approaches*. Crit Rev Toxicol 48, 359-374. doi:10.1080/10408444.2018.1429386

Lam, J., Koustas, E., Sutton, P. et al. (2014). The navigation guide – Evidence-based medicine meets environmental health: Integration of animal and human evidence for PFOA effects on fetal growth. Environ Health Perspect 122, 1040-1051. doi:10.1289/ehp.1307923

Leist, M., Ghallab, A., Graepel, R. et al. (2017). Adverse outcome pathways: Opportunities, limitations and open questions. Arch Toxicol 91, 3477-3505. doi:10.1007/s00204-017-2045-3

Meek, M. E. (2014). Evolution of mode of action/adverse outcome pathway analyses. Toxicol Lett 229, S10. doi:10.1016/j.toxlet.2014.06.063

Molander, L., Ågerstrand, M., Beronius, A. et al. (2015). Science in risk assessment and policy (SciRAP): An online resource for evaluating and reporting in vivo (eco)toxicity studies. Hum Ecol Risk Assess 21, 753-762. doi:10.1080/10807039.2014.928104

Morgan, M. M., Johnson, B. P., Livingston, M. K. et al. (2016a). Personalized in vitro cancer models to predict therapeutic response: Challenges and a framework for improvement. Pharmacol Ther 165, 79-92. doi:10.1016/j.pharmthera.2016.05.007

Morgan, R. L., Thayer, K. A., Bero, L. et al. (2016b). GRADE: Assessing the quality of evidence in environmental and occupational health. Environ Int 92-93, 611-616. doi:10.1016/j.envint.2016.01.004

Morgan, R. L., Whaley, P., Thayer, K. A. et al. (2018). Identifying the PECO: A framework for formulating good questions to explore the association of environmental and other exposures with health outcomes. Environ Int 121, 1027-1031. doi:10.1016/j.envint.2018.07.015

OECD (2016). Guidance Document for the Use of Adverse Outcome Pathways in Developing Integrated Approaches to Testing and Assessment (IATA). OECD Series on Testing and Assessment, No. 260. OECD Publishing, Paris.

OECD (2017a). Revised Guidance Document on Developing and Assessing Adverse Outcome Pathways. OECD Series on Testing and Assessment, No. 184. OECD Publishing, Paris.

OECD (2017b). Guidance Document on the Reporting of Defined Approaches to be Used Within Integrated Approaches to Testing and Assessment. OECD Series on Testing and Assessment, No. 255. OECD Publishing, Paris. doi:10.1787/9789264274822-en

Parmelli, E., Amato, L., Oxman, A. D. et al. (2017). GRADE evidence to decision (EtD) framework for coverage decisions. Int J Technol Assess Health Care 33, 176-182. doi:10.1017/s0266462317000447

Rooney, A. A., Boyles, A. L., Wolfe, M. S. et al. (2014). Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect 122, 711-718. doi:10.1289/ehp.1307972

Rooney, A. A., Cooper, G. S., Jahnke, G. D. et al. (2016). How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards. Environ Int 92-93, 617-629. doi:10.1016/j.envint.2016.01.005

Scholten, R. J., Clarke, M. and Hetherington, J. (2005). The Cochrane Collaboration. Eur J Clin Nutr 59, Suppl 1, S147-149; discussion S195-146. doi:10.1038/sj.ejcn.1602188

Schünemann, H., Hill, S., Guyatt, G. et al. (2011). The GRADE approach and Bradford Hill’s criteria for causation. J Epidemiol Community Health 65, 392-395. doi:10.1136/jech.2010.119933

Smith, M. T., Guyton, K. Z., Gibbons, C. F. et al. (2016). Key characteristics of carcinogens as a basis for organizing data on mechanisms of carcinogenesis. Environ Health Perspect 124, 713-721. doi:10.1289/ehp.1509912

Stephens, M. L., Betts, K., Beck, N. B. et al. (2016). The emergence of systematic review in toxicology. Toxicol Sci 152, 10-16. doi:10.1093/toxsci/kfw059

Thayer, K. A., Wolfe, M. S., Rooney, A. A. et al. (2014). Intersection of systematic review methodology with the NIH reproducibility initiative. Environ Health Perspect 122, A176-177. doi:10.1289/ehp.1408671

Tsafnat, G., Dunn, A., Glasziou, P. et al. (2013). The automation of systematic reviews. BMJ 346, f139. doi:10.1136/bmj.f139

Tsaioun, K. K., S. A. (2010). ADMET for Medicinal Chemists: A Practical Guide. John Wiley & Sons, Inc. doi:10.1002/9780470915110

Tugwell, P., Bennett, K. J., Sackett, D. L. et al. (1985). The measurement iterative loop: A framework for the critical appraisal of need, benefits and costs of health interventions. J Chronic Dis 38, 339-351. doi:10.1016/0021-9681(85)90080-3

Van der Mierden, S., Tsaioun, K., Bleich, A. et al. (2019). Software tools for literature screening in systematic reviews in biomedical research. ALTEX 36, 508-517. doi:10.14573/altex.1902131

van Vliet, E., Kuhnl, J., Goebel, C. et al. (2018). State-of-the-art and new options to assess T cell activation by skin sensitizers: Cosmetics Europe workshop. ALTEX 35, 179-192. doi:10.14573/altex.1709011

Vandenberg, L. N., Ågerstrand, M., Beronius, A. et al. (2016). A proposed framework for the systematic review and integrated assessment (SYRINA) of endocrine disrupting chemicals. Environ Health 15, 74. doi:10.1186/s12940-016-0156-6

Villeneuve, D. L., Crump, D., Garcia-Reyero, N. et al. (2014). Adverse outcome pathway development II: Best practices. Toxicol Sci 142, 321-330. doi:10.1093/toxsci/kfu200

Whaley, P., Halsall, C., Ågerstrand, M. et al. (2016). Implementing systematic review techniques in chemical risk assessment: Challenges, opportunities and recommendations. Environ Int 92-93, 556-564. doi:10.1016/j.envint.2015.11.002

Wolffe, T. A. M., Whaley, P., Halsall, C. et al. (2019). Systematic evidence maps as a novel tool to support evidence-based decision-making in chemicals policy and risk management. Environ Int 130, 104871. doi:10.1016/j.envint.2019.05.065

Woodruff, T. J. and Sutton, P. (2014). The navigation guide systematic review methodology: A rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122, 1007-1014. doi:10.1289/ehp.1307175

Most read articles by the same author(s)

1 2 3 4 5 6 7 8 9 10 > >>