EFPIA / EFSPI Estimand Implementation Working Group (EIWG)

Charter & Purpose

“EIWG brings together statisticians and clinicians to support the estimand journey”
  • To provide a cross-industry forum to:
    • share Industry and Academic experiences of implementing the new estimand framework introduced in ICH E9(R1)
    • discuss issues emerging through implementation
    • be champions and engage in scientific discussion about the value and benefits of the framework
  • With the aim to:
    • give feedback and recommendations for best practices
    • promote broad understanding and awareness of the framework within and outside of statistics
    • consolidate issues and topics for discussion with the ICH E9 Implementation Working Group
    • provide training through case studies, e.g., through the EIWG Estimand Training Academy
       
       

2024 Ongoing/planned Activities

  1. Training sub-Team
    • Planning on creating estimand webinars on neuroscience, early development and HTA
  2. Estimation sub-team
    • Publication on treatment policy estimation
  3. Reporting Subteam
    • Publication on the reporting of estimands and intercurrent events in clinical study reports
    • Successful collaboration with NIC on the reporting of estimands on “Clinicaltrials.gov”
  4. Estimands in Early Phase [I/II] & Clinical Pharmacology Studies sub-team
    • Develop a case study for implementing estimands for a dose-ranging (Ph2b) study
    • Develop a case study with focus on clinical pharmacology studies in pregnant and breast-feeding women
    • Input into guidance around implementing estimands for patient-reported outcomes in early phase trials
    • Explore estimands for concentration modelling for PD effect (e.g., concentration-QTc).
  5.  HTA and RWE sub-team
  6. Non-inferiority sub-team
    • PSI session on estimands in non-inferiority trials
    • First paper published
    • Paper initiated on case studies illustrating challenges discussed in first paper
  7. Intercurrent Event sub-team
    • Continue to identify areas of uncertainty around how the different intercurrent event strategies may be interpreted
    • Identify areas of uncertainty around whether certain events meet the definition of an intercurrent event
    • Identify and begin to implement appropriate strategies to reduce this uncertainty, e.g. through training materials, a possible publication, or feeding back to the ICH E9(R1) creators
  8. Communications sub-team
    • Establish an EIWG teams site for efficient communication and collaborative working
    • Homepage with working group updates and estimand resources, hosted and managed by the EIWG
    • PSI session on estimand thinking and statistical leadership
       

EIWG Members

The EIWG consists of 43 members representing 26 companies and institutions

 

2024 EIWG Sub-teams

 

2022 Achievements - Training sub-team

The training committee has continued to work on webinars for their training series ‘EIWG Estimand Training Academy’ targeting anyone working in clinical trials.

All trainings provided so far are freely available as ‘Video-on-Demand’

Portal: https://psiweb.org/vod/Index/ or YouTube on the EFPIA channel

2023 Achievements

  1. Non-inferiority sub-team
    • PSI 2023 presentation
    • Preparation of paper on estimands in non-inferiority trials
    • Preparation of PSI 2024 proposal including a panel of regulators
  2. Training sub-team
    • Organized the webinar "Proposing Estimands from Different Perspectives", which showed a case study in heart failure presented by the perspective of multiple stakeholders (patient, clinician, regulator, health technology assessor and statistician). The webinar had a record of more than 800 people registered to attend. (March 2023)
  3. Communications sub-team
    • Participated in APBG Estimands Webinar
    • Preparation of PSI 2024 proposal on estimand thinking and statistical leadership
  4. Estimation sub-team
    • Preparation of manuscript on treatment policy estimation
  5. Reporting sub-team
    • Agreed to collaborate with NIH on trial disclosure and estimands
    • Invited presentation at JSM 2023 by Melanie Wright “Realizing the benefits of estimands to increase transparency in the reporting and communication of trial results”
    • Preparation of manuscript on the reporting of estimands and intercurrent events in clinical study reports
  6. Intercurrent Events sub-team
    • Newly formed to tackle uncertainty around the meaning of different intercurrent event strategies, which is a major barrier to effective implementation of the estimands framework
    • Identified several key areas of uncertainty to target in 2024
  7. Estimands in Early Phase [I/II] & Clinical Pharmacology Studies sub-team
    • Submitted and received referee comments on paper “Tutorial on How Estimands can be Applied to Bioequivalence and Related Clinical Pharmacology Trials”. (Hope for open access in 2024).
    • Presented to PSI conference (linked to above bioequivalence topic) “Does it Make Sense to Apply the Estimand Framework to Clinical Pharmacology Trials”. June 2023
    • Reviewed and submitted comments for FDA draft guidance : Statistical Approaches to Establishing Bioequivalence (December 2022)
    • Knowledge sharing and discussion on a number of topics.
  8. HTA and RWE sub-team
    • Antonia Morga and Pepa Polavieja presented on behalf of the group on “The ICH E9(R1) Addendum in the context of Health Technology Assessments: methodological considerations and recommendations” at an Estimand session during the PSI conference in London (June 2023)
    • The group presented a poster at ISPOR Europe (November 2023) titled: “Estimands in Health Technology Assessments: methodological considerations and recommendations”

 

2022 Achievements - Estimation sub-team

Estimating the treatment-policy strategy with continuous data and incomplete post-IE follow-up is a relevant and under-researched issue. To address it, the group has assessed the performance of different estimators – based on either multiple imputation (MI) or mixed effect models (MMRM) – for simulated trials based on the HbA1c endpoint from the PIONEER1 study. The properties of the estimators (bias and variance shown here) generally confirm the equivalence of MI and MMRM approaches (if the same assumptions are made) and the particular importance of collecting post-IE data. The complex trade-off between variance inflation and accuracy needs to be carefully evaluated further.

2022 Achievements - Early Phase & Other Studies sub-team

This sub-team was created as a forum for both statisticians (industry & academia) and pharmacokinetics as well as regulators to help bridge the gap in the estimands framework with regards other study types including early phase and clinical pharmacology where the purpose is not confirmatory efficacy.

We presented a poster (Does the Estimand Framework Add Value to Clinical Pharmacology Trials?) at the PSI conference 2022. A manuscript is under preparation with focus on bioequivalence/bioavailability studies and is planned to be published in a clinical pharmacology journal in 2023.

The implementation of estimands in early phase studies (including dose finding and CRMs) are also being discussed within this workstream. We aim to share some of our work at the PSI conference in 2023.

2022 Achievements - Communications sub-team

In 2022 the homepage of the group was fully revised and summarizes all work of the EIWG.

Posters of the working group were presented at the 2022 PSI conference in Gothenburg and the 2022 Regulatory Industry workshop in Basel.

2022 Achievements - Estimands in non-inferiority trials sub-team

The ICH E9(R1) includes limited guidance in relation to non-inferiority (NI) trials. Current regulatory guidelines on NI trials predate the release of the addendum and the per protocol analysis set plays an important part in the EMA NI guidelines. In contrast, ICH E9(R1) questions the role of the per protocol set and this has led to confusion as regards to the applicability of the EMA Points to consider on switching between superiority and non-inferiority.

The sub-team is discussing which estimands can be considered relevant in an NI setting and how they fit into existing guidelines. The sub-team members are sharing recent regulatory feedback on NI trials, and we are discussing questions such as

  • What is the underlying clinical question to be answered in an NI trial?
  • Are two estimands with different strategies for intercurrent events required to reflect the spirit in the EMA Points to consider on switching between superiority and non-inferiority?
  • Can protocol violations be handled as intercurrent events? Is there any remaining role for a Per Protocol analysis set?
  • Can different estimands be used to show NI and superiority in the same trial (hierarchical set-up)?
  • How does the estimand framework impact the choice of the NI margin?

The sub-team is planning to prepare a manuscripton these topics.

EIWG Estimand Training Academy

  • Targeted to anyone working in clinical trials: Clinician, Regulator, Investigator, Academic, Ethics Committee, HTA Agencies, Statistician.

 

Publications

  • D. Wright, H. Lynggaard , S. Englert, V. Lanius, O. Keene. Why Estimands are Needed to Define Treatment Effects in Clinical Trials. BMC Medicine 21:276 (2023)
  • A. Morga, NR. Latimer, M. Scott, N. Hawkins, M. Schlichting, J. Wang. Is Intention to Treat Still the Gold Standard or Should Health Technology Assessment Agencies Embrace a Broader Estimands Framework?: Insights and Perspectives From NICE and IQWiG on the ICH E9(R1) Addendum. Value Health. 2022 Sep 20:S1098-3015(22)02148-9. https://doi.org/10.1016/j.jval.2022.08.008
  • H. Lynggaard, J. Bell, C. Lösch, A. Besseghir, K. Rantell, V. Schoder, V. Lanius. Principles and Recommendations for Incorporating Estimands into Clinical Study Protocol Templates. Trials (2022) https://doi.org/10.1186/s13063-022-06515-2
  • O. N. Keene, D. Wright, A. Phillips, M. Wright. Why ITT analysis is not always the answer for estimating treatment effects in clinical trials (2021). Contemporary Clinical Trials. https://doi.org/10.1016/j.cct.2021.106494
  • C. Fletcher, N. Hefting, M. Wright, J. Bell, J. Anzures-Cabrera, D Wright, H. Lynggaard, A. Schueler. Marking 2-years of new thinking in clinical trials - the estimand journey. Ther Innov Regul Sci 56, 637–650 (2022). https://doi.org/10.1007/s43441-022-00402-3 
     

Partnerships with related groups

  • European special interest group “Estimands in oncology”, sponsored by PSI and EFSPI and ASA scientific working group of the ASA biopharmaceutical section
    • Mission: The cross-industry working group (www.oncoestimand.org) was initiated to foster a common understanding and consistent implementation of the estimand framework in oncology clinical trials.
    • Liaison: Stefan Englert
  • PhUSE:
    • Mission: Sharing ideas, tools and standards around data, statistical and reporting technologies to advance the future of life sciences.
    • Liaison: Armin Schueler
  • TransCelerate:
    • Mission: TransCelerate BioPharma’s mission is to collaborate across the global biopharmaceutical research and development community to identify, prioritize, design, and facilitate the implementation of solutions designed to drive the efficient, effective and high-quality delivery of new medicines.
    • Liaison: Pepa Polavieja and Helle Lynggaard

Contact

The general spirit of the working group is inclusive. If you’d like to contribute in one or the other way, we propose you first reach out to your company’s representative(s) (if applicable) and align within your company who is best placed to contribute.

For further information, please reach out to:

Chrissie Fletcher
chrissie.a.fletcher@gsk.com