Showing posts with label intercurrent event. Show all posts
Showing posts with label intercurrent event. Show all posts

Friday, August 23, 2024

Estimand Framework - discussions at JSM 2024

In the Joint Statistical Meetings 2024, there was a session "Global Impact of the ICH E9(R1) Addendum - 5-Year Anniversary for the Trial Estimand Framework". In this session, panel members discussed the global impact of this guidance at its 5-year anniversary. Members from different regulatory agencies and the pharmaceutical industry, including members from the ICH E9(R1) Expert Working Group, reflected on multiple aspects of the impact of the estimand framework and the current stage of its broad implementation across clinical trials, including:
  • impact of the estimand framework to regulatory interactions, trial planning, drug approval process and labeling
  • examples of estimand framework implementation
  • disease-specific regulatory guidance documents using the estimand framework, including future plans
  • implementation of the ICH E9(R1) Addendum in clinical trial practice, from start (planning a trial, protocol development) to finish (reporting, communication and dissemination of results) and any remaining challenges
  • estimand thinking process and multi-disciplinary collaborations
  • estimand-related initiatives and their global impact
  • development of statistical methodologies (e.g. missing data and causal inference methods) triggered by the ICH E9(R1) Addendum;
  • standardizations efforts that facilitate the implementation of this framework; opportunities for the future.
The ICH E9(R1) guideline has been formally endorsed by major regulatory agencies such as the EMA, FDA, HC, and PMDA. The concepts of estimands and intercurrent events are frequently addressed in regulatory feedback on study protocols and statistical analysis plans. However, these topics have yet to gain traction in disease-specific scientific conferences. For instance, at several conferences and congresses focused on cardiovascular and pulmonary diseases, I observed a notable absence of presentations or abstracts discussing the estimand framework. Within the industry, estimands and intercurrent events are often seen as purely statistical concepts, primarily relevant to statisticians.

Estimand: A precise description of the treatment effect reflecting the clinical question posed by the trial objective. It summarises at a population-level what the outcomes would be in the same patients under different treatment conditions being compared. 

Estimator: A method of analysis to compute an estimate of the estimand using clinical trial data.
Estimate: A numerical value computed by an estimator. 

A question arose regarding the lack of an appropriate estimator for the corresponding estimand. Stephen Ruberg, from the audience, provided an insightful response by quoting John Tukey: 'An approximate answer to the right problem is worth a good deal more than an exact answer to an approximate problem. The greatest value of a picture is when it forces us to notice what we never expected to see. An approximate answer to the right question is worth far more than a precise answer to the wrong one.' In the context of the estimand framework, it is crucial to ask the right question and define the estimand accurately. While an exact estimator for the proposed estimand may not exist, it can often be reasonably approximated.

The estimand framework has been built into some disease-specific regulatory guidance documents. For example, in FDA's guidance for industry "Graft-versus-Host Diseases: Developing Drugs, Biological Products, and Certain Devices for Prevention or Treatment", the estimand and intercurrent events are extensively discussed and example estimands are provided. 



Monday, January 15, 2024

Terminal events as intercurrent events in clinical trials

ICH E9 "Addendum on Estimands and Sensitivity Analysis in Clinical Trials to the Guideline on Statistical Principles for Clinical Trials" contained discussions about intercurrent events and strategies for handling intercurrent events. Intercurrent events were defined as: 

Events occurring after treatment initiation that affect either the interpretation or the existence of the measurements associated with the clinical question of interest. It is necessary to address intercurrent events when describing the clinical question of interest in order to precisely define the treatment effect that is to be estimated.

The terminal events are one kind of intercurrent event. ICH E9 Addendum did not provide the formal definition for 'terminal events', but gave examples of the terminal events: 

Examples of intercurrent events that would affect the existence of the measurements include terminal events such as death and leg amputation (when assessing symptoms of diabetic foot ulcers), when these events are not part of the variable itself.

In a paper by Siegel et al "The role of occlusion: potential extension of the ICH E9 (R1) Addendum on Estimands and Sensitivity Analysis for Time-to-Event oncology studies", the terminal events were described as the following: 

The estimands guidance also introduces the concept of a terminal event. Terminal events prevent the possibility of subsequent measurement. "For terminal events such as death, the variable cannot be measured after the intercurrent event, but neither should these data generally be regarded as missing." There are two examples given in the guidance, death and leg amputation. These examples clarify that terminal events physically prevent subsequent measurement, for any estimand in any study. 

Terminality is an objective property of an event which renders further observation physically impossible. If an event is terminal, it is impossible to devise a study that can look beyond it. Indeed there is no meaningful clinical question regarding the treatment effect that manifests after a terminal event. 

Terminal events can be defined as events that make the outcome measures impossible and the events are not part of the outcome such as death and ankle amputation in a trial assessing ankle function). Sometimes, the outcome measure after the terminal events may still be possible, but the measures after the terminal events are not meaningful. For example, in clinical trials of pulmonary diseases with spirometry measure as the primary outcome, lung transplantation will be a terminal event. After the lung transplantation, the spirometry measure can still be performed, but the spirometry measure is a reflection of the transplanted lungs, not the intended measure of the clinical trial endpoint. 

Terminal events should be separated as fatal (death, mortality) and non-fatal terminal events (may be called 'terminal events excluding mortality'). While they are all considered intercurrent events, the strategies for handling the fatal and non-fatal terminal events need to be different. 

Strategies for Handling the Fatal Terminal Events

Treatment policy strategy can not be used for handling fatal terminal events (death events). ICH E9 Addendum mentioned the following: 

In general, the treatment policy strategy cannot be implemented for intercurrent events that are terminal events, since values for the variable after the intercurrent event do not exist. For example, an estimand based on this strategy cannot be constructed with respect to a variable that cannot be measured due to death.

Composite strategies (or composite variable strategies) are particularly useful for handling fatal terminal events (deaths). The occurrence of the fatal terminal intercurrent event is informative about the effect of the treatment and so it is incorporated in the endpoint. In practice, the outcomes after the fatal terminal intercurrent event can not be observed, but need to be assumed to have the worst values. 

With the composite strategy, the terminal intercurrent events will be assigned a failed value. A failed value may be:

    • Worse possible measure (for example, 0 for 6MWD and 0 for FEV1 or FVC measures)
    • Worst observed value across all subjects at the endpoint visit
    • Trimmed means (trimmed means and quantiles were mentioned in ICH E9 addendum training materials)
    • The worst change (from baseline) of all subjects plus a random error. The error can be randomly drawn from a normal distribution with a mean of 0 and a variance equal to the residual variance estimated from the mixed model for all observed values of change from baseline
In FDA's guidance, "Amyotrophic Lateral Sclerosis: Developing Drugs for Treatment Guidance for Industry", deaths were integrated into the functional measure by the ALS Functional Rating Scale-Revised (ALSFRS-R). The guidance said:
Functional endpoints can be confounded by loss of data because of patient deaths. To address this, FDA recommends sponsors use an analysis method that combines survival and function into a single overall measure, such as the joint rank test.
In pivotal clinical trials in ALS, the joint rank test is almost the default method for analyzing the primary efficacy endpoint of the ALSFRS-R. The Joint Rank statistic ranks study participants in each treatment group, first by survival and then by ALSFRS-R score. The Joint Rank can increase power relative to analysis of either ALSFRS-R or survival analysis alone in some circumstances, for example when mortality rates are high 

Joint Rank test was described and used in the NEJM paper by Miller et al "Trial of Antisense Oligonucleotide Tofersen for SOD1 ALS".

Strategies for Handling the Non-Fatal Terminal Events

It is acceptable to use hypothetical strategy to handle the non-fatal terminal intercurrent events. "Hypothetical strategies: A scenario is envisaged in which the intercurrent event would not occur: the value of the variable to reflect the clinical question of interest is the value which the variable would have taken in the hypothetical scenario defined." 

The value of the variable to reflect the clinical question of interest is the value which the variable would have taken in the hypothetical scenario defined. The value to be considered would have been the one collected if patients had not had the non-fatal terminal event. Outcomes after the non-fatal terminal events do not need to be measured. If the outcomes after the non-fatal terminal events are measured (for example, the spirometry measure after lung transplantation), the measures can be disregarded and not used in the analyses. The outcomes after the non-fatal terminal events cannot be observed, can be left as missing values, and usually need to be implicitly or explicitly predicted/imputed.