Monday, April 17, 2023

Change from Baseline versus Percent Change from Baseline

The US Food and Drug Administration (FDA) has published its fourth and final guidance in a series of patient-focused drug development (PFDD) guidances meant to help sponsors collect and incorporate patient experience information that can factor into regulatory decision-making. The latest guidance "Patient-Focused Drug Development: Incorporating Clinical Outcome Assessments Into Endpoints For Regulatory Decision-Making" focuses on how clinical outcomes assessments (COA) can be used as endpoints to support a product. It is interesting to see that there is an entire section to discuss the difference between using change from baseline versus percent (or percentage) change from baseline as the endpoint. While the discussion is specifically for COA (clinical outcomes assessments) endpoints, the same discussion points are applicable to other endpoints where the outcome measures are continuous variables. 


Clinical trials are usually designed as longitudinal studies where the baseline measures are performed before the randomization or the first dose of the study drug and then there will be periodic measures (or repeated measures) for the post-baseline visits. 

The statistical analyses may be performed on the original measures, but are more often performed using change from baseline values. For each post-baseline visit, the change from baseline values will be calculated and statistical analyses will include the change from baseline values as the dependent variable and the baseline values will be used as a covariate in the model. Both FDA and EMA have guidelines related to the adjustment for baseline values. 

"Clinical trials often record a baseline measurement of a defined characteristic and record a later measurement of the characteristic to be used as an outcome. When using this approach, adjusting for the baseline value rather than (or in addition to) defining the primary endpoint as a change from baseline is generally acceptable."
"5.6. Change from baseline’ analyses
When the primary analysis is based on a continuous outcome there is commonly the choice of whether to use the raw outcome variable or the change from baseline as the primary endpoint. Whichever of these endpoints is chosen, the baseline value should be included as a covariate in the primary analysis. The use of change from baseline with adjustment for baseline is generally more precise than change of baseline without adjustment. Note that when the baseline is included as a covariate in a standard linear model, the estimated treatment effects are identical for both ‘change from baseline’ (on an additive scale) and the ‘raw outcome’ analysis. Consequently if the appropriate adjustment is done, then the choice of endpoint becomes solely an issue of interpretability."

Percent change from baseline may also be used as the endpoint even though it is less commonly used in the analysis of clinical trial data. FDA's COA guidance clearly indicated the potential issues for using percent change from baseline in the analysis. 

For statistical modeling, Percent change from baseline has some undesirable properties: 
  • It is asymmetric, e.g. a change from 4 to 5 is 25%, but a change from 5 to 4 is -20%. While this is asymmetric, the percent change has been commonly used in measuring the fluctuation of stock prices, a change from $50 to $100 is a 100% increase, but a change from $100 to $50 is a 50% decrease. 
  • The variance is not easily defined. If we rewrite the percent change from baseline, it will be 1−Post-baseline measures/Baseline measure, so the variance is only defined by the ratio of the Post baseline values/baseline value. In statistical modeling, people don't like to deal with the ratio unless there is no better way. When we handle log-normal data (such as pharmacokinetic data), the geometric mean ratio is commonly used. 
  • It is undefined if the baseline is zero
In a paper by Vickers "The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study", the following conclusions were made:
"Percentage change from baseline has the lowest statistical power and was highly sensitive to changes in variance. Theoretical considerations suggest that percentage change from baseline will also fail to protect from bias in the case of baseline imbalance and will lead to an excess of trials with non-normally distributed outcome data."
Nevertheless, the percent change from the baseline may still be used as the primary efficacy endpoint in some clinical trials. Recently, therapeutic trials for weight loss in non-diabetic patients are hot topics. In clinical trials for weight loss, the primary efficacy endpoint is the Percent Change from Baseline to Week x in weight or BMI (body mass index). 

In a paper by Weghuber, et al "Once-Weekly Semaglutide in Adolescents with Obesity", the primary efficacy endpoint was percent change from baseline to week 68 in BMI. 
Efficacy end points were assessed from baseline (the time of randomization [week 0]) to week 68, unless otherwise stated. The primary end point was the percentage change in BMI, and the secondary confirmatory end point was a reduction in body weight of
at least 5%.

In a paper by Rubino et al "Effect of Weekly Subcutaneous Semaglutide vs Daily Liraglutide on BodyWeight in Adults With Overweight or Obesity Without Diabetes The STEP 8 Randomized Clinical Trial", the primary efficacy endpoint was percentage change from baseline in body weight at week 68. Percent change from baseline was analyzed using analysis of covariance, with randomized treatment as a factor and baseline value of the outcome measure of interest (eg, baseline body weight in kilograms for analysis of percentage change in body weight) as a covariate. Multiple imputation approach was used to handle the missing values. 

In SURMOUNT-1 study by Eli Lilly (Jastreboff, et al "Tirzepatide Once Weekly for the Treatment of Obesity"), co-primary efficacy endpoints were specified: 
Percent change in body weight from baseline to Week 72
AND
Percentage of participants with ≥5% body weight reduction at Week 72

No comments: