Showing posts with label incorrect stratification. Show all posts
Showing posts with label incorrect stratification. Show all posts

Friday, February 14, 2025

Understanding Mis-Stratification in Randomized Controlled Clinical Trials

Stratified randomization is a common practice in randomized, controlled clinical trials. It ensures that key characteristics are evenly distributed across treatment groups and the treatment assignments are balanced within each randomization stratum, enhancing the validity of study results. However, during the course of a trial, mis-stratification can occur—this happens when an incorrect stratification stratum is used during randomization. Let's explore what this means, why it happens, and how it impacts clinical trials.


What is Mis-Stratification?

In clinical trials, stratification factors (e.g., age, disease severity, disease subgroup, or background medication use) are used to group participants before randomization. Stratified randomization is used to ensure that equal numbers of subjects with one or more characteristic(s) thought to affect the treatment outcome in efficacy measure will be allocated to each comparison group. Mis-stratification - a type of randomization errors, occurs when:

  • An incorrect stratification factor is used for randomization, or
  • A participant is placed in the wrong stratum due to an error.

Despite this, the treatment assignment and drug dispensation remain accurate, making it a minor deviation rather than a critical error. When mis-stratification occurs, the random code and the treatment assignment is pulled from an incorrect stratum. 


Historical Approach: Intention-to-Treat Principle

Traditionally, clinical trials have adhered to the Intention-to-Treat (ITT) principle, where participants are analyzed according to the group they were originally randomized to, regardless of any errors. This approach maintains the integrity of the randomization process.

In practice, this means using the original stratification data—even if incorrect—in the statistical analysis. A typical Statistical Analysis Plan (SAP) might state:

“All original stratification information used in the randomization procedure will be used for analyses, regardless of whether it was later found to be incorrect. All efficacy analyses will be performed primarily on the ITT Population.”

This approach minimizes bias and reflects the 'real-world' impact of treatment. However, in the mis-stratification situation, using the incorrect stratum information in analyses may be too harsh and too strict unnecessarily.


Why Does Mis-Stratification Occur?

Mis-stratification can result from several factors, including:

  • Too Many Stratification Factors: More factors increase the complexity and likelihood of error.
  • Local vs. Central Lab Results: Differences between local and central lab measurements can lead to misclassification.
  • Timing of Measurement: Stratification factors measured at different times (baseline vs. screening) may not align.
  • Medication Use: Stratifying by prior or concomitant medication use can be complicated by variations in patient reporting or prescription practices.

These issues highlight potential flaws in protocol design and study quality, emphasizing the need for clear definitions and consistent procedures.


Regulatory Perspective: FDA Guidance

The FDA's guidance document, Adjusting for Covariates in Randomized Clinical Trials for Drugs and Biological Products,” provides clarity on handling mis-stratification:

“Randomization is often stratified by baseline covariates. A covariate adjustment model should generally include strata variables and can also include covariates not used for stratifying randomization. In some cases, incorrect stratification may occur and result in actual and as-randomized baseline strata variables. A covariate adjustment model can use either strata variable definition as long as this is prespecified.  “

This guidance supports the use of either the originally assigned stratification or the actual baseline data in the analysis, provided it is specified before data unblinding. This flexibility helps maintain the study's validity while addressing stratification errors transparently.


Impact on Study Results

Mis-stratification is generally considered a minor deviation because its impact on efficacy and safety analyses is minimal. It does not affect treatment assignment or drug dispensation but only the stratum from which the assignment was drawn.

When incorrect stratification occurs, the actual stratification information is collected in the Electronic Data Capture (EDC) system and can be used in sensitivity analyses to evaluate the robustness of the study results.

There is an article "Handling misclassified stratification variables in the analysis of randomised trials with continuous outcomes" where the authors did the simulation study to investigate the impact of the mis-stratification on the statistical analyses. 


Minimizing Mis-Stratification in Randomization

Too many mis-stratification errors indicate the poor quality of the clinical trial. To reduce the risk of mis-stratification, consider the following best practices:

  • Limit Stratification Factors: Use the minimum necessary factors to reduce complexity.
  • Consistent Measurement Timing: Align the timing of stratification factor measurements (e.g., always at baseline).
  • Clear Definitions: Ensure stratification criteria are clearly defined, identified or measured, and uniformly applied.
  • Training and Quality Checks: Provide thorough training for study personnel and implement rigorous quality checks.

Conclusion

While mis-stratification is not ideal, its impact on clinical trial results is usually minimal. By adhering to the Intention-to-Treat principle and following regulatory guidance, researchers can maintain the integrity of their analyses. As clinical trial designs become more complex, understanding and managing mis-stratification will continue to be crucial for maintaining study quality and reliability.

Monday, May 29, 2023

Final FDA Guidance "Adjusting for Covariates in Randomized Clinical Trials for Drugs and Biological Products" - what we learned?

In May 2023, FDA published the final guidance for industry "Adjusting for Covariates in Randomized Clinical Trials for Drugs and Biological Products". This final version was based on the draft guidance with the same title that was released 4 years ago in April 2019 (see a previous post "FDA and EMA Guidance on Adjusting for Covariates in Randomized Clinical Trials".

FDA created guidance snapshot below:





The final guidance provided the general guidelines on several issues related to the covariates or baseline covariates. 


Both unadjusted analysis and analysis adjusted for baseline covariates are acceptable. However, if analysis is adjusted for baseline covariates, the details about the covariates need to be pre-specified in the statistical analysis plan before the study unblinding. Our experience is that the details about which baseline covariates to be included and whether the baseline covariates are continuous or categorized need to be pre-specified. 

Usually, the analysis adjusted for baseline covariates leads to efficiency gain and is more powerful than the unadjusted analysis. 

It is acceptable to calculate the sample size based on adjusted analysis, but perform the final analysis based on analysis adjusted for baseline covariates. In practice, the sample size calculation is commonly based on adjusted analysis regardless of the final analysis. For example, for a study to compare two group means, the sample size may be calculated based on t-test approach, but the analysis may be based on analysis of covariates where the adjustment for baseline covariates are used. 

For studies with stratified randomization where the randomization is stratified by one or more baseline covariates (categorical), the stratification factors are usually included in the analysis model even though the treatment assignments are generally balanced within each stratum. 

For studies with stratified randomization, it is not uncommon that incorrect stratification may occur where the treatment assignment is picked from the incorrect stratum. When this occurs, there will be two sets of the randomization stratification information (two different strata variables): strata as randomized versus actual strata. It is acceptable to use either strata variable as randomized (intention-to-treat principle) or actual strata variable (correct strata information for all patients). When mis-stratification occurs, there should be any attempt to go back to the randomization systems (such as IRT, IVR, IWR) to correct the stratification allocation. Once randomized, it is randomized. While the incorrect stratification is used for randomization, the correct stratification can be recorded on the case report form or EDC (electronic data capture). See a previous post "Handling Randomization Errors in Clinical Trials with Stratified Randomization".

For studies with continuous outcome measures, the endpoint is usually the change from baseline to a specific visit. Baseline covariate is used in the change from baseline calculation. In the analysis adjusted for baseline covariate, the baseline covariate can still be included in the model even though it gives an impression that the baseline measure is used twice. 

The guidance contains additional guidelines on linear models and non-linear models. For example, for linear models, the issue related to treatment group by covariate interactions is discussed: 


For non-linear models, binary outcome (logistic regression), ordinal outcome (generalized linear model), count outcome (Poisson regression), or time-to-event outcome (Cox regression) are analyzed. The estimators like odds ratio and hazard ratio are called are non-collapsible effect measures. Non-collapsibility implies that the effect parameter is not the same for different sets of covariates that are conditioned on, even if these covariates are independent of the exposure. Even when all subgroup treatment effects are identical, this subgroup specific conditional treatment effect can differ from the unconditional treatment effect.