Clinical Terminology Standards:Using a public process that allows for stakeholder
input, FDA shall develop standardized clinical data terminology through open standards
development organizations (i.e., the Clinical Data Interchange Standards Consortium
(CDISC)) with the goal of completing clinical data terminology and detailed
implementation guides by FY 2017.
1. FDA shall develop a project plan for distinct therapeutic indications, prioritizing clinical terminology standards development within and across review divisions. FDA shall publish a proposed project plan for stakeholder review and comment by June 30, 2013. FDA shall update and publish its project plan annually.
1. FDA shall develop a project plan for distinct therapeutic indications, prioritizing clinical terminology standards development within and across review divisions. FDA shall publish a proposed project plan for stakeholder review and comment by June 30, 2013. FDA shall update and publish its project plan annually.
This section of the goals letter has given risen to the development of so-called "Therapeutic Area (TA) Standards." I was involved in numerous activities associated with TA standards development. I found there exists a substantial amount of confusion or lack of clarity regarding what these are and how they should be managed. I decided to write this post to explore TA standards
from a data standards and regulatory review policy perspective that hopefully provides
useful insight in what these standards are and how best to manage them in the future.
Standard vs. Data Standard
When discussing TA standards, it’s useful to draw a
distinction between a standard and a data standard. A standard is defined in
dictionary.com as “something considered by an authority or by general consent
as a basis of comparison; an approved model.” There are many different kinds of standards:
manufacturing standards, measurement standards, data standards, etc. To understand the distinction, consider a
ruler. The ruler can be marked in inches or centimeters. Which ruler is used to
measure length depends on the measurement standard that has been selected for
the task. Once a measurement standard is selected, then the data standard
provides a consistent approach to document and/or share the measurement. If the
measurement standard is inches, and the measurement is 10 inches, then the data
standard describes whether it’s 10”, 10 in, or 10 inches. This distinction is
important when considering TA standards. How to represent a measurement (i.e.
an observation) requires two decisions: a business decision (what to measure,
which measurement standard to use), followed by a data standards decision (how
to standardize the representation of the measurement, which data standard(s) to
use).
What is a Therapeutic Area Standard?
I find there is no widely established “standard definition” for a
TA standard. One working (perhaps prevailing?) definition is that a TA standard
is a data standard for a therapeutic area or indication. I argue that a
TA standard is not a data standard. Let’s examine this definition more closely.
Consider a clinical observation, specifically a clinical
laboratory test: glycosylated hemoglobin (HbA1C).
The standardization of HbA1C data is straightforward. CDISC provides controlled
terminology for the HbA1C lab test (represented by the NCI Enterprise Vocabulary Services code C64849). The
CDISC SDTM Implementation Guide describes how to represent lab test data (which includes HbA1C
data) using the LB domain. The result is a numeric value, expressed as a percentage of the total hemoglobin in blood. Anyone conducting a clinical
trial that includes the collection of HbA1C need only look at the SDTM IG and
CDISC controlled terminology to understand how to standardize this information.
No additional data standards are needed.
Consider now a single therapeutic area: Diabetes Mellitus.
Let’s assume that, for the purpose of determining efficacy of a new diabetes
drug, only one outcome measure is necessary: the HbA1C.
So what does a Diabetes Mellitus
TA Standard then look like? What are we “standardizing” that isn’t already
standardized?
One can envision a separate Diabetes
TA Standards document that says, “if you’re studying a new drug to treat
diabetes, you should collect HbA1C and here is how you should represent HbA1C
data using these existing standards: SDTM + CDISC controlled terminology.” For
this document to be truly useful, an independent scientific and/or regulatory
body should first decide what design features and clinical observations are
relevant for diabetes studies. This can be described as a “good clinical
research practice guideline” for diabetes. One could consider this a standard
but it is not a data standard. Such a guideline is analogous to a manufacturing
or building standard. Just as a builder might say: “A hurricane-resistant
building must/should contain these materials: ….,” a clinical researcher would
say: “A good diabetes study must/should contain HbA1C testing.”
FDA publishes such guidelines. These
are called indication-specific guidances, which help sponsors design their
development programs, including clinical trials to support U.S. approval of new
drugs for a given indication. I was involved in the development of a standard template for these guidances so that there is consistency in the content and presentation across therapeutic areas. Other organizations may publish similar
guidelines: professional societies, other government agencies (e.g. NIH),
consortia, etc.
In this simple example, a
researcher would only need to read the clinical research guideline for
diabetes, and understand how to represent HbA1C data using existing exchange
and terminology standards. No additional documentation is necessary. A Diabetes
TA user guide is not needed. The “standard” for diabetes trial is the clinical
research guideline itself and the existing data standards.
Of course therapeutic areas are
much more complicated than this. Each TA has multiple relevant clinical
observations, and any given observations may have additional metadata and qualifiers
needed to interpret the observation. In this setting a TA “user guide” is
useful to demonstrate how to represent all TA-relevant data and meta-data using existing data
standards. But the user guide itself is not a data standard. The data standards
are the exchange and terminology standards that the user guide references.
So an alternative definition for
a TA Standard is a best practice guideline for conducting clinical trials for a
specific therapeutic area, with an accompanying illustration (e.g. “user guide”) on how to use existing data standards (exchange and terminology
standards) for that TA. If FDA generates the guideline, then it would be an
indication-specific guidance, and any available user guide would ideally be incorporated
by reference to the guidance.
An analogy would be a best
practice specification for designing a kitchen. The kitchen “standard” would say: it must have cabinets, a refrigerator, a
sink and faucet, and a stove and oven. It may
have a garbage disposal, dishwasher, and trash compactor. The kitchen TA user
guide might say, “this is what your kitchen would look like if you use standard
Ikea cabinets and General Electric appliances.”
We should all therefore agree that a TA standard is not a data
standard. A TA Standard is a use case for existing exchange and terminology standards. The data standard is the exchange and terminology standards that are
used to standardize TA-specific data. A TA Standard is a use case for existing exchange and terminology standards.The FDA publishes a Data Standards Catalog that lists the data standards the Agency supports for various use cases. Because TA standards are not data standards, I do not think they belong in
the FDA Data Standards Catalog as new data standards that FDA supports. FDA does need a new approach to convey that the TA use cases are adequately supported by the data standards listed in the catalog.
So what about the user guides? We should recognize that a TA
standard has two components:
- A clinical research ‘best research
practice guideline’ or standard (i.e. the data requirements)
- A description of how
available data exchange and terminology standards can represent the TA data
requirements. A user guide may be useful (but not necessary) to illustrate
how this is done.
In the trivial example described here, there is really no
need for a separate Diabetes TA user guide because it is clear how to represent
HbA1C information using existing data standards. The problem arises when the
data requirements are complex and the existing data standards do not provide a
clear and unambiguous representation of the clinical data. Then, a user guide
is helpful and necessary.
For a TA standard to be effective for FDA, the Agency needs to ensure
that its regulatory data needs are met. FDA needs a process to ensure that:
- the TA best practice
research guideline is accurate (the TA-specific data requirements; in CDER this is
largely a function of the Office of New Drugs(OND)). Ideally this is captured in an indication-specific
guidance, and
- data standards exist (or
have been adequately modified) to represent the data requirements in a
standard format (in CDER this is likely a collaboration between OND, the Office of Strategic Programs (OSP), the Office of Translational Sciences (OTS) and
data standards development organization(s)).
Thanks for continuing this discussion, Armando (which you began in July) and calling attention to this issue. Actually, CFAST TA User Guides were never intended to be separate standards; Section 1.1 of each guide states that the actual normative standards used are the CDISC SDTMIG and sometimes CDASH and ADaM. TA's also reference specific controlled terminologies that are applicable to a therapeutic area, but these are simply represented as part of the NCI-EVS CDISC domain of terminologies. A TA User Guide is a way to apply existing normative CDISC standards for studies that are conducted for treatments being tested against a specific therapeutic area. However, as you show, these are often generalized by many as individual standards in their own right, even though this was never the intent. I think it's important for people to characterize these properly in the future.
ReplyDeleteTA UGs tend to try to describe the context of research in this area (which is typically focused on a limited scope initially), describes what data are typically collected for studies in this area, and provides examples on how to represent such data using standards such as SDTMIG with examples. This material is essential to reach a common understanding (that extends throughout the research process) so people can use the standards consistently, which in turn will make it easier for FDA. But in the course of developing these, in most cases (but not all) some limitations of the SDTMIG were identified, which required the definition of new variables or even new domains. These are included as drafts in the TA UG, but are intended to become normative in a future version or amendment to the most recent SDTMIG. And in almost all cases, there is a need to extend the available controlled terminology that is managed by NCI EVS, since the original CDISC standards tended to focus on the most commonly used data in all types of studies, rather than the specific nuances of studies in a particular TA.
So I tend to agree that a TA standard user guide is not a data standard in its own right, but rather a guide on how to use CDISC data standards to conduct research in a TA. It may be a fine distinction, but it's an important one. And I believe as long as FDA is ready to receive new versions of SDTMIG, they should be able to accommodate the associated TAs as well.
Wayne, thank you for your feedback. I agree that CDISC and CFAST are getting it right in terms of the proper role and use of the user guides. Unfortunately, this is not a uniformly held view that leads to confusion, especially given that the FDA data standards catalog has a section reserved for "future therapeutic area data standards."
ReplyDelete