Clinical Trial Curation#
Immunotherapy datasets#
Introduction#
This documentation goes over the clinical trial data curation process in detail, using immunotherapy data.
Objective#
The objective is to curate a clinical dataset into R's MultiAssayExperiment object. An example of a clinical data MultiAssayExperiment (MAE) object can be found in ORCESTRA.
Currently, a clinical data object contains the following data parts:
- Clinical metadata: Contains patient/sample metadata.
- Molecular profiles: Molecular assay data (Currently RNA-seq, SNV or CNA) which is formatted in either RangedSummarizedExperiment or regular SummarizedExperiment object.
Data Access#
Public data#
If the source is Pubmed, the raw omics files and clinical response metadata are available from Supplementary or external repository links in Data Availability section of the paper.
Private data#
Private data such as PHI, clinical response might be available only upon request. Please contact the author(s) or whoever is responsible for requesting such data.
Data Processing Overview#
An example of clinical data processing pipeline can be found here as a Snakemake pipeline.
Generally, an overall process of the curation follows the steps outlined below:
- Download source data: Download data from publications or data repositories. The source data can be in various formats such as an Excel file, CSV or TXT.
- Process raw molecular data, if available: The RNA-seq processing from raw FASTQ is outlined on the RNAseq raw processing page.
- Add annotations: Ensure that genes, tissues and treatments are annotated with metadata available from external source and lab standardized columns.
- Create RangedSummarizedExperiment or SummarizedExperiment (SE) object: For the molecular data, we prefer RangedSummarizedExperiment as it is compatible with GenomicRanges R package.
- Create MAE object: Format downloaded data to the layout and structure that is favourable to creating a MAE object. Through this process, the source data is extracted from the source data format and formatted into a CSV or TSV file. Integrate molecular data to MAE.
Processing Clinical Metadata#
The clinical data should be formatted into patient/sample ids as rows and attributes as column data. This will be added as colData
of the SE or MAE object.
The following columns are mandatory and should be filled with NA if the data is not available to maintain consistency across ICB and non-ICB datasets:
Column name | Description |
---|---|
Patientid | This column contains unique patient identifiers |
treatmentid | This column contains the treatment regimen of each patient. Individual drug names are separated by ":" and standardized based on the lab's nomenclature. For example, the drug combo "FAC" is represented as "5-fluorouracil:Doxorubicin:Cyclophosphamide" |
response | This column contains the response status of the patients to the given treatment - Responders (R) and Non-responders (NR) |
tissueid | Cancer type standardized based on the lab's nomenclature from Oncotree. Example: “Breast” |
survival_time_pfs/survival_time_os | The time starting from taking the treatment to the occurrence of the event of interest. The event name like "pfs", "os" must be appended to survival_time to differentiate the survival measure. Example for data in this column: “2.6” |
survival_unit | The unit in which the survival time is measured. If the event is measured in other units such as “day”, or “year”, it must be converted to "month" for consistency |
event_occurred_pfs/event_occurred_os | Binary measurement showing whether the event of interest occurred (1) or not (0). The event name like "pfs", "os" must be appended to event_occurred to differentiate the survival measure |
Note
Common columns have to be the first set of columns appearing in the metadata followed by the rest of the columns. You could add other columns with the name in the source data, but the standard columns with the above mentioned names should be present.
If you are adding new columns based on restructured data from existing columns, please assign the lucid, self-explanatory column names.
The table below shows the other common columns across the 19 ICB datasets curated.
Column name | Description | type |
---|---|---|
age | Age | source |
AMP | Sum of total AMP/coverage; calculated from CNA values | in-lab curation |
cancer_type | Type of cancer tissue | source |
CIN | Calculated from CNA values | in-lab curation |
CNA_tot | Sum of total CNA/coverage; calculated from CNA values | in-lab curation |
DEL | Sum of total DEL/coverage; calculated from CNA values | in-lab curation |
dna | DNA sequencing type. eg: whole exome sequencing | source |
histo | Histological info such as subtype | source |
indel_nsTMB_perMb | - | in-lab curation |
indel_nsTMB_raw | - | in-lab curation |
indel_TMB_perMb | - | in-lab curation |
indel_TMB_raw | - | in-lab curation |
nsTMB_perMb | - | in-lab curation |
nsTMB_raw | - | in-lab curation |
recist | Annotated using RECIST. The most commonly used responses are CR,PR,SD, PD. | source |
response.other.info | Same data as Responders (R) and Non-responders (NR) | source |
rna | Type of rna processed data. eg: TPM | source |
sex | Sex of the patient - Male or Female | source |
stage | Cancer stage | source |
survival_type | PFS or OS or both (denoted by '/'). If both, added by in-lab curation | in-lab curation |
TMB_perMb | TMB per megabase (Mb) was performed as defined: TMB = mutns/target. With mutns = number of non-synonymous mutations; and target = target size of the sequencing See Supplementary Table S2 of https://pubmed.ncbi.nlm.nih.gov/36055464/ | in-lab curation |
TMB_raw | Tumor Mutation Burden raw values | in-lab curation |
treatment | Drug target or drug name | source |
Processing Molecular Data#
The raw omics data files are obtained and processed in the lab. If the raw files are not available, processed data is used. Exceptions are Mutation data where only processed data is used to avoid ambiguity around matched normals.
In general, all molecular data should be formatted into genes (eg: transcript IDs for RNA profiling) as rows and patient/sample IDs as columns.
RNA-seq data#
First and foremost, the RNA-seq data should be at gene-level and in TPM. The TPM value should be log transformed with log2(TPM) + 0.001.
If the TPM values are not available, but counts values are available, you could use the following formula to convert counts value to TPM:
If available, counts and transcript-level data (isoforms) should also be included.
SummarizedExperiment Object#
Each molecular data needs to be formatted into a SummarizedExperiment (or RangedSummarizedExperiment) object.
At minimum, SummarizedExperiment requires:
- colData (the patient metadata) formatted in patient/sample IDs as rows and attribute data as columns.
- assay (expression values) formatted in gene/transcript IDs as rows and patient/sample IDs as columns.
- rowData (gene metadata) is gene metadata for the genes that exist in the assay, formatted as gene/transcript IDs as rows and attributes as columns. More details on the gene metadata below.
Annotation#
Lab standardized annotation data are stored in BHKLab-Pachyderm's Annotation repository.
Gene Annotations#
Gene metadata is obtained from Gencode annotations. We have a few versions of Gencode annotation data available in .RData files. An .RData file includes data frames that contains gene and transcript information such as features_gene, features_transcript and tx2gene. Some of the available gene annotations include:
Note
Please use the most recent version for your gene annotations from this repository. The version of Gencode must be decided after checking the reference genome. Follow Gene curation SOP for detailed steps
Drug Annotations#
For clinical data, drug annotations are performed in case-by-case basis. For immunotherapy treatments, both instances such as anti-"target" (eg: anti-CTLA4) and monoclonal antibody brand names can be present. Please follow the Drug curation SOP to correctly annotate such cases using the standard lab files in the Annotation repository.
Tissue Annotations#
For tissue annotations that cannot be mapped using Tissue curation SOP to the standard lab files in the Annotation repository, manual review needs to be performed in case-by-case basis.