Datasets Included¶
This page provides an overview of the datasets included in CoderData version 2.4. This package collects 18 diverse sets of paired molecular datasets with corresponding drug sensitivity data. All data here is reprocessed and standardized so it can be easily used as a benchmark dataset for drug response prediction machine learning models.
The dataset files are in csv format and are available at the link below:
Figshare record: https://api.figshare.com/v2/articles/33990850
Version: 2.4
Dataset Overview¶
Dataset |
References |
Model Type |
Sample |
Drug |
Drug Descriptor |
Experiments |
Transcriptomics |
Proteomics |
Mutations |
Copy Number |
|---|---|---|---|---|---|---|---|---|---|---|
BeatAML |
ex vivo |
1022 |
164 |
X |
X |
X |
X |
X |
||
Bladder |
patient derived organoid; patient derived xenograft; tumor; xenograft derived organoid |
134 |
50 |
X |
X |
X |
X |
X |
||
CCLE |
cell line |
502 |
24 |
X |
X |
X |
X |
X |
X |
|
Colorectal |
patient derived organoid; tumor |
61 |
10 |
X |
X |
X |
X |
X |
||
CPTAC |
tumor |
1139 |
X |
X |
X |
X |
||||
CTRPv2 |
cell line |
847 |
460 |
X |
X |
X |
X |
X |
X |
|
FIMM |
cell line |
52 |
52 |
X |
X |
X |
X |
X |
X |
|
GDSC v1 |
cell line |
984 |
291 |
X |
X |
X |
X |
X |
X |
|
GDSC v2 |
cell line |
806 |
169 |
X |
X |
X |
X |
X |
X |
|
gCSI |
cell line |
570 |
43 |
X |
X |
X |
X |
X |
X |
|
HCMI |
patient derived organoid; tumor; cell line |
2129 |
X |
X |
X |
|||||
Liver |
patient derived organoid |
62 |
76 |
X |
X |
X |
X |
X |
X |
|
MPNST |
3D-MEDS; patient derived xenograft; tumor |
133 |
39 |
X |
X |
X |
X |
X |
X |
|
NCI60 |
cell line |
83 |
55712 |
X |
X |
X |
X |
X |
X |
|
Novartis |
patient derived xenograft |
385 |
25 |
X |
X |
X |
X |
X |
||
Pancreatic |
patient derived organoid |
49 |
25 |
X |
X |
X |
X |
X |
||
PRISM |
cell line |
478 |
1416 |
X |
X |
X |
X |
X |
X |
|
Sarcoma |
tumor; patient derived organoid |
36 |
34 |
X |
X |
X |
X |
The table above lists the datasets included in CoderData version 2.4, along with references to their original publications, counts of samples and drugs, and the types of data available for each dataset.
CoderData includes the following data:
Model Type - the biological model the samples derive from (cell line, patient derived organoid, patient derived xenograft, tumor, ex vivo, or 3D-MEDS microtissue)
Sample - cell lines, patient-derived samples, or patient-derived organoids
Drug - compounds tested for sensitivity
Drug Descriptor - molecular descriptors for each drug (Morgan fingerprints from RDKit and 2D descriptors from Mordred; see Data Processing below)
Experiments - dose-response experiments (various metrics such as AUC, IC50, etc.)
Transcriptomics - gene expression (in transcripts per million, TPM)
Proteomics - protein expression (log2 ratio to reference)
Mutations - gene mutations (variant calls)
Copy Number - gene copy number on the DepMap scale, log2(relative copy number + 1), where 1 is diploid, plus a copy call for each gene
An “X” indicates the presence of a particular data type for the corresponding dataset. Each sample in the datasets corresponds to either a cancer cell line, a patient-derived xenograft, or a patient-derived organoid, depending on the specific dataset.
Data Processing¶
Every dataset is reprocessed into the same formats, so data can be compared and combined across datasets. Genes are identified by Entrez ID, samples by improve_sample_id and drugs by improve_drug_id.
Transcriptomics - gene expression in transcripts per million (TPM). CPTAC values are kept on the log2 scale provided by the cptac Python package.
Proteomics - log2 ratio of each protein to the study’s reference. CPTAC values are kept on the log2 scale provided by the cptac package.
Mutations - somatic variants for each gene, with variant types given MAF-style names (e.g.
Missense_Mutation,Frame_Shift_Del,Silent). A few sources keep their own name for some types, e.g.Frameshift_Variantin BeatAML, Pancreatic and Sarcoma.Copy Number - each source’s values are converted to the DepMap scale, log2(relative copy number + 1), where 1 is diploid. Each value is also binned into a copy call: deep del (below 0.52), het loss (0.52 to 0.73), diploid (0.73 to 1.21), gain (1.21 to 1.42) and amp (above 1.42).
Drugs - drug names are matched to PubChem to get each drug’s structure (canonical SMILES and InChIKey), and drugs with the same structure share one
improve_drug_idacross datasets.Drug Descriptors - computed from each drug’s canonical SMILES. Each drug has a
morgan fingerprint(1024 bits, radius 2, from RDKit) and about 1,600 2D descriptors from Mordred. Thestructural_descriptorcolumn holds the descriptor name.Experiments - for datasets screened in culture (cell lines, organoids, microtissues and BeatAML’s ex vivo samples), a Hill curve (Einf, EC50 and Hill slope) is fit to each sample and drug’s dose-response data, and the curve metrics below are calculated from that fit. PDX datasets (MPNST and Novartis) use tumor volume metrics (ABC, LMM, mRECIST, TGI) instead. Sarcoma has the published AUC only.
Dataset Summary Statistics¶
The following table summarizes combination counts for each dataset. This includes the number of experimental sample-drug pairs, with different molecular data types. Each column represents the number of unique combinations of samples and drugs with the specified molecular data types available. For example, the “Sample-Drug-Transcriptomics-Mutations” column indicates the number of unique sample-drug pairs that have both transcriptomics and mutation data available. These counts let you estimate how much paired data is available for tasks like building predictive models with transcriptomics and drug response.
Dataset Summary Statistics¶ dataset
sample_drug_pairs
sample_drug_transcript_pairs
sample_drug_transcriptomics_mutation_pairs
sample_drug_transcriptomics_copynumber_pairs
sample_drug_mutation_copynumber_pairs
beataml
62707
52985
48724
bladder
3300
840
640
640
3100
ccle
11543
10933
10885
8375
8398
colorectal
140
60
60
60
140
cptac
ctrpv2
310133
300871
297687
216046
216830
fimm
2663
2457
2457
2098
2098
gcsi
13229
12368
12259
9186
9248
gdscv1
245489
242980
239787
239034
240351
gdscv2
113964
112911
111387
111085
111687
hcmi
liver
4453
4453
4453
4453
4453
mpnst
2736
2657
181
181
181
nci60
2940159
2343136
2343121
2085608
2085608
novartis
1757
1725
1725
1714
1714
pancreatic
190
190
185
185
185
prism
637674
632199
632199
497743
499088
sarcoma
275
234
187
Drug Curve Metrics Collected¶
The following table summarizes the number of drugs associated with each dose-response metric across the datasets.
To compare drug response across datasets, use fit_auc. It is calculated over the same dose range (10⁻¹⁰ to 10⁻⁴ M) for every dataset with dose-response curves, so values are on the same scale. auc, aac and dss use each study’s own dose range.
Drug Curve Metrics Summary¶ dataset
num_drugs
aac
abc
auc
delta_auc
dss
fit_auc
fit_ec50
fit_ec50se
fit_einf
fit_hs
fit_ic50
fit_r2
lmm
mrecist
published_auc
tgi
beataml
162
X
X
X
X
X
X
X
X
X
X
bladder
50
X
X
X
X
X
X
X
X
X
X
ccle
24
X
X
X
X
X
X
X
X
X
X
colorectal
10
X
X
X
X
X
X
X
X
X
X
ctrpv2
460
X
X
X
X
X
X
X
X
X
X
fimm
52
X
X
X
X
X
X
X
X
X
X
gcsi
43
X
X
X
X
X
X
X
X
X
X
gdscv1
291
X
X
X
X
X
X
X
X
X
X
gdscv2
169
X
X
X
X
X
X
X
X
X
X
liver
73
X
X
X
X
X
X
X
X
X
X
mpnst
39
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
nci60
55712
X
X
X
X
X
X
X
X
X
X
novartis
23
X
X
X
X
pancreatic
5
X
X
X
X
X
X
X
X
X
X
prism
1416
X
X
X
X
X
X
X
X
X
X
sarcoma
32
X
Types of dose-response metrics collected include:
AAC - Area above the response curve; the complement value of AUC.
ABC - Area between curves, the difference between the AUC of the control and the treated cells. (PDX)
AUC - Area under the fitted hill slope curve across all doses present. Lower AUC signifies lower levels of growth.
delta_auc - Difference in AUC between a single drug and its combination (single-drug AUC minus combination AUC); used for MPNST treated-microtissue combination experiments.
DSS - A multiparametric dose response value, that takes into account control and treated cells; the Drug Sensitivity Score is described in Yadav et al., 2014.
fit_auc - Area under the fitted hill slope curve across the common interval of −log10[M], where the molar concentration ranges from 10⁻⁴ to 10⁻¹⁰.
fit_ec50 - The fitted curve prediction of the −log10M concentration at which 50% of the maximal effect is observed.
fit_ec50se - Standard error of the Fit_EC50 estimate.
fit_einf - The fraction of cells that are unaffected even at an infinite dose concentration. Calculated as the lower asymptote of the hill slope function.
fit_hs - The estimated hill slope binding cooperativity, calculated as the slope of the sigmoidal hill curve.
fit_ic50 - The fitted curve prediction of the −log10M concentration required to reduce tumor growth by 50%.
fit_r2 - Coefficient of determination between observed growth and the fitted hill slope curve, indicating goodness of fit.
lmm - The resulting “time and treatment interaction” in a linear mixed model with fixed effects as time and treatment and with patient as a random effect. This indicates how much the treatment changes the slope of log(volume) over time compared to the control. (PDX)
mRECIST - Disease status is classified into four categories: PD (progressive disease), SD (stable disease), PR (partial response), and CR (complete response). This is calculated as Day 10 percent volume change (%ΔV) and its cumulative average response under the following methods: CR if best %ΔV < −95% and avg < −40%, PR if %ΔV < −50% and avg < −20%, SD if %ΔV < +35% and avg < +30%, otherwise PD. (PDX)
published_auc - Published Area Under the Curve
TGI - The tumor growth inhibition (TGI) between the control and treatment time-volume curves. (PDX)