Data release notes
Last updated
Was this helpful?
Last updated
Was this helpful?
Files: 4,5784,454 (+174,244)
Series: 950,888 (+3,308)
Studies: 149,577 (+2,070)
Cases: 71,082 (+1,893)
Collections: 150 (+1)
Analysis results collections: 17 (no change)
Disk size: 87.49 TB (+1.94 TB)
bamf_aimi_annotations_brain_mr_qa_results
bamf_aimi_annotations_breast_fdg_pet_ct_qa_results
bamf_aimi_annotations_breast_mr_qa_results
bamf_aimi_annotations_kidney_ct_qa_results
bamf_aimi_annotations_liver2_ct_qa_results
bamf_aimi_annotations_liver_ct_qa_results
bamf_aimi_annotations_liver_mr_qa_results
bamf_aimi_annotations_lung2_ct_qa_results
bamf_aimi_annotations_lung_ct_qa_results
bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
bamf_aimi_annotations_prostate_mr_qa_results
cptac_aml_demographic_classification
varepop_apollo_clinical
nlst_canc
Previously nlst_clinical
acrin_nsclc_fdg_pet_bamf_lung_pet_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
anti_pd_1_lung_bamf_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
anti_pd_1_lung_bamf_lung_fdg_pet_ct_segmenation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
lung_pet_ct_dx_bamf_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
lung_pet_ct_dx_bamf_lung_fdg_pet_ct_segmenation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
nsclc_radiogenomics_bamf_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
nsclc_radiogenomics_bamf_lung_fdg_pet_ct_segmenation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
prostatex_bamf_segmentations
Subsumed by bamf_aimi_annotations_prostate_mr_qa_results
qin_breast_bamf_breast_segmentation
Subsumed by bamf_aimi_annotations_breast_fdg_pet_ct_qa_results
rider_lung_pet_ct_bamf_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
rider_lung_pet_ct_bamf_lung_fdg_pet_ct_segmenation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
tcga_kirc_bamf_kidney_segmentation
Subsumed by bamf_aimi_annotations_kidney_ct_qa_results
tcga_lihc_bamf_liver_ct_segmentation
Subsumed by bamf_aimi_annotations_liver_ct_qa_results
tcga_lihc_bamf_liver_mr_segmentation
Subsumed by amf_aimi_annotations_liver_mr_qa_results
tcga_luad_bamf_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
tcga_luad_bamf_lung_mr_segmentation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
tcga_lusc_lung_ct_segmentation
Subsumed by bamf_aimi_annotations_lung_ct_qa_results
tcga_lusc_lung_mr_segmentation
Subsumed by bamf_aimi_annotations_lung_fdg_pet_ct_qa_results
The segmentation of an instance in each of the following series was excluded due to having a DICOM PixelData size greater than or equal to 2GB:
1.2.826.0.1.3680043.10.511.3.10544506665348704312902213950958190
1.2.826.0.1.3680043.10.511.3.11183783347037364699862133130586654
1.2.826.0.1.3680043.10.511.3.11834745481756047014039855874680259
1.2.826.0.1.3680043.10.511.3.11901667084519361717338400810055642
1.2.826.0.1.3680043.10.511.3.12041600048156613329793822566495651
1.2.826.0.1.3680043.10.511.3.12718116375608495830041119776887887
1.2.826.0.1.3680043.10.511.3.13386724401829265460622415500801368
1.2.826.0.1.3680043.10.511.3.14042734131864468280344737986870899
1.2.826.0.1.3680043.10.511.3.17374765903080083648409690755539184
1.2.826.0.1.3680043.10.511.3.17429002643681869326389465422353495
1.2.826.0.1.3680043.10.511.3.20359930476040698387716730891020638
1.2.826.0.1.3680043.10.511.3.28397033639127902823368316410884210
1.2.826.0.1.3680043.10.511.3.28425539132321749931109935391487352
1.2.826.0.1.3680043.10.511.3.34574227972763695321794092913087775
1.2.826.0.1.3680043.10.511.3.36216094237641867532902805456135029
1.2.826.0.1.3680043.10.511.3.39533936694797964318706337783276378
1.2.826.0.1.3680043.10.511.3.39900930856460689132625586523683939
1.2.826.0.1.3680043.10.511.3.41633795217567037218184715094985555
1.2.826.0.1.3680043.10.511.3.42218106649761752724553401155203874
1.2.826.0.1.3680043.10.511.3.49098870621170235412220976183110770
1.2.826.0.1.3680043.10.511.3.50064322235999800062455171235601125
1.2.826.0.1.3680043.10.511.3.50905421517530127976832505410705816
1.2.826.0.1.3680043.10.511.3.62935684444056080516153739948364303
1.2.826.0.1.3680043.10.511.3.73572792121235596011940904319511291
1.2.826.0.1.3680043.10.511.3.74494366757564543824303304482444570
1.2.826.0.1.3680043.10.511.3.79988146996803179892075404247166692
1.2.826.0.1.3680043.10.511.3.80004293150506819482091023564947091
1.2.826.0.1.3680043.10.511.3.82774274518897141254234567300292686
1.2.826.0.1.3680043.10.511.3.84202416467561501610598853920808906
1.2.826.0.1.3680043.10.511.3.86214492184712627544696209982376598
1.2.826.0.1.3680043.10.511.3.90193069664920622990317347485104073
1.2.826.0.1.3680043.10.511.3.95666157880521064637011880609274546
1.2.826.0.1.3680043.10.511.3.96676982370873257329281821215166082
1.2.826.0.1.3680043.10.511.3.98258035017480972315346136181769675
New pathology collections
New analysis results
Revised radiology collections
Cancer Moonshot Biobank (CMB) radiology images were updated to fix incorrect values assigned to PatientID (see details on the collection pages linked above). The updated images have different DICOM Study/Series/SOPInstanceUIDs.
Revised analysis results
New clinical metadata tables
New radiology collections
New analysis results
Revised radiology collections
(starred collections are revised due to new or revised analysis results)
Revised pathology collections
(starred collections are revised due to new or revised analysis results)
Also added missing instance SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.3459553143.523311062.1687086765943.9.0
Removed corrupted instances
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2164023716.1899467316.1685791236516.37.0
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2411736851.773458418.1686038949651.37.0
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2411736851.773458418.16860389
TCGA-DLBC (No description page)
New clinical metadata tables
Notes
The deprecated columns tcia_api_collection_id and idc_webapp_collection_id have been removed from the auxiliary_metadata table in the idc_v18 BQ dataset. These columns were duplicates of columns collection_name and collection_id respectively.
New radiology collections
New analysis results
Collections analyzed:
Revised radiology collections
New clinical metadata tables
New radiology collections
New pathology collections
Revised radiology collections
New analysis results
New clinical metadata tables
New radiology collections
New pathology collections
Revised radiology collections
Revised pathology collections
New analysis results
Revised analysis results
New clinical metadata tables
New analysis results collection:
New clinical data collections:
New collections:
Updated collections:
Other:
Metadata corresponding to "limited" access collections are removed.
New clinical data collections:
Other clinical data updates:
Limited access collections are removed. Clinical metadata for the COVID-19-NY-SUB and ACRIN 6698/I-SPY2 Breast DWI collections now includes information ingested from data dictionaries associated with these collections. In v11 the string value 'NA' was being changed to null during the ETL process for some columns/collections. This is now fixed in v12 and the value 'NA' is preserved.
This release introduces clinical data ingested for a subset of collections, and now available via a dedicated BigQuery dataset.
New collections:
New collections:
Updated collections:
CPTAC, TCGA and NLST collections have been reconverted due to a technical issue identified with a subset of images included in v9.
TCGA-DLBC
TCGA-KIRP: PatientID TCGA-5P-A9KA, StudyInstanceUID 2.25.191236165605958868867890945341011875563
TCGA-BRCA: PatientID TCGA-OL-A66H, StudyInstanceUID 2.25.82800314486527687800038836287574075736 The affected files will be included in IDC when the infrastructure limitation is addressed.
Collection access level change:
This data release introduces the concept of differential license to IDC: some of the collections maintained by IDC contain items that have different licenses. As an example, radiology component of the TCGA-GBM collection is covered by the TCIA limited access license, and is not available in IDC, while the digital pathology component is covered by CC-BY. With this release, we complete sharing in full of the digital pathology component of the datasets released by the CPTAC and TCGA programs.
New collections:
Updated collections:
The main highlight of this release is the addition of the NLST and TCGA Slide Microscopy imaging data. New TCGA content includes introduction of new (to IDC) TCGA collections that have only slide microscopy component, and addition of the slide microscopy component to those IDC collections that were available earlier and included only the radiology component.
New collections
TCGA-DLBC (TCGA-DLBC collection does not have a description page)
Updated collections
The main highlight of this release is the addition of the Slide Microscopy imaging component to the remaining CPTAC collections.
New collections
Updated collections
Original collections:
Analysis results collections:
New collections:
New analysis results collections:
Updated collections:
1) CT images available as any other imaging collection (via IDC Portal, BigQuery metadata tables, and storage buckets);
3) One instance is missing from patient/study/series:
126153/1.2.840.113654.2.55.319335498043274792486636919135185299851/1.2.840.113654.2.55.262421043240525317038356381369289737801
4) Three instances are missing from patient/study/series:
215303/1.3.6.1.4.1.14519.5.2.1.7009.9004.337968382369511017896638591276/1.3.6.1.4.1.14519.5.2.1.7009.9004.180224303090109944523368212991
The DICOM Slide Microscopy (SM) images included in the collections above in IDC are not available in TCIA. TCIA only includes images in the vendor-specific SVS format!
New original collections:
New analysis results collections:
Original collections included:
Analysis collections included:
Collections analyzed:
Collections analyzed:
WARNING: After the release of v20, it was discovered that a mistake had been made during data conversion that affected the newly-released segmentations accompanying the "RMS-Mutation-Prediction" collection. Segmentations released in v20 for this collection have the segment labels for alveolar rhabdomyosarcoma (ARMS) and embryonal rhabdomyosarcoma (ERMS) switched in the metadata relative to the correct labels. Thus segment 3 in the released files is labelled in the metadata (the SegmentSequence) as ARMS but should correctly be interpreted as ERMS, and conversely segment 4 in the released files is labelled as ERMS but should be correctly interpreted as ARMS. We apologize for the mistake and any confusion that it has caused, and will be releasing a corrected version of the files in the next release as soon as possible. Collections analyzed:
Collections analyzed:
Collections analyzed:
Collections analyzed:
* Collections analyzed:
** Collections analyzed:
(revisions only to clinical data)
**
(fix PatientAges > 090Y)
(fix PatientAges > 090Y)
*
(All TCGA revisions are to correct multiple manufacturer values within same series)
Collections analyzed:
(TCIA description: (Repair of DICOM tag(0008,0005) to value "ISO_IR 100" in 79 series)
(Revised because results from CPTAC-CRCC-Tumor-Annotations were added)
(Revised because results from CPTAC-UCEC-Tumor-Annotations were added)
(Revised because results from CPTAC-PDA-Tumor-Annotations were added)
(ICDC-Glioma radiology added in a previous version)
(TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(“TCIA description: Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
(TCIA description: “Added DICOM version of MED_ABD_LYMPH_MASKS.zip segmentations that were previously available”)
(Revised because QIBA-VolCT-1B analysis results were added)
(Revised because analysis results from nnU-Net-BPR-Annotations were revised)
(Revised because analysis results from nnU-Net-BPR-Annotations were revised)
(11 pathology-only patients removed at request of data owner)
(1 pathology-only patient removed at request of data owner)
(Analysis of NLST and NSCLC-Radiomics)
(Annotations of NLST and NSCLC-Radiomics radiology)
This release does not introduce any new data, but changes the bucket organization and introduces replication of IDC files in Amazon AWS storage buckets, as described in .
In this release we introduce a new HTAN program including currently three collections release by the .
*
*
Note that the TCGA-KIRP and TCGA-BRCA collections (marked with the asterisk in the list above) are currently missing SM high resolution layer files/instances due to a of Google Healthcare that makes it not possible to ingest datasets that exceed some internal limits. Specifically, the following patient/studies are affected:
is now available as public access collection
The following collections became limited access due to the , which is the original source of those collections.
Outcome Prediction in Patients with Glioblastoma by Using Imaging, Clinical, and Genomic Biomarkers: Focus on the Nonenhancing Component of the Tumor ()
DICOM-SEG Conversions for TCGA-LGG and TCGA-GBM Segmentation Datasets ()
is added. The data included consists of the following components:
2) a subset of clinical data available in the BigQuery tables starting with nlst_ under the idc_v4 dataset, as documented in the section.
The following radiology collections were updated to include DICOM Slide Microscopy (SM) images converted from the original vendor-specific representation into .
Listed below are all of the and collections of currently hosted by IDC, with the links to the Digital Object Identifiers (DOIs) of those collections.
Listed below are all of the and collections of currently hosted by IDC, with the links to the Digital Object Identifiers (DOIs) of those collections.
(only items corresponding to the LIDC-IDRI original collection are included)
(only items corresponding to the ISPY1 original collection are included)