Data release notes
Last updated
Last updated
Data hosted by IDC is ingested from several sources, including The Cancer Imaging Archive (TCIA), Genomics Data Commons (GDC), Clinical Proteomic Tumor Analysis Consortium (CPTAC) and Human Tumor Atlas Network (HTAN).
Please refer to the license and terms of use, which are defined in the license_url and source_doi or source_doi of the IDC BigQuery dicom_all table. You can filter the data by license type in the IDC Portal.
BAMF-AIMI-Annotations Collections analyzed:
Pan-Cancer-Nuclei-Seg-DICOM Collections analyzed:
The segmentation of an instance in each of the following series was excluded due to having a DICOM PixelData size greater than or equal to 2GB:
1.2.826.0.1.3680043.10.511.3.10544506665348704312902213950958190
1.2.826.0.1.3680043.10.511.3.11183783347037364699862133130586654
1.2.826.0.1.3680043.10.511.3.11834745481756047014039855874680259
1.2.826.0.1.3680043.10.511.3.11901667084519361717338400810055642
1.2.826.0.1.3680043.10.511.3.12041600048156613329793822566495651
1.2.826.0.1.3680043.10.511.3.12718116375608495830041119776887887
1.2.826.0.1.3680043.10.511.3.13386724401829265460622415500801368
1.2.826.0.1.3680043.10.511.3.14042734131864468280344737986870899
1.2.826.0.1.3680043.10.511.3.17374765903080083648409690755539184
1.2.826.0.1.3680043.10.511.3.17429002643681869326389465422353495
1.2.826.0.1.3680043.10.511.3.20359930476040698387716730891020638
1.2.826.0.1.3680043.10.511.3.28397033639127902823368316410884210
1.2.826.0.1.3680043.10.511.3.28425539132321749931109935391487352
1.2.826.0.1.3680043.10.511.3.34574227972763695321794092913087775
1.2.826.0.1.3680043.10.511.3.36216094237641867532902805456135029
1.2.826.0.1.3680043.10.511.3.39533936694797964318706337783276378
1.2.826.0.1.3680043.10.511.3.39900930856460689132625586523683939
1.2.826.0.1.3680043.10.511.3.41633795217567037218184715094985555
1.2.826.0.1.3680043.10.511.3.42218106649761752724553401155203874
1.2.826.0.1.3680043.10.511.3.49098870621170235412220976183110770
1.2.826.0.1.3680043.10.511.3.50064322235999800062455171235601125
1.2.826.0.1.3680043.10.511.3.50905421517530127976832505410705816
1.2.826.0.1.3680043.10.511.3.62935684444056080516153739948364303
1.2.826.0.1.3680043.10.511.3.73572792121235596011940904319511291
1.2.826.0.1.3680043.10.511.3.74494366757564543824303304482444570
1.2.826.0.1.3680043.10.511.3.79988146996803179892075404247166692
1.2.826.0.1.3680043.10.511.3.80004293150506819482091023564947091
1.2.826.0.1.3680043.10.511.3.82774274518897141254234567300292686
1.2.826.0.1.3680043.10.511.3.84202416467561501610598853920808906
1.2.826.0.1.3680043.10.511.3.86214492184712627544696209982376598
1.2.826.0.1.3680043.10.511.3.90193069664920622990317347485104073
1.2.826.0.1.3680043.10.511.3.95666157880521064637011880609274546
1.2.826.0.1.3680043.10.511.3.96676982370873257329281821215166082
1.2.826.0.1.3680043.10.511.3.98258035017480972315346136181769675
RMS-Mutation-Prediction-Expert-Annotations
WARNING: After the release of v20, it was discovered that a mistake had been made during data conversion that affected the newly-released segmentations accompanying the "RMS-Mutation-Prediction" collection. Segmentations released in v20 for this collection have the segment labels for alveolar rhabdomyosarcoma (ARMS) and embryonal rhabdomyosarcoma (ERMS) switched in the metadata relative to the correct labels. Thus segment 3 in the released files is labelled in the metadata (the SegmentSequence) as ARMS but should correctly be interpreted as ERMS, and conversely segment 4 in the released files is labelled as ERMS but should be correctly interpreted as ARMS. We apologize for the mistake and any confusion that it has caused, and will be releasing a corrected version of the files in the next release as soon as possible. Collections analyzed:
New pathology collections
New analysis results
Pancreas-CT-SEG Collections analyzed:
Revised radiology collections
Cancer Moonshot Biobank (CMB) radiology images were updated to fix incorrect values assigned to PatientID (see details on the collection pages linked above). The updated images have different DICOM Study/Series/SOPInstanceUIDs.
Revised analysis results
BAMF-AIMI-Annotations Collections analyzed:
New clinical metadata tables
New radiology collections
New analysis results
RMS-Mutation-Prediction-Expert-Annotations* Collections analyzed:
TotalSegmentator-CT-Segmentations** Collections analyzed:
Revised radiology collections
(starred collections are revised due to new or revised analysis results)
Breast-Cancer-Screening-DBT (revisions only to clinical data)
NLST**
Revised pathology collections
(starred collections are revised due to new or revised analysis results)
CPTAC-BRCA (fix PatientAges > 090Y)
CPTAC-COAD (fix PatientAges > 090Y)
Also added missing instance SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.3459553143.523311062.1687086765943.9.0
Removed corrupted instances
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2164023716.1899467316.1685791236516.37.0
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2411736851.773458418.1686038949651.37.0
SOPInstanceUID: 1.3.6.1.4.1.5962.99.1.2411736851.773458418.16860389
TCGA-BLCA (All TCGA revisions are to correct multiple manufacturer values within same series)
TCGA-DLBC (No description page)
New clinical metadata tables
Notes
The deprecated columns tcia_api_collection_id and idc_webapp_collection_id have been removed from the auxiliary_metadata table in the idc_v18 BQ dataset. These columns were duplicates of columns collection_name and collection_id respectively.
New radiology collections
New analysis results
Prostate-MRI-US-Biopsy-DICOM-Annotations Collections analyzed:
Revised radiology collections
New clinical metadata tables
New radiology collections
New pathology collections
Revised radiology collections
Breast-MRI-NACT-Pilot (TCIA description: (Repair of DICOM tag(0008,0005) to value "ISO_IR 100" in 79 series)
CPTAC-CRCC (Revised because results from CPTAC-CRCC-Tumor-Annotations were added)
CPTAC-UCEC (Revised because results from CPTAC-UCEC-Tumor-Annotations were added)
CPTAC-PDA (Revised because results from CPTAC-PDA-Tumor-Annotations were added)
New analysis results
New clinical metadata tables
New radiology collections
New pathology collections
ICDC-Glioma (ICDC-Glioma radiology added in a previous version)
Revised radiology collections
CPTAC-CCRCC (TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-CM (“TCIA description: Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-LSCC (TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-LUAD (TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-PDA (TCIA description: TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-SAR (TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CPTAC-UCEC (TCIA description: “Radiology modality data cleanup to remove extraneous scans.”)
CT Lymph Nodes (TCIA description: “Added DICOM version of MED_ABD_LYMPH_MASKS.zip segmentations that were previously available”)
RIDER Lung CT (Revised because QIBA-VolCT-1B analysis results were added)
NLST (Revised because analysis results from nnU-Net-BPR-Annotations were revised)
NSCLC-Radiomics (Revised because analysis results from nnU-Net-BPR-Annotations were revised)
Revised pathology collections
CPTAC-GBM (11 pathology-only patients removed at request of data owner)
CPTAC-SAR (1 pathology-only patient removed at request of data owner)
New analysis results
QIBA-VolCT-1B (Analysis of NLST and NSCLC-Radiomics)
Revised analysis results
nnU-Net-BPR-Annotations (Annotations of NLST and NSCLC-Radiomics radiology)
New clinical metadata tables
This release does not introduce any new data, but changes the bucket organization and introduces replication of IDC files in Amazon AWS storage buckets, as described in this section.
New analysis results collection:
New clinical data collections:
New collections:
Updated collections:
Other:
Metadata corresponding to "limited" access collections are removed.
New clinical data collections:
Other clinical data updates:
Limited access collections are removed. Clinical metadata for the COVID-19-NY-SUB and ACRIN 6698/I-SPY2 Breast DWI collections now includes information ingested from data dictionaries associated with these collections. In v11 the string value 'NA' was being changed to null during the ETL process for some columns/collections. This is now fixed in v12 and the value 'NA' is preserved.
This release introduces clinical data ingested for a subset of collections, and now available via a dedicated BigQuery dataset.
New collections:
In this release we introduce a new HTAN program including currently three collections release by the Human Tumor Atlas Network.
New collections:
Updated collections:
CPTAC, TCGA and NLST collections have been reconverted due to a technical issue identified with a subset of images included in v9.
TCGA-DLBC
Note that the TCGA-KIRP and TCGA-BRCA collections (marked with the asterisk in the list above) are currently missing SM high resolution layer files/instances due to a known limitation of Google Healthcare that makes it not possible to ingest datasets that exceed some internal limits. Specifically, the following patient/studies are affected:
TCGA-KIRP: PatientID TCGA-5P-A9KA, StudyInstanceUID 2.25.191236165605958868867890945341011875563
TCGA-BRCA: PatientID TCGA-OL-A66H, StudyInstanceUID 2.25.82800314486527687800038836287574075736 The affected files will be included in IDC when the infrastructure limitation is addressed.
Collection access level change:
Vestibular-Schwannoma-SEG is now available as public access collection
This data release introduces the concept of differential license to IDC: some of the collections maintained by IDC contain items that have different licenses. As an example, radiology component of the TCGA-GBM collection is covered by the TCIA limited access license, and is not available in IDC, while the digital pathology component is covered by CC-BY. With this release, we complete sharing in full of the digital pathology component of the datasets released by the CPTAC and TCGA programs.
New collections:
Updated collections:
The main highlight of this release is the addition of the NLST and TCGA Slide Microscopy imaging data. New TCGA content includes introduction of new (to IDC) TCGA collections that have only slide microscopy component, and addition of the slide microscopy component to those IDC collections that were available earlier and included only the radiology component.
New collections
TCGA-DLBC (TCGA-DLBC collection does not have a description page)
Updated collections
The main highlight of this release is the addition of the Slide Microscopy imaging component to the remaining CPTAC collections.
New collections
Updated collections
The following collections became limited access due to the change in policy by TCIA, which is the original source of those collections.
Original collections:
Analysis results collections:
New collections:
New analysis results collections:
Outcome Prediction in Patients with Glioblastoma by Using Imaging, Clinical, and Genomic Biomarkers: Focus on the Nonenhancing Component of the Tumor (GBM-MR-NER-Outcomes)
DICOM-SEG Conversions for TCGA-LGG and TCGA-GBM Segmentation Datasets (DICOM-Glioma-SEG)
Updated collections:
National Lung Screening Trial (NLST) collection is added. The data included consists of the following components:
1) CT images available as any other imaging collection (via IDC Portal, BigQuery metadata tables, and storage buckets);
2) a subset of clinical data available in the BigQuery tables starting with nlst_ under the idc_v4 dataset, as documented in the Collection-specific BigQuery Tables section.
3) One instance is missing from patient/study/series:
126153/1.2.840.113654.2.55.319335498043274792486636919135185299851/1.2.840.113654.2.55.262421043240525317038356381369289737801
4) Three instances are missing from patient/study/series:
215303/1.3.6.1.4.1.14519.5.2.1.7009.9004.337968382369511017896638591276/1.3.6.1.4.1.14519.5.2.1.7009.9004.180224303090109944523368212991
The following radiology collections were updated to include DICOM Slide Microscopy (SM) images converted from the original vendor-specific representation into dual personality DICOM-TIFF format.
The DICOM Slide Microscopy (SM) images included in the collections above in IDC are not available in TCIA. TCIA only includes images in the vendor-specific SVS format!
Listed below are all of the original and analysis results collections of The Cancer Imaging Archive currently hosted by IDC, with the links to the Digital Object Identifiers (DOIs) of those collections.
New original collections:
New analysis results collections:
Listed below are all of the original and analysis results collections of The Cancer Imaging Archive currently hosted by IDC, with the links to the Digital Object Identifiers (DOIs) of those collections.
Original collections included:
Analysis collections included:
QIN multi-site collection of Lung CT data with Nodule Segmentations (only items corresponding to the LIDC-IDRI original collection are included)
DICOM SR of clinical data and measurement for breast cancer collections to TCIA (only items corresponding to the ISPY1 original collection are included)