Core functions

Easy and efficient access to public cancer imaging data

We ingest and distribute datasets from variety of sources and contributors, primarily focusing on large data collection initiatives sponsored by US National Cancer Institute.

At this time, we do not have resources to prioritize receipt of the imaging data from individual PIs (but we are encouraging submissions of annotations/analysis results for existing IDC data!). Nevertheless, if you feel you might have a compelling dataset, please email us at [email protected].

On ingestion, we harmonize images and image-derived data into DICOM format for interoperability, whenever data is represented in a non-DICOM format.

Upon conversion, the data undergoes Extract-Transform-Load (ETL), which extracts DICOM metadata to make the data searchable, ingests the DICOM files into public S3 storage buckets and a DICOMweb store. Once the data is released, we provide various interfaces to access data and metadata.

Schematic summary of the IDC data ingestion and release process.

Tools to simplify the use of the data

We are actively developing a variety of capabilities to make it easier for the users to work with the data in IDC. Some of the examples of those tools include

• IDC Portal provides interactive browser-based interface for exploration of IDC data

• we are the maintainers of Slim - an open-source viewer of DICOM digital pathology images; Slim is integrated with IDC Portal for visualizing pathology images and image-derived data available in IDC

• we are actively contributing to the OHIF Viewer, and rely on it for visualizing radiology images and image-derived data

• idc-index is a python package that provides convenience functions for accessing IDC data, including efficient download from IDC public S3 buckets

• 3D Slicer extensions SlicerIDCBrowser can be used for interactive download of IDC data

• we are contributing to a variety of tools that aim to simplify the use of DICOM in cancer imaging research; these include OpenSlide and BioFormats bfconvert library that can be used for conversion between DICOM Whole Slide Imaging (WSI) format and other slide microscopy formats, dcmqi library for converting image analysis results to and from DICOM representation

Although IDC data is stored in DICOM format, it can be converted into alternative research representations using open-source tools.

Support of continuous enrichment of data

We welcome you to apply to contribute analysis results and annotations of the images available in IDC! These can be expert manual annotations, analysis results generated using AI tools, segmentations, contours, metadata attributes describing the data (e.g., annotation of the scan type), expert evaluation of the quality of existing AI-generated annotations in IDC.

If you would like your annotations/analysis results to be considered, you must establish the value of your contribution (e.g., describe the qualifications of the experts performing manual annotations, demonstrate robustness of the AI tool you are applying to images with a peer-reviewed publication or other type of evidence), and be willing to share your contribution under a permissive Creative Commons Attribution CC BY 4.0 license.

See more details on our curation policy here, and reach out by sending email to [email protected] with any questions or inquries. Every application will be reviewed by IDC stakeholders.

If your contribution is accepted by the IDC stakeholders:

• we will work with you to choose the appropriate DICOM object type for your data and convert it into DICOM representation

• upon conversion, we will create a Zenodo entry under theNCI Imaging Data Commons Zenodo community for your contribution so that you get the Digital Object Identifier (DOI), citation and recognition of your contribution

• once published in IDC

  • your data will become searchable and viewable in IDC Portal, so it is easier for the users of your data to discover and work with your data

  • files can be downloaded very efficiently using S3 interface and idc-index

Integration of cancer imaging data with other components of CRDC

IDC is a component of the broader NCI Cancer Research Data Commons (CRDC), giving you access to the following:

• Cancer Data Aggregator (CDA) can be used to find data related to the images in IDC in Genomics Data Commons, Proteomics Data Commons and Integrated Canine Data Commons

• Broad FireCloud and Seven Bridges Cancer Genimics Cloud (SB-CGC) can be used to apply analysis tools to the data in IDC (you can read more about how this can be done in this preprint from the IDC team)

• MHub.AI platform curates a growing number of cancer imaging AI models that can be applied directly to the DICOM data available in IDC