> For the complete documentation index, see [llms.txt](https://learn.canceridc.dev/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://learn.canceridc.dev/frequently-asked-questions.md).

# Frequently Asked Questions

## What is the difference between IDC and TCIA?

IDC and TCIA are partners in providing [FAIR data](https://learn.canceridc.dev/fair.md) for cancer imaging researchers.

TCIA provides a unique service: it works with data submitters to de-identify, curate and publish cancer imaging data. TCIA distributes the non-DICOM data it publishes. The public DICOM collections it publishes are distributed by IDC, which is the only place to download them.

The mission of IDC is to support efficient access and use of the cancer imaging data, after it was de-identified and released.

Here are some of the highlights that make IDC unique:

* **Unique datasets:** IDC is the only place to download the public DICOM collections published by TCIA. In addition, there is a growing amount of data in IDC that is not available anywhere else:
  * DICOM digital pathology collections from prominent initiatives: Childhood Cancer Data Initiative (CCDI), GTEx, TCGA, CPTAC, HTAN, CMB
  * image analysis results available only from IDC, such as TotalSegmentator segmentations and radiomics features for most of the CT images in the NLST collection
* **Cloud-native:** IDC makes the data available in public cloud buckets with free egress, so you can download it quickly, at no cost and without logging in
* **Partnerships with cloud vendors:** IDC collaborates with Public Datasets Programs of Amazon Web Services and Google Cloud to support hosting and free out-of-cloud egress, contributing to improved accessibility, sustainability and longevity of the resource
* **State of the art tools:** IDC maintains superior community recognized tools to support the use of the data:
  * modern OHIF Viewer v3 for radiology data, with support of visualization of annotations and segmentations;
  * Slim viewer for digital pathology and annotations
  * highly capable IDC Portal
* **Standard access interfaces:** IDC offers standard interfaces for data access: S3 API for file download, DICOMweb for interoperability with DICOM tools, SQL for searching all of the DICOM metadata
* **Harmonized data:** All of the data (radiology and digital pathology images, annotations, segmentations, image-derived features) available in IDC is harmonized into DICOM representation, which means
  * interoperability: you can use IDC data with any DICOM-compatible tool
  * metadata: every single file in IDC is accompanied by metadata that follows DICOM data model, and is associated with unique identifiers, allowing you to build reproducible cohorts
  * uniform representation: you don't need to customize your processing pipelines to a specific collection, and can build cohorts combining data across collections
* **Co-location with cloud compute resources:** IDC data is easier to access from cloud computing resources, allowing you to more easily experiment with the new analysis tools and scale your computation
* **Versioning:** IDC data is versioned: you will be able to access the exact files you analyzed in a given verison of IDC even if there were any updates to the collection after you accessed it, helping you achieve reproducibility of your analyses
* **Open-source tool stack:** all of the tools developed by IDC are shared under permissive licenses to support community contribution, reuse and sustainability

## How to download data from IDC?

Check out the [Downloading data](https://learn.canceridc.dev/data/downloading-data.md) documentation page!

## How do I get my data into IDC?

Data reaches IDC in three ways:

* **through** [**The Cancer Imaging Archive (TCIA)**](https://www.cancerimagingarchive.net/)**.** TCIA de-identifies, curates and publishes collections, and IDC is the only place to download the public DICOM collections that TCIA publishes.
* **directly to IDC.**
  * IDC prioritizes original image collections from NCI-funded driving projects and selected initiatives, and considers other strong datasets case by case.
  * IDC welcomes derived data, such as expert annotations or results produced by ML models, for the images already in IDC. Please contribute these directly to IDC rather than through TCIA: the process is simpler, and your results are likely to be available in IDC sooner.
* **IDC selects an existing public dataset** and converts it to DICOM. Anyone can suggest a dataset.

All data in IDC must be public, de-identified, and in DICOM or feasible to convert to DICOM. The CC BY 4.0 license is strongly preferred.

See [Contributing data](https://learn.canceridc.dev/contributing-data.md) for the requirements and the process, or email <support+submissions@canceridc.dev>.

## How much does it cost to use the cloud?

IDC data is stored in the cloud buckets, and you can search and [download data from IDC](https://learn.canceridc.dev/data/downloading-data.md) for free and without login.

If you would like to use the cloud for analysis of the data, we recommend you start with the free tier of [Google Colab](https://colab.research.google.com) to get free access to a cloud-hosted VM with GPU to experiment with analysis workflows for IDC data. If you are an NIH-funded researcher, you may be eligible for a free allocation via [NIH Cloud Lab](https://cloud.nih.gov/resources/cloudlab/). US-based researchers can also access free cloud-based computing resources via [ACCESS program allocations](https://learn.canceridc.dev/cookbook/access-allocations.md).

## What is the status of IDC?

IDC pilot release took place in Fall 2020, followed by the production release in September 2021. IDC team is continuously refining the capabilities of IDC Portal and various tools, and publishes new data releases every 3-4 months.

## What data is available?

IDC distributes the public DICOM collections published by [The Cancer Imaging Archive (TCIA)](https://www.cancerimagingarchive.net), and is the only place to download them. We also host HTAN and other pathology images not hosted by TCIA, and analysis results available only from IDC. You can review the complete, up-to-date list of [collections included in IDC](https://portal.imaging.datacommons.cancer.gov/collections/).

## How to acknowledge IDC?

Please cite the latest paper from the IDC team. Please also make sure you acknowledge the specific data collections you used in your analysis.

> Fedorov, A., Longabaugh, W. J. R., Pot, D., Clunie, D. A., Pieper, S. D., Gibbs, D. L., Bridge, C., Herrmann, M. D., Homeyer, A., Lewis, R., Aerts, H. J. W. L., Krishnaswamy, D., Thiriveedhi, V. K., Ciausu, C., Schacherer, D. P., Bontempi, D., Pihl, T., Wagner, U., Farahani, K., Kim, E. & Kikinis, R. National cancer institute imaging data commons: Toward transparency, reproducibility, and scalability in imaging artificial intelligence. *Radiographics* 43, (2023). <https://doi.org/10.1148/rg.230180>

## Where do I learn more about other components of CRDC?

The main website for the Cancer Research Data Commons (CRDC) is [https://datacommons.cancer.gov/](https://datacommons.cancer.gov)

## What about non-imaging data that accompanies IDC collections?

Clinical data that was shared by the submitters is available for a number of imaging collections in IDC. Please see [this tutorial](https://github.com/ImagingDataCommons/IDC-Tutorials/blob/master/notebooks/advanced_topics/clinical_data_intro.ipynb) on how to search that data and how to link clinical data with imaging metadata!

Many of the imaging collections are also accompanied by the genomics or proteomics data. CRDC [Cancer Data Aggregator (CDA)](https://cda.readthedocs.io/en/latest/) provides the API to locate such related datasets.

## I want to search IDC content using an attribute not available in the portal

IDC Portal gives you access to just a small subset of the metadata accompanying IDC images. If you want to learn more about what is available, you have several options:

* [this notebook](https://github.com/ImagingDataCommons/IDC-Tutorials/blob/master/notebooks/getting_started/part2_searching_basics.ipynb) from our Getting Started tutorial series explains how to use [`idc-index`](https://github.com/ImagingDataCommons/idc-index) - a python package that aims to simplify access to IDC data
* [this more advanced notebook](https://github.com/ImagingDataCommons/IDC-Tutorials/blob/master/notebooks/getting_started/part3_exploring_cohorts.ipynb) will help you get started with searching IDC metadata in BigQuery, which gives you access to all of the DICOM metadata extracted from IDC-hosted files
* if you are not comfortable writing queries or coding in pyhon, you can use [this DataStudio dashboard](https://datastudio.google.com/reporting/ab96379c-e134-414f-8996-188e678f1b70/page/KHtxB) to search using some of the attributes that are not available through the portal. You can also [extend this dashboard](https://learn.canceridc.dev/cookbook/data-studio/cohort-dashboard.md) to include additional attributes.
