Skip to content

4258 Add TCIA dataset#4610

Merged
wyli merged 36 commits into
Project-MONAI:devfrom
yiheng-wang-nv:4258-add-tciadataset
Jul 19, 2022
Merged

4258 Add TCIA dataset#4610
wyli merged 36 commits into
Project-MONAI:devfrom
yiheng-wang-nv:4258-add-tciadataset

Conversation

@yiheng-wang-nv

@yiheng-wang-nv yiheng-wang-nv commented Jun 29, 2022

Copy link
Copy Markdown
Contributor

Signed-off-by: Yiheng Wang vennw@nvidia.com

Fixes #4258 .

Description

This PR is used to:

  1. add TciaDataset, which is able to download and data from TCIA.
  2. enhance PydicomReader to support load dicom data with modality "SEG"

Dataset download and load images

I've tested with the following collections with seg_type = "SEG":

  • LIDC-IDRI
  • C4KC-KiTS
  • NSCLC Radiogenomics
  • NSCLC-Radiomics
  • NSCLC-Radiomics-Interobserver1
  • PROSTATEx
  • QIN LUNG CT
  • QIN-PROSTATE-Repeatability
  • RIDER Lung CT

Also tested with the following collections with seg_type = "RTSTRUCT":

  • Pancreatic-CT-CBCT-SEG
  • Pediatric-CT-SEG
  • LCTSC
  • 4D-Lung

load "SEG" data

For collections that contain modality "SEG", if tag "PerFrameFunctionalGroupsSequence" exists for each frame of the dicom file, the reader is able to load the data (this method refers to: Highdicom ). Therefore, for the collections with seg_type = "SEG" mentioned above, some of them cannot be recognized:

  • LIDC-IDRI
  • NSCLC Radiogenomics
  • QIN LUNG CT
  • RIDER Lung CT

Status

Ready

progresses:

  • Implement TciaDataset

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

yiheng-wang-nv and others added 8 commits June 29, 2022 16:57
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
@yiheng-wang-nv yiheng-wang-nv requested a review from wyli July 8, 2022 08:20
yiheng-wang-nv and others added 7 commits July 8, 2022 16:55
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
@yiheng-wang-nv yiheng-wang-nv marked this pull request as ready for review July 13, 2022 08:39
@yiheng-wang-nv

Copy link
Copy Markdown
Contributor Author

Hi @kirbyju and @AHarouni , could you please help to review this PR? Thanks!

Comment thread monai/apps/datasets.py Outdated
Co-authored-by: Wenqi Li <831580+wyli@users.noreply.github.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
yiheng-wang-nv and others added 5 commits July 14, 2022 16:12
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Comment thread monai/apps/datasets.py Outdated
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
@yiheng-wang-nv

Copy link
Copy Markdown
Contributor Author

/black

Signed-off-by: monai-bot <monai.miccai2019@gmail.com>
@yiheng-wang-nv yiheng-wang-nv requested a review from wyli July 18, 2022 13:02
yiheng-wang-nv and others added 3 commits July 19, 2022 12:06
Signed-off-by: Wenqi Li <wenqil@nvidia.com>
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
@wyli

wyli commented Jul 19, 2022

Copy link
Copy Markdown
Contributor

/black

@wyli

wyli commented Jul 19, 2022

Copy link
Copy Markdown
Contributor

/build

@wyli wyli enabled auto-merge (squash) July 19, 2022 07:32
@wyli wyli disabled auto-merge July 19, 2022 07:36
wyli and others added 2 commits July 19, 2022 08:39
@wyli

wyli commented Jul 19, 2022

Copy link
Copy Markdown
Contributor

/black

@wyli wyli enabled auto-merge (squash) July 19, 2022 09:05
wyli and others added 4 commits July 19, 2022 12:41
Signed-off-by: Yiheng Wang <vennw@nvidia.com>
Signed-off-by: Wenqi Li <wenqil@nvidia.com>
@wyli

wyli commented Jul 19, 2022

Copy link
Copy Markdown
Contributor

/build

Comment thread monai/apps/tcia/utils.py
Signed-off-by: Wenqi Li <wenqil@nvidia.com>
@wyli

wyli commented Jul 19, 2022

Copy link
Copy Markdown
Contributor

/build

@wyli wyli merged commit 422cc6d into Project-MONAI:dev Jul 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

monai Dataset subclass for TCIA Rest API

4 participants