713-gradcam

[wyli]

Signed-off-by: Wenqi Li wenqil@nvidia.com

Fixes #713; fixes #1212

Description

visualisations with class activation maps
added CAM/GradCAM/GradCAM++

Status

ready

Types of changes

• Non-breaking change (fix or new feature that would not break existing functionality).
• New tests added to cover the changes.
• Integration tests passed locally by running ./runtests.sh --codeformat --coverage.
• Quick tests passed locally by running ./runtests.sh --quick.
• In-line docstrings updated.
• Documentation updated, tested make html command in the docs/ folder.

[wyli]

thanks @ahatamiz I've updated the modules, I'll add a few unit tests. do you have a use case in 3D by any chance?

[ahatamiz]

thanks @ahatamiz I've updated the modules, I'll add a few unit tests. do you have a use case in 3D by any chance?

Great work @wyli ! I don't have a trained 3D use case right now.. but maybe we can use one of the COVID models for classification ?

[wyli]

/integration-test
added modules and tests for:

• cam
  
• gradcam
  
• gradcam++
  

[Nic-Ma]

Thanks for your great work, this new feature looks good to me.
@ericspod do you have any more comments from a researcher's view?

Thanks.

[Nic-Ma]

Hi @wyli , and BTW, I think this is very cool a new feature, could you please help also develop a tutorial notebook for it?

Thanks.

[wyli]

Hi @wyli , and BTW, I think this is very cool a new feature, could you please help also develop a tutorial notebook for it?

Thanks.

that would be nice but I don't have a good quality 3d model, do you have access to any classification model?

[Nic-Ma]

Can we use IXI dataset to train a model? Actually, I am curious which part of the feature map indicates the gender in IXI.
Thanks.

[wyli]

Can we use IXI dataset to train a model? Actually, I am curious which part of the feature map indicates the gender in IXI.
Thanks.

the training is a short demo with only a few examples, don't think visualisation will make sense..

[Nic-Ma]

OK, then I don't have any better dataset for reference. Maybe @ericspod knows more?
Thanks.

[wyli]

I create a ticket to track the progress of the demo Project-MONAI/tutorials#76