Skip to content

sbApp_hyp3: update url of the example dataset#26

Merged
yunjunz merged 3 commits intoinsarlab:mainfrom
cirrusasf:asf-mintpy-tutorial
Sep 14, 2021
Merged

sbApp_hyp3: update url of the example dataset#26
yunjunz merged 3 commits intoinsarlab:mainfrom
cirrusasf:asf-mintpy-tutorial

Conversation

@cirrusasf
Copy link
Contributor

No description provided.

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@yunjunz
Copy link
Member

yunjunz commented Aug 14, 2021

Looks good. I like the new way of using wget to download rather than aws.

One details, I don't find the prep_ts_hyp3 in the hyp3-docs repo currently. So I guess it's a planned future notebook there?

@yunjunz
Copy link
Member

yunjunz commented Aug 14, 2021

Hi @cirrusasf, I have tried your example dataset and everything seems to work out fine, which is great!

There are quite some redundant files in it, so I remove a lot of them, the remaining files are as below, which is ~1GB before compression and ~500 MB after compression into RidgecrestSenDT71.tar.xz file. I would suggest uploading this to the AWS S3 bucket also for a smaller size on the user size. If you could do this, I will add hyp3 into the regular circle CI testing for long-term maintenance.

With your permission, I would recommend letting me upload this to zenodo as well, where the other example datasets for mintpy sits. It would be similar to https://zenodo.org/record/3952950, where you and the related ASF team will be first author.

What do you think?

Related to insarlab/MintPy#540.

(insar) yunjunz:~/data/test/RidgecrestSenDT71>$ tree
.
├── hyp3
│   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262.README.md.txt
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262.txt
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_corr_clip.tif
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_dem_clip.tif
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_lv_phi_clip.tif
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_lv_theta_clip.tif
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_unw_phase.png
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_unw_phase.png.aux.xml
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_unw_phase.png.xml
│   │   ├── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_unw_phase_clip.tif
│   │   └── S1AA_20190610T135156_20190622T135157_VVP012_INT80_G_ueF_1262_water_mask_clip.tif
│   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C.README.md.txt
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C.txt
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C_corr_clip.tif
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C_unw_phase.png
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C_unw_phase.png.aux.xml
│   │   ├── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C_unw_phase.png.xml
│   │   └── S1AA_20190610T135156_20190704T135158_VVP024_INT80_G_ueF_612C_unw_phase_clip.tif
│   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43.README.md.txt
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43.txt
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43_corr_clip.tif
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43_unw_phase.png
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43_unw_phase.png.aux.xml
│   │   ├── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43_unw_phase.png.xml
│   │   └── S1AA_20190622T135157_20190704T135158_VVP012_INT80_G_ueF_4C43_unw_phase_clip.tif
│   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28.README.md.txt
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28.txt
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28_corr_clip.tif
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28_unw_phase.png
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28_unw_phase.png.aux.xml
│   │   ├── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28_unw_phase.png.xml
│   │   └── S1AA_20190622T135157_20190716T135159_VVP024_INT80_G_ueF_BA28_unw_phase_clip.tif
│   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F.README.md.txt
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F.txt
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F_corr_clip.tif
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F_unw_phase.png
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F_unw_phase.png.aux.xml
│   │   ├── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F_unw_phase.png.xml
│   │   └── S1AA_20190704T135158_20190716T135159_VVP012_INT80_G_ueF_EF5F_unw_phase_clip.tif
│   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C.README.md.txt
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C.txt
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C_corr_clip.tif
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C_unw_phase.png
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C_unw_phase.png.aux.xml
│   │   ├── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C_unw_phase.png.xml
│   │   └── S1AA_20190704T135158_20190728T135159_VVP024_INT80_G_ueF_513C_unw_phase_clip.tif
│   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927.README.md.txt
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927.txt
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927_corr_clip.tif
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927_unw_phase.png
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927_unw_phase.png.aux.xml
│   │   ├── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927_unw_phase.png.xml
│   │   └── S1AA_20190716T135159_20190728T135159_VVP012_INT80_G_ueF_3927_unw_phase_clip.tif
│   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01.README.md.txt
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01.txt
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01_corr_clip.tif
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01_unw_phase.png
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01_unw_phase.png.aux.xml
│   │   ├── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01_unw_phase.png.xml
│   │   └── S1AA_20190716T135159_20190809T135200_VVP024_INT80_G_ueF_9D01_unw_phase_clip.tif
│   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175.README.md.txt
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175.txt
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175_corr_clip.tif
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175_unw_phase.png
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175_unw_phase.png.aux.xml
│   │   ├── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175_unw_phase.png.xml
│   │   └── S1AA_20190728T135159_20190809T135200_VVP012_INT80_G_ueF_C175_unw_phase_clip.tif
│   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B.README.md.txt
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B.txt
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B_corr_clip.tif
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B_unw_phase.png
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B_unw_phase.png.aux.xml
│   │   ├── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B_unw_phase.png.xml
│   │   └── S1AA_20190728T135159_20190821T135201_VVP024_INT80_G_ueF_1D6B_unw_phase_clip.tif
│   └── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04.README.md.txt
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04.txt
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04_corr_clip.tif
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04_unw_phase.png
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04_unw_phase.png.aux.xml
│       ├── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04_unw_phase.png.xml
│       └── S1AA_20190809T135200_20190821T135201_VVP012_INT80_G_ueF_FA04_unw_phase_clip.tif
└── mintpy
    └── RidgecrestSenDT71.txt

13 directories, 82 files

@cirrusasf
Copy link
Contributor Author

cirrusasf commented Aug 16, 2021 via email

@yunjunz
Copy link
Member

yunjunz commented Aug 16, 2021

Great. Could you provide a list of names and affiliations to be added to the authors list of the dataset on Zenodo?

@cirrusasf
Copy link
Contributor Author

cirrusasf commented Aug 17, 2021 via email

@yunjunz
Copy link
Member

yunjunz commented Aug 17, 2021

Thanks for the list. I will let you know when it's uploaded and available on Zenodo.

@yunjunz
Copy link
Member

yunjunz commented Sep 13, 2021

Hi @cirrusasf, the dataset is now on zenodo: https://zenodo.org/record/5502403. Cheers.

@yunjunz yunjunz changed the title update the url of the example dataset sbApp_hyp3: update url of the example dataset Sep 14, 2021
@yunjunz yunjunz merged commit f58e150 into insarlab:main Sep 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants