Skip to content

Configurable resources for RGB and NN#131

Merged
iamsg95 merged 43 commits intomasterfrom
configurable-resources
Jul 3, 2020
Merged

Configurable resources for RGB and NN#131
iamsg95 merged 43 commits intomasterfrom
configurable-resources

Conversation

@iamsg95
Copy link
Copy Markdown

@iamsg95 iamsg95 commented Jun 18, 2020

New options were added:
sh/shaves - number of shaves used by NN
cmx/cmx_slices -number of cmx slices used by NN
NCE/NCEs -number of NCEs used by NN
rgb/rgb_cam_config - rgb camera config, 1080p_30hz / 4k_30hz supported currently

Install requirements for cloud compile:
python3 -m pip install -r requirements.txt
Install dependencies for hostapp cpp backend:

Ubuntu:
        sudo apt-get install -y  libcurl4-openssl-dev
macOS:
        brew install curl

Run as :
./depthai.py -s metaout previewout -sh 8 -cmx 8 -NCE 1 -rgb 4k_30hz -v test.h264 -dd

Tested on Mac and Linux.

@iamsg95 iamsg95 requested a review from Luxonis-Brandon June 18, 2020 00:31
@iamsg95 iamsg95 changed the title Configurable resources Configurable resources for RGB and NN Jun 18, 2020
@iamsg95 iamsg95 force-pushed the configurable-resources branch from 92e33d4 to 5554f9e Compare June 19, 2020 20:52
Comment thread depthai.py Outdated
Comment thread depthai.py Outdated
Comment thread depthai_helpers/cli_utils.py Outdated
@iamsg95 iamsg95 force-pushed the configurable-resources branch from fecbaa2 to d759944 Compare June 20, 2020 01:00
@Luxonis-Brandon
Copy link
Copy Markdown

Thanks good idea.

@iamsg95
Copy link
Copy Markdown
Author

iamsg95 commented Jun 22, 2020

Added model downloader into cpp backend:
New dependencies to build hostapp:

Ubuntu:
        sudo apt-get install -y  libcurl4-openssl-dev
  - macOS:
        brew install curl

@iamsg95
Copy link
Copy Markdown
Author

iamsg95 commented Jun 29, 2020

Fixed @Luxonis-Brandon
I was about to move NN decodings in different file, so it's cleaner, so I added a new parameter "labels", but I forget to update the code at one place.

@Luxonis-Brandon
Copy link
Copy Markdown

Thanks @szabi-luxonis . Yes, tested it and I can confirm it looks great! No problem now on my Mac for the same command.
image

Copy link
Copy Markdown

@Luxonis-Brandon Luxonis-Brandon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All LGTM and works for me!

Comment thread resources/nn/tiny-yolo/tiny-yolo.json
Comment thread model_compiler/model_converter.py Outdated
@alex-luxonis
Copy link
Copy Markdown
Collaborator

With a configuration that overloads the device so it can't keep up with 30fps processing, I see frame tearing or out-of-order frames, seems to appear in both previewout and h.264 streams, so could be from the ISP/post-processed output.

./depthai.py -sh 8 -cmx 8 -NCE 2 -rgbr 2160 -dd -v test.h264
./depthai.py -sh 8 -cmx 8 -NCE 2 -rgbr 2160 -dd

Not sure if caused by the change in frame update policy.
If not easy to resolve now, we could just flag the issue, as this may be an unusual configuration.

@Luxonis-Brandon
Copy link
Copy Markdown

Yes agreed on if not easy to solve to just flag it as I agree it is likely an unusual configuration.

Comment thread depthai_helpers/cli_utils.py Outdated
@iamsg95 iamsg95 merged commit a4f15e8 into master Jul 3, 2020
@SzabolcsGergely SzabolcsGergely deleted the configurable-resources branch October 6, 2020 06:15
SzabolcsGergely pushed a commit that referenced this pull request Oct 30, 2020
Configurable resources for RGB and NN
jdavidberger pushed a commit to constructiverealities/depthai that referenced this pull request May 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants