Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Mask, SuperResolution, Depth visualization features #747

Merged

Conversation

vinnamkim
Copy link
Contributor

@vinnamkim vinnamkim commented Oct 20, 2022

Summary

  • Related ticket no. 94411.
  • Add Mask, SuperResolution, Depth visualization features
Mask SuperResolution (up: draw_only_image=True, down: draw_only_image=False Depth
image image image

How to test

I added unit tests for changes.

Checklist

License

  • I submit my code changes under the same MIT License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below)
# Copyright (C) 2021 Intel Corporation
#
# SPDX-License-Identifier: MIT

@vinnamkim
Copy link
Contributor Author

This should be merged after #746.

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@vinnamkim
Copy link
Contributor Author

I added Jupyter notebook examples for visualization in this PR. The related ticket is no. 94408.

@vinnamkim vinnamkim assigned sooahleex and bonhunko and unassigned sooahleex and bonhunko Oct 21, 2022
@vinnamkim vinnamkim added the ENHANCE Enhancement of existing features label Oct 21, 2022
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
function

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
datumaro/components/visualizer.py Show resolved Hide resolved
datumaro/components/visualizer.py Outdated Show resolved Hide resolved
@review-notebook-app
Copy link

review-notebook-app bot commented Oct 31, 2022

View / edit / reply to this conversation on ReviewNB

wonjuleee commented on 2022-10-31T04:32:42Z
----------------------------------------------------------------

Specifically, we are going to provide the example codes for instance segmentation and captioning tasks with MS-COCO 2017 dataset.


vinnamkim commented on 2022-10-31T07:49:23Z
----------------------------------------------------------------

Added.

@review-notebook-app
Copy link

review-notebook-app bot commented Oct 31, 2022

View / edit / reply to this conversation on ReviewNB

wonjuleee commented on 2022-10-31T04:32:43Z
----------------------------------------------------------------

Can we reuse the tests/assets instead of downloading the full dataset?


vinnamkim commented on 2022-10-31T07:20:00Z
----------------------------------------------------------------

I don't know whether there is a legal issue to upload some of images in COCO dataset to this repository. This downloading COCO dataset in notebook examples is same as yolov5/tutorial.ipynb at master · ultralytics/yolov5 (github.com).

wonjuleee commented on 2022-10-31T08:09:49Z
----------------------------------------------------------------

I don't think downloading all dataset for running this notebook is efficient.

vinnamkim commented on 2022-10-31T08:19:30Z
----------------------------------------------------------------

Out of efficiency issue, my opinion is that this notebook is intended to give users insight or teach them about how to use Datumaro with real-world datasets. However, I do not think that explaining this with artificially created small datasets or custom assets will not be of sufficient help to users. Especially because users are likely to make use of this notebook to solve their problem rather than just running it, it's good start point to use the real-world dataset as an example.

vinnamkim commented on 2022-10-31T08:20:39Z
----------------------------------------------------------------

In addition, it does not require many resources because COCO val dataset is <1G.

wonjuleee commented on 2022-11-01T00:45:09Z
----------------------------------------------------------------

If so, we need to download other datasets for other notebooks. My suggestion is making an option to download public datasets or prepare another separated notebook for downloading public datasets. Referring the notebook could be enough.

On the other hand, Datumaro provides the downloading command through CLI.

vinnamkim commented on 2022-11-01T00:53:48Z
----------------------------------------------------------------

I guess download from CLI command only supports BBOX for now.

https://github.com/openvinotoolkit/datumaro/blob/a8f3cc947594d7fe2f16a7f61a07a67150cfb78f/datumaro/components/extractor_tfds.py#L287-L302

Can we leave this to be a future work? (Current) download from source -> (Future) Download from Datumaro CLI

wonjuleee commented on 2022-11-01T01:33:28Z
----------------------------------------------------------------

Yes, sure. Let's take a look at CLI issues with another thread.

Copy link
Contributor Author

I don't know whether there is a legal issue to upload some of images in COCO dataset to this repository. This downloading COCO dataset in notebook examples is same as yolov5/tutorial.ipynb at master · ultralytics/yolov5 (github.com).


View entire conversation on ReviewNB

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Copy link
Contributor Author

Added.


View entire conversation on ReviewNB

Copy link
Contributor

I don't think downloading all dataset for running this notebook is efficient.


View entire conversation on ReviewNB

Copy link
Contributor Author

Out of efficiency issue, my opinion is that this notebook is intended to give users insight or teach them about how to use Datumaro with real-world datasets. However, I do not think that explaining this with artificially created small datasets or custom assets will not be of sufficient help to users. Especially because users are likely to make use of this notebook to solve their problem rather than just running it, it's good start point to use the real-world dataset as an example.


View entire conversation on ReviewNB

Copy link
Contributor Author

In addition, it does not require many resources because COCO val dataset is <1G.


View entire conversation on ReviewNB

Copy link
Contributor

If so, we need to download other datasets for other notebooks. My suggestion is making an option to download public datasets or prepare another separated notebook for downloading public datasets. Referring the notebook could be enough.

On the other hand, Datumaro provides the downloading command through CLI.


View entire conversation on ReviewNB

Copy link
Contributor Author

I guess download from CLI command only supports BBOX for now.

https://github.com/openvinotoolkit/datumaro/blob/a8f3cc947594d7fe2f16a7f61a07a67150cfb78f/datumaro/components/extractor_tfds.py#L287-L302

Can we leave this to be a future work? (Current) download from source -> (Future) Download from Datumaro CLI


View entire conversation on ReviewNB

Copy link
Contributor

Yes, sure. Let's take a look at CLI issues with another thread.


View entire conversation on ReviewNB

Copy link
Contributor

@wonjuleee wonjuleee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will merge this, but please add downloading public data & make notebooks be lightweight PRs later.

@wonjuleee wonjuleee merged commit 74842de into openvinotoolkit:develop Nov 4, 2022
@vinnamkim
Copy link
Contributor Author

vinnamkim commented Nov 4, 2022

I will merge this, but please add downloading public data & make notebooks be lightweight PRs later.

I created a backlog ticket no. 95780 for it.

wonjuleee added a commit to wonjuleee/datumaro that referenced this pull request Nov 28, 2022
…kit#747)

* Add _draw_mask

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Add SR and Depth visualization

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Update changelog.md

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Fixing _draw_mask numpy slicing bug and revise test to wrap the original
function

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Add Jupyter notebook example

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Add parameter descriptions to _draw()

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Add more explanation to notebook intro

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

* Remove draw_only_image flag

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Co-authored-by: Wonju Lee <wonju.lee@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ENHANCE Enhancement of existing features
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants