Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Object Placement using Homography #320

Open
sarthakg2002 opened this issue May 21, 2024 · 2 comments
Open

Object Placement using Homography #320

sarthakg2002 opened this issue May 21, 2024 · 2 comments
Labels
help wanted Extra attention is needed

Comments

@sarthakg2002
Copy link

I am working on adding object placement in video which is anchored to scene so if the camera performs any PTZ the position of the object is maintained.

I was wondering if it is possible to tweak the norfair camera_motion module to achieve the above. I'm aware that norfair only does Pan and tilt detection so i'll be working on implementing zoom part separately.
Also wanted general guidance on how i can use the library for my purpose.

@sarthakg2002 sarthakg2002 added the help wanted Extra attention is needed label May 21, 2024
@aguscas
Copy link
Collaborator

aguscas commented May 21, 2024

Norfair also allows for zooms since homographies also contemplate zooms. You can use the HomographyTransformationGetter class for the transformation getter of our MotionEstimator for that purpose. There is an example in our camera_motion demo which might be helpful.

@sarthakg2002
Copy link
Author

sarthakg2002 commented May 23, 2024

Is it possible to use the norfair model on top of some other models than the recommended ones. Specifically i want to use the Segment-anything (SAM) model to get a mask of a surface (not a object) which can also give the bounding box for the same and use the Homography method to place an object there and then track it throughout the video. Will the yolo_dectections_to_norfair_dections be somewhat similar?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants