Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why use positional embedding as conditional vector? #43

Open
eric-tc opened this issue Apr 24, 2023 · 2 comments
Open

Why use positional embedding as conditional vector? #43

eric-tc opened this issue Apr 24, 2023 · 2 comments

Comments

@eric-tc
Copy link

eric-tc commented Apr 24, 2023

Hi,
I have read your paper and i do not fully understand why are you using positional embedding as conditional for coupling flow layer. What is the benefit of doing this?

Is related to positional invariance?

Thanks

@gudovskiy
Copy link
Owner

@eric-tc because positional information allows to incorporate spatial prior to the model. For example, the model with such prior can learn how anomaly features should be arranged on the image.

@mjack3
Copy link

mjack3 commented Oct 13, 2023

My experiments suggest that the model may have performed better without it (green using positional encoding)

Screenshot from 2023-10-13 21-04-06

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants