We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
It seems like when computing the doubly stochastic attention, the code is doing:
alpha_reg = alpha_c * ((1.-alphas.sum(0))**2).sum(0).mean()
As per my understanding alphas is of dimensions [sequence_length, batch_size, feature_map_spatial_extent] which for vgg conv5 would be 14 x 14 = 196.
This means that we are averaging along the 196 spatial locations as opposed to averaging along with minibatch. Is this the expected behavior?
Any clarification on this would be great!
The text was updated successfully, but these errors were encountered:
No branches or pull requests
It seems like when computing the doubly stochastic attention, the code is doing:
alpha_reg = alpha_c * ((1.-alphas.sum(0))**2).sum(0).mean()As per my understanding alphas is of dimensions [sequence_length, batch_size, feature_map_spatial_extent] which for vgg conv5 would be 14 x 14 = 196.
This means that we are averaging along the 196 spatial locations as opposed to averaging along with minibatch. Is this the expected behavior?
Any clarification on this would be great!
The text was updated successfully, but these errors were encountered: