Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about the difference between notebook version and script version #6

Open
Jasonxu1225 opened this issue Mar 1, 2023 · 6 comments

Comments

@Jasonxu1225
Copy link

Jasonxu1225 commented Mar 1, 2023

Hello, I'm sorry to disturb you.
I want to ask about the difference of "get_action" between notebook version and script version. Specifically, the "get_action" in notebook version is self.forward(inputs, self.K), but in script version (namely in calss IQN in modul.py), it is self.forward(inputs, self.N). And I can not find any use of self.K in agent.py.
From my perspective, I think maybe the version in the notebook version is true. Namely we should use K to get action. So I think the script version is wrong because it use N to get_action instead of K. (Although the paper says that IQN Is not sensitive to the value of K)

@BY571
Copy link
Owner

BY571 commented Mar 1, 2023 via email

@Jasonxu1225
Copy link
Author

Thank you for your reply!
I think maybe it is better to use K to get_action in the script version, which is corresponding to the paper.

@BY571
Copy link
Owner

BY571 commented Mar 1, 2023 via email

@Jasonxu1225
Copy link
Author

Thank you for your reply!
I have try to do a pr to fix the error of get_action in script version.
Many thanks again!

@Jasonxu1225
Copy link
Author

Sorry, after detailed observation. I find that there is no reflection of
image
in your code.
So maybe the questions about K and N above do not work. Because there is nothing about K in your code.

@Jasonxu1225 Jasonxu1225 reopened this Mar 1, 2023
@Jasonxu1225
Copy link
Author

After specific considerations, I think maybe the notebook version is correct, namely using K to get_action as a sample. And I have try to do a pr to fix the error of get_action in script version, many thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants