New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Target quantiles uses online network #2

Open

inspirit opened this issue Oct 10, 2022 · 1 comment

inspirit commented Oct 10, 2022

Hi!
I was wondering if this is intentional to use online network for target quantiles?

FQF-and-Extensions/agent.py

Line 205 in 9c25cb3

    
           m_quantiles_targets = self.qnetwork_local.get_quantiles(states, taus_, embedding).detach()

emrul commented Feb 12, 2023

I am wondering this too, and also why the save method doesn't save the FPN state - surely it's necessary to reload a trained agent?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment