Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I have read the enas paper,which says that weight sharing is used for efficiency. Any one can tell me which part of the code realize the weight sharing?Thanks a lot! #99

Open
berisfu opened this issue May 11, 2019 · 4 comments

Comments

@berisfu
Copy link

berisfu commented May 11, 2019

I have read the enas paper,which says that weight sharing is used for efficiency. Any one can tell me which part of the code realize the weight sharing?

@AlanChou
Copy link

Hi, ENAS builds a DAG to achieve weight sharing. The DAG is created in this file. https://github.com/melodyguan/enas/blob/master/src/cifar10/general_child.py

@berisfu
Copy link
Author

berisfu commented May 11, 2019

Hi, ENAS builds a DAG to achieve weight sharing. The DAG is created in this file. https://github.com/melodyguan/enas/blob/master/src/cifar10/general_child.py

I also have view the ENAS Keras implementation whose url is as here https://github.com/shibuiwilliam/ENAS-Keras/blob/master/ENAS.py.
they use CNC.set_weight_to_layer(save_to_disk=self.save_to_disk) to save the weight file, use CNC.fetch_layer_weight(save_to_disk=self.save_to_disk) to load the weight.
Via this method,they realize the weight sharing,finally get best efficiency NAS. I am pretty new to tensorflow,I have read the official code,but can not find out which part of the code realizes the weight saving and weight loading.

@berisfu
Copy link
Author

berisfu commented May 11, 2019

anybody can help me?Thanks a lot!

@matthewygf
Copy link

@berisfu its where the reuse=reuse comes in.
within the variablescope under ("child")
all train, val, test graph use the same parameters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants