Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance in Subspace #3

Open
zerocostpt opened this issue May 31, 2021 · 1 comment
Open

Performance in Subspace #3

zerocostpt opened this issue May 31, 2021 · 1 comment

Comments

@zerocostpt
Copy link

Hi, thanks for the good work, and for the performance in subspace. Are you run each experiment four times with 4 random seeds and select the best to report? Just as what previous work did? This part not be illustrated on paper, just wanna check if it's right.

@ruocwang
Copy link
Owner

ruocwang commented Jun 1, 2021

Hello. That is correct; for S1-S4 subspaces we report the best result following the original RobustDARTS, to encourage fair comparison with its baselines. (For the reference of other fellows that might check this thread later: on the original DARTS Space, we report both average and best results of running the whole search algorithms under different seeds, to establish direct comparisons with all previous methods regardless of their adopted reporting schema.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants