Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FedMeta #2241

Closed
7 tasks done
jafermarq opened this issue Aug 22, 2023 · 5 comments
Closed
7 tasks done

FedMeta #2241

jafermarq opened this issue Aug 22, 2023 · 5 comments
Assignees
Labels
summer-of-reproducibility About a baseline for Summer of Reproducibility

Comments

@jafermarq
Copy link
Contributor

jafermarq commented Aug 22, 2023

FedMeta

Do you want to work on this baseline?

🌻 Check everything about the Summer of Reproducibility on flower.dev/summer

All available baselines are listed in the Summer of Reproducibility Dashboard and also in the GitHub Issues with the summer-of-reproducibility label. The content is the same.

📝 It is advised to complete these steps before your start working on your code. But if you can't wait to implement your baseline with Flower (we totally understand it 😄), please ensure you follow the steps on how to contribute a new baseline.

What follows are the steps 1 & 2 in the Summer of Reproducibility instructions.

1. Join the Summer of Reproducibility program

  • Join the Flower Slack and say "hi! 👋" in the channel #summer-of-reproducibility.
  • Pick a baseline from our curated list <---------------------------------------- [you are doing this now]

2. Define the scope of your contribution

  • What are you going to reproduce? Add a comment to your issue and tell us about your plan regarding this baseline: what experiments from the paper are you reproducing?, for which datasets ? the more details you provide us with the better !

  • Check if you are eligible for a reward.

    As we have to comply with US/EU regulations, we have checked that individual contributors based on these countries or territories are eligible: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Gibraltar, Greece, Hong Kong SAR China, Hungary, India, Ireland, Italy, Japan, Latvia, Liechtenstein, Lithuania, Luxembourg, Malta, Mexico, Netherlands, New Zealand, Norway, Poland, Portugal, Romania, Singapore, Slovakia, Slovenia, South Korea, Spain, Sweden, Switzerland, Thailand, United Arab emirates, United Kingdom United States.

    If where you are based is not on the list, please send us an email (summer@flower.dev) letting us know a bit about yourself (where are you currently based?, are you a university student? do you work at a public institution?). Please tell us the baselines you are interested in implementing (i.e. tell us your GitHub issue if you have crated one). We will reach back to you.

  • We will discuss with you about your contribution plan, if it sounds like a substantial enough contribution according to the Summer of Reproducibility rules (check our website flower.dev/summer), you'll get the OK from us to start working on your baseline!

What happens next?

Is something wrong or not clear ?

  • Ask a question directly in your issue.
  • Reach out to us via the Flower Slack and ask your question in the #summer-of-reproducibility channel
  • Check all the details (including FAQ) in the Summer of Reproducibility website: flower.dev/summer
@jafermarq jafermarq added the summer-of-reproducibility About a baseline for Summer of Reproducibility label Aug 22, 2023
@JinsooKim-KR
Copy link
Contributor

Hi, @jafermarq , I'm glad to attend the Summer of Reproducibility. Thank you for the chance.

I plan to implement the "FedMeta" algorithm as described in Algorithm 1 of the above paper at the Flower and I will make the baseline support the results presented in Table 2 & Figure 2 of the above paper.

In detail, I will implement FedAvg, FedAvg(Meta), FedMeta(MAML), FedMeta(Meta-SGD) and then compare them. I will use two datasets: Femnist(for image) and Shakespeare(for NLP) from the Leaf dataset.

@jafermarq
Copy link
Contributor Author

Hi @jinsoogod, It's great to have your onboard the Flower Summer of Reproducibility. This contribution plan sounds perfect. You'll find the instructions on how to start with your contribution by following the link on the What happens next? section above. Please use Flower simulation if possible.

I have now ✅ all points in Step 1 & 2 above and added you as the assignee to this issue. As a kind reminder, the Summer of Reproducibility ends at the end of September so my advice for you is to start soon. Feel free to reach out to me via Slack (or to any of the other contributors) if you have some questions or feedback.

Looking forward to seeing your FedMeta implementation in action!!

@jafermarq
Copy link
Contributor Author

Hi @jinsoogod !

This is just a gentle reminder that the Flower Summer of Reproducibility is ending at the end of the month. With just a little more than 3 weeks to go, we are excited to see quite a few baselines well ahead in the process with their respective PRs close to ready. If your PR is already on the list, great !! Please make sure the PR is linked to this issue (you just need to copy the URL of this issue somewhere in the main message of your PR). Ping me when you'd like me to take a look.

Also, make sure you keep an eye:eyes: on the #summer-of-reproducibility channel in the Flower Slack. I’ll announce very soon a new (the third!) round of 1:1 ask-me-anything sessions to help Summer of Reproducibility contributors like yourself to meet the deadline. Please consider booking a time slot if you want to chat with me about your baseline, potential issues you have making your code run, how to open a PR, doubts about what to include in your readme, how to use Hydra configs more effective, etc … all questions are welcome!!

@JinsooKim-KR JinsooKim-KR mentioned this issue Oct 1, 2023
6 tasks
@jafermarq
Copy link
Contributor Author

Congratulations @jinsoogod ! your baseline has been merged. We'll follow up with you soon to complete your Summer of Reproducibility journey 😄 !

@JinsooKim-KR
Copy link
Contributor

I’m really happy to participate in the Flower Project. Thank you 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
summer-of-reproducibility About a baseline for Summer of Reproducibility
Projects
Development

No branches or pull requests

2 participants