feat: adagrad optimizer support

[Benjamin-eecs]

Description

Adagrad optimizer support.

Roadmap

• low-level alias
• high-level Optimizer
• high-level MetaOptimizer
• low-level test
• high-level Optimizer test
• api docs
• CHANGELOG

[codecov-commenter]

Codecov Report

Patch coverage: 96.09% and project coverage change: +0.32 🎉

Comparison is base (6223010) 93.05% compared to head (c188839) 93.37%.

❗ Current head c188839 differs from pull request most recent head fbb68f8. Consider uploading reports for the commit fbb68f8 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #80      +/-   ##
==========================================
+ Coverage   93.05%   93.37%   +0.32%     
==========================================
  Files          66       71       +5     
  Lines        2574     2684     +110     
==========================================
+ Hits         2395     2506     +111     
+ Misses        179      178       -1     

Flag	Coverage Δ
unittests	93.37% <96.09%> (+0.32%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
torchopt/alias/adam.py	100.00% <ø> (ø)
torchopt/alias/adamw.py	100.00% <ø> (ø)
torchopt/alias/sgd.py	100.00% <ø> (ø)
torchopt/optim/adam.py	100.00% <ø> (ø)
torchopt/optim/adamw.py	100.00% <ø> (ø)
torchopt/optim/func/base.py	88.46% <ø> (ø)
torchopt/optim/meta/adamw.py	90.91% <ø> (ø)
torchopt/schedule/polynomial.py	100.00% <ø> (+19.05%)	⬆️
torchopt/transform/scale_by_adam.py	100.00% <ø> (ø)
torchopt/transform/scale_by_rms.py	100.00% <ø> (ø)
... and 13 more

... and 1 file with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

I have completed the requested change