Add option for refreshing expired AWS token

[andrejvanderzee]

We are running in Kubernetes context with ephemeral AWS credentials which are refreshed every X hours. This PR adds an option that re-reads credentials from AWS shared credential file and retries the request.

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

Merging #57 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #57   +/-   ##
=======================================
  Coverage   72.37%   72.37%           
=======================================
  Files          12       12           
  Lines         992      992           
=======================================
  Hits          718      718           
  Misses        212      212           
  Partials       62       62           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 97429fa...5143caf. Read the comment docs.

[eytan-avisror]

Thanks for the contribution @andrejvanderzee 👍
Changes look good outside of the removal of caching.
We need to get caching to work with your changes since it's very critical for scalability.

[andrejvanderzee]

@eytan-avisror Yes you are right I guess I overlooked. Fixed the caching statements. Can you please have another look?

[eytan-avisror]

Thanks @andrejvanderzee it looks good.
Did you get a chance to test this by running it and make sure it's functional?
This project doesn't have an automated functional test yet unfortunately.

[andrejvanderzee]

Yes I had it running and looks good. Here the debug output of a recovering connection from an expired token 403 response:

time="2020-06-30T13:24:35Z" level=debug msg="active goroutines: 7"
time="2020-06-30T13:24:35Z" level=debug msg="retryable: ExpiredToken: The security token included in the request is expired\n\tstatus code: 403, request id: 606a5f3a-9efb-5126-8345-084fa1a848aa -- sqs/ReceiveMessage, will retry after 1.533618922s"
time="2020-06-30T13:24:40Z" level=debug msg="no messages received in interval"
time="2020-06-30T13:24:40Z" level=debug msg="polling for messages from queue"
time="2020-06-30T13:24:40Z" level=debug msg="active goroutines: 7"
time="2020-06-30T13:24:43Z" level=debug msg="no messages received in interval"

[eytan-avisror]

🥇

[andrejvanderzee]

@eytan-avisror Thanks for your prompt replies and merging my PR!

[andrejvanderzee]

BTW, would it be possible to tag 0.4.1?

[eytan-avisror]

@andrejvanderzee NP, thanks again for contributing.
Will release 0.4.1 today, we have other fixes as well that will go in.