Skip to content

Releases: hemachandsai/s3-bulk-delete

Minor Changes

17 Nov 13:02
Compare
Choose a tag to compare

Banner Addition & minor code enhancements

s3-bulk-delete v2 release

28 Dec 12:50
Compare
Choose a tag to compare

This release contains s3-bulk-delete utility which clear aws s3 bucket at much higher rate than aws-cli recursive delete functionality.

Note:-

  1. Once, aws max limit is hit(approx after deletion of 2,50,000 keys) the subsequent calls slows down to match available ops per second.
  2. The max rate of this utility is currently set to the default s3 value of 3.5k objects per second, max 21 active requests at any instinct. This value can be tweaked with maxConcurrentHTTPCalls and maxQueuedHTTPCalls variable.

s3-bulk-delete v1 release

28 Dec 10:45
Compare
Choose a tag to compare

This release contains the basic version of s3-bulk-delete utility which clear aws s3 bucket at much higher rate than aws-cli recursive delete functionality.

Note:-

  1. Continuous code handling when aws max limit is hit(approx after deletion of 2,50,000 keys), is not yet handled and will be taken care off once aws go-sdk community team responds back.
  2. The max rate of this utility is currently set to the default s3 value of 3.5k objects per second and is dependent on number of s3 prefixes. This value can be tweaked with maxConcurrentHTTPCalls variable.