[Repository] Support multi-stream downloads within Repository

[kotwanikunal]

Is your feature request related to a problem? Please describe.

• Coming in from [Feature Proposal] Enhancement of Repository Plugin #6354 and [Design Proposal] Enhancement of Repository Plugin #6632
• Multi stream support for the Repository interface was proposed as a part of [Feature Proposal] Enhancement of Repository Plugin #6354 and a design for multi-stream uploads was introduced as a part of [Design Proposal] Enhancement of Repository Plugin #6632
• As next steps of the interface improvement, we need to add support for multi-stream downloads as a part of the repository interface

Describe the solution you'd like

• Enhance the Repository interface to support multiple streams for downloads
• This task focuses on defining the next steps and laying out the plan for adding this support

Possible tasks

• [POC] Support multi-stream downloads within Repository #8729
• Design for the enhanced Repository interface with multi-stream downloads
• Implement the interface with required InputStream changes
• Add support for all/any Repository implementations within core plugins (Azure/GCP/S3)
• [Repository] Add support for readBlobAsync API within AsyncMultiStreamEncryptedBlobContainer #10105
• Ensure FilePartWriter can't leave partially written files #9784
• [Repository] Define and tune for appropriate ThreadPool/Executor usage for multi stream downloads #10106
• [Repository] Add core and plugin integration tests for multi stream download APIs #10107
• [Repository] Perform benchmarking for multistream downloads #10108
• [Repository] Honor throttling limits on recovery for multistream downloads #10282
• [Repository] Report proper statistics for multistream downloads #10283

[anasalkouz]

@kotwanikunal Do we need a documentation issue for this feature? anything setting/config that need to be documented?

[kotwanikunal]

@kotwanikunal Do we need a documentation issue for this feature? anything setting/config that need to be documented?

As per the current design, we do not expose anything to the users. I will add in a documentation task if something changes.