IO operations optimization

[caviri]

Context
The operations related to compression and uncompression after every step of the execution takes a considerable amount of time. This is done mainly for two reasons a) in order to upload a single object into Minio and b) reduce the amount of bytes transferred.

This is inconvenient, specially when developing and testing execution with components running on ephemeral mode.

Proposed solutions

• In production: Enhance the compression performance.
• In dev: Allow overpassing of Minio. Assuming a pipeline of A -> B uploading and copy output's files of A directly into input's folder of B.

Related repositories

• odtp-components-client.

Acceptance criteria

• Implement copy of files from output input for debugging.
• Increase the performance of compression/uncompression tasks.