[BUG] OpenSearch Sink failures are masked by max retry in the logs

[cmanning09]

Describe the bug
Writing to the OpenSearch sink may encounter failures. These were originally provided after the final failure occurred. The recent change to the failure handling overwrites the error message masking it from the operator. This makes it difficult to debug failure scenarios:

WARN  org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Document [******] has failure.
java.lang.RuntimeException: Number of retries reached the limit of max retries(configured value 10)

Expected behavior
Log the original failure associated with

Additional context

• Overwriting the original failure
• PR associated with the change

[kkondaka]

I will look into this. Please assign this to me.

[dlvenable]

Thanks, @kkondaka !

Along with this change, it may be useful to log periodically. Right now, if the sink continues to fail before reaching max_retries there is no indication in the logging. You can find this in the metrics however.

Perhaps every 5-10 failures log a message about failing to write.