[Meta] Remote Store: 2.10.0 - Release Tracking

[sachinpkale]

This meta issue will track remote store feature related tasks that are aimed for OpenSearch 2.10.0 release.
This list is WIP and will be modified as we identify more tasks.

Features

• [META] Remote Cluster State Issues #9344
• RFC : Repository Registration for Remote Backed Storage #8623
• [RFC] [Remote Store] /_remotestore/stats API and _nodes/stats API enhancements for observability on Remote Translog Store upload operations #8311

Enhancements

• [Remote Store] RFC - Adding segment download metrics to remotestore stats API #8395
• [Remote Store] Add remote segment transfer stats on NodesStats API #9168
• [Remote Store] Add cumulative bytes lag to NodesStats #9393
• [Remote Store] Add total upload and download time from remote store to nodes stats #9454
• [Remote Store] Refactor Translog metadata upload/download to write/read header and footer via VersionedCodecStreamWrapper #7228
• [Remote Store] Add integration tests for restore flow #8483
• [Remote Store] Persist StoreFileMetadata fields in Remote Store #7722
• [RFC] [Remote Store] /_remotestore/stats API and _nodes/stats API enhancements for observability on Remote Translog Store upload operations #8311
• [Remote Store] Restrict index level remote store settings #8770
• [BUG] Index creation fails when index.replication.type is not mentioned while cluster setting cluster.remote_store.enabled is true #9249
• [Remote Store] Create separate refresh listener to publish data about local segments being refreshed in remote segment tracker #8717
• Introduce cluster level dynamic default and minimum refresh interval setting  #9266
• Add cluster default remote store translog buffer interval setting #9574
• [BUG] Multiple UTs in org.opensearch.repositories.blobstore.BlobStoreRepositoryTests are flaky #8834
• Rate Limiter integration for remote transfer #9448
• [Remote Store] Delete stale commits in async flow #4315
• [Remote Store] Add support to restore only unassigned shards of an index #8792

Bug Fixes

• [BUG] [Remote Store] Shard routing table has wrong number of replicas while restoring an index with >= 1 replicas from remote store #8479
• [BUG] org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithInvokeFlush and org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithoutInvokeFlush are flaky #8658
• [BUG] [Remote Store] RemoteStoreRefreshListenerTests.testAfterCommit flaky test failure #8947
• [BUG] Remote store restore using API fails when the index was created, docs indexed (optional) and node was stopped before the first refresh could happen #7923
• [BUG] org.opensearch.remotestore.RemoteStoreIT.testRemoteTranslogRestoreWithNoDataPostRefresh is flaky #9185
• [BUG] Index creation fails when index.replication.type is not mentioned while cluster setting cluster.remote_store.enabled is true #9249
• [BUG] org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessAfterFailureInFirstAttemptAfterSnapshotAndMetadataUpload is flaky #8131
• [BUG] org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing flaky failure #9191
• [BUG] org.opensearch.index.translog.RemoteFSTranslogTests.testConcurrentWriteViewsAndSnapshot is flaky #9455
• [BUG] org.opensearch.remotestore.RemoteStoreRestoreIT.testRTSRestoreWithRefreshedDataPrimaryReplicaDown is flaky #9408
• [BUG] org.opensearch.remotestore.ReplicaToPrimaryPromotionIT.testPromoteReplicaToPrimary is flaky #7791