Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HDFS-17573. Allow turn on both FSImage parallelization and compression #6929

Merged
merged 18 commits into from
Aug 25, 2024
Merged

HDFS-17573. Allow turn on both FSImage parallelization and compression #6929

merged 18 commits into from
Aug 25, 2024

Conversation

Last-remote11
Copy link
Contributor

@Last-remote11 Last-remote11 commented Jul 8, 2024 •
edited

Description of PR

The feature added HDFS-14617(in Improve FSImage load time by writing sub-sections to the FSImage index. by Stephen O'Donnell) makes loading FSImage very faster.

But this option cannot be activated when turn on dfs.image.compress=true.

In my opinion, larger clusters require both settings at the same time.

In my environment, the cluster I'm using has approximately 6 million file system objects and FSImage is approximately 11GB with dfs.image.compress=true setting. If turn off the dfs.image.compress option, it is expected to exceed 30GB, in which case it will take a long time to move FSImage from standby to active namenode using high network resource.

It was proved in this jira(HDFS-16147 by kinit) that loading FSImage parallel and FSImage compression can be turned on at the same time.  (And worked well on my environment also.)

I created this new Jira and PR because the discussion in HDFS-16147 ended in 2021, and I want it to be officially added in the next release, instead of patch available.

The actual code of the patch was written by kinit and I resolved empty sub-section problem(see below comment of HDFS-16147) and added test code.

If this is not a proper method, please let me know another way to contribute.

Thanks.

How was this patch tested?

added testParallelSaveAndLoadWithCompression and ran unit test.

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 45s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 49m 37s trunk passed
+1 💚 compile 1m 26s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 14s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 14s trunk passed
+1 💚 mvnsite 1m 26s trunk passed
+1 💚 javadoc 1m 10s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s trunk passed
+1 💚 shadedclient 41m 54s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 4s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 68 unchanged - 0 fixed = 69 total (was 68)
+1 💚 mvnsite 1m 13s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 37s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 21s the patch passed
+1 💚 shadedclient 41m 0s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 256m 55s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 45s The patch does not generate ASF License warnings.
412m 33s
Reason Tests
Failed junit tests hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.blockmanagement.TestDatanodeManager
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/1/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 4ab5125a9a51 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7b9332e
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/1/testReport/
Max. process+thread count 2963 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Last-remote11 Last-remote11 reopened this Jul 9, 2024
@Last-remote11 Last-remote11 marked this pull request as draft July 9, 2024 04:32
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 47s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 34s trunk passed
+1 💚 compile 1m 25s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 16s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 15s trunk passed
+1 💚 mvnsite 1m 25s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 45s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 23s trunk passed
+1 💚 shadedclient 41m 22s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 10s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 4s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 68 unchanged - 0 fixed = 70 total (was 68)
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 38s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
-1 ❌ spotbugs 3m 24s /new-spotbugs-hadoop-hdfs-project_hadoop-hdfs.html hadoop-hdfs-project/hadoop-hdfs generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-1 ❌ shadedclient 40m 54s patch has errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 76m 28s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 47s The patch does not generate ASF License warnings.
232m 21s
Reason Tests
SpotBugs module:hadoop-hdfs-project/hadoop-hdfs
org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Saver.commitSection(FsImageProto$FileSummary$Builder, FSImageFormatProtobuf$SectionName) uses the same code for two branches At FSImageFormatProtobuf.java:code for two branches At FSImageFormatProtobuf.java:[line 674]
Null pointer dereference of FSImageFormatProtobuf$Saver.codec in org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Saver.commitSection(FsImageProto$FileSummary$Builder, FSImageFormatProtobuf$SectionName) Dereferenced at FSImageFormatProtobuf.java:in org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Saver.commitSection(FsImageProto$FileSummary$Builder, FSImageFormatProtobuf$SectionName) Dereferenced at FSImageFormatProtobuf.java:[line 676]
Failed junit tests hadoop.hdfs.TestDataStream
hadoop.hdfs.server.datanode.TestTransferRbw
hadoop.fs.permission.TestStickyBit
hadoop.hdfs.TestReadStripedFileWithDNFailure
hadoop.hdfs.server.namenode.TestDeleteRace
hadoop.hdfs.server.namenode.TestStripedINodeFile
hadoop.cli.TestCacheAdminCLI
hadoop.hdfs.TestClientProtocolForPipelineRecovery
hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer
hadoop.hdfs.web.TestFSMainOperationsWebHdfs
hadoop.hdfs.TestDFSFinalize
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.TestDFSClientRetries
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.hdfs.TestLeaseRecovery2
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyRatioConsiderLoadWithStorage
hadoop.hdfs.TestDFSRollback
hadoop.hdfs.TestMultipleNNPortQOP
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl
hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation
hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
hadoop.hdfs.server.namenode.TestFSDirectory
hadoop.fs.viewfs.TestViewFsWithAcls
hadoop.hdfs.TestTrashWithEncryptionZones
hadoop.hdfs.server.namenode.TestFSImageWithXAttr
hadoop.hdfs.server.namenode.TestQuotaByStorageType
hadoop.fs.viewfs.TestViewFSOverloadSchemeWithMountTableConfigInHDFS
hadoop.fs.TestUnbuffer
hadoop.fs.TestFcHdfsSetUMask
hadoop.hdfs.TestReservedRawPaths
hadoop.hdfs.server.namenode.TestSnapshotPathINodes
hadoop.hdfs.server.balancer.TestBalancer
hadoop.hdfs.TestReadStripedFileWithDecoding
hadoop.fs.contract.hdfs.TestHDFSContractBulkDelete
hadoop.hdfs.TestDFSStripedOutputStream
hadoop.fs.contract.hdfs.TestHDFSContractAppend
hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor
hadoop.hdfs.TestPipelines
hadoop.hdfs.TestAppendSnapshotTruncate
hadoop.hdfs.server.namenode.TestMetadataVersionOutput
hadoop.hdfs.tools.TestGetGroups
hadoop.hdfs.TestDFSMkdirs
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory
hadoop.hdfs.server.namenode.snapshot.TestListSnapshot
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
hadoop.hdfs.TestConnCache
hadoop.hdfs.server.namenode.TestSecurityTokenEditLog
hadoop.hdfs.client.impl.TestBlockReaderRemote
hadoop.hdfs.server.datanode.TestDataNodeTcpNoDelay
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForAcl
hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
hadoop.hdfs.server.namenode.TestNNThroughputBenchmark
hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer
hadoop.hdfs.shortcircuit.TestShortCircuitCache
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.blockmanagement.TestPendingReconstruction
hadoop.hdfs.server.namenode.TestEditLogAutoroll
hadoop.hdfs.client.impl.TestBlockReaderLocal
hadoop.hdfs.server.datanode.TestDataNodeTransferSocketSize
hadoop.hdfs.TestFileCreation
hadoop.fs.viewfs.TestViewFsHdfs
hadoop.fs.viewfs.TestNNStartupWhenViewFSOverloadSchemeEnabled
hadoop.fs.contract.hdfs.TestHDFSContractRename
hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand
hadoop.hdfs.TestDFSStripedOutputStreamUpdatePipeline
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.namenode.TestReencryption
hadoop.hdfs.TestLocatedBlocksRefresher
hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks
hadoop.hdfs.TestFsShellPermission
hadoop.hdfs.server.namenode.TestBlockUnderConstruction
hadoop.fs.viewfs.TestViewFileSystemLinkFallback
hadoop.hdfs.TestDFSClientFailover
hadoop.hdfs.server.namenode.TestAddStripedBlocks
hadoop.hdfs.server.datanode.TestDirectoryScanner
hadoop.hdfs.server.datanode.TestBlockRecovery2
hadoop.hdfs.server.blockmanagement.TestRBWBlockInvalidation
hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots
hadoop.hdfs.server.namenode.TestListCorruptFileBlocks
hadoop.hdfs.TestDFSRename
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.TestFileStatus
hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure
hadoop.cli.TestAclCLI
hadoop.hdfs.TestSlowDatanodeReport
hadoop.hdfs.TestSmallBlock
hadoop.hdfs.web.TestWebHdfsFileSystemContract
hadoop.hdfs.TestRead
hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup
hadoop.hdfs.TestErasureCodingMultipleRacks
hadoop.fs.TestGlobPaths
hadoop.hdfs.server.namenode.TestAuditLogger
hadoop.tools.TestJMXGet
hadoop.hdfs.server.namenode.TestValidateConfigurationSettings
hadoop.hdfs.server.namenode.TestRefreshBlockPlacementPolicy
hadoop.hdfs.TestAbandonBlock
hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
hadoop.hdfs.TestSeekBug
hadoop.hdfs.server.namenode.TestNetworkTopologyServlet
hadoop.hdfs.TestByteBufferPread
hadoop.hdfs.server.namenode.TestAuditLogs
hadoop.hdfs.server.namenode.snapshot.TestDisallowModifyROSnapshot
hadoop.hdfs.TestRollingUpgradeRollback
hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBPPBalanceLocal
hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
hadoop.fs.TestWebHdfsFileContextMainOperations
hadoop.fs.TestResolveHdfsSymlink
hadoop.hdfs.server.namenode.ha.TestFailoverWithBlockTokensEnabled
hadoop.hdfs.TestHAAuxiliaryPort
hadoop.hdfs.web.TestWebHDFSForHA
hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithQJM
hadoop.hdfs.TestReadStripedFileWithMissingBlocks
hadoop.hdfs.server.namenode.TestNameNodeRpcServer
hadoop.hdfs.server.datanode.TestBlockCountersInPendingIBR
hadoop.hdfs.TestDatanodeDeath
hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForStoragePolicy
hadoop.hdfs.server.namenode.TestHostsFiles
hadoop.hdfs.server.datanode.TestDataNodeECN
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame
hadoop.hdfs.server.namenode.TestCreateEditsLog
hadoop.hdfs.TestReconstructStripedFileWithValidator
hadoop.hdfs.server.datanode.TestDataNodeLifeline
hadoop.hdfs.TestDecommissionWithBackoffMonitor
hadoop.hdfs.server.namenode.ha.TestUpdateBlockTailing
hadoop.hdfs.server.datanode.fsdataset.impl.TestReplicaCachingGetSpaceUsed
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.TestDFSInotifyEventInputStreamKerberized
hadoop.hdfs.web.TestWebHDFSAcl
hadoop.hdfs.web.TestWebHDFS
hadoop.hdfs.TestFileAppend3
hadoop.hdfs.server.mover.TestMover
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement
hadoop.hdfs.TestGetBlocks
hadoop.hdfs.server.datanode.TestDataNodeUUID
hadoop.hdfs.TestSetrepDecreasing
hadoop.hdfs.server.datanode.fsdataset.impl.TestInterDatanodeProtocol
hadoop.hdfs.server.namenode.web.resources.TestWebHdfsCreatePermissions
hadoop.fs.viewfs.TestViewFileSystemWithTruncate
hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.server.namenode.snapshot.TestFsShellMoveToTrashWithSnapshots
hadoop.hdfs.server.blockmanagement.TestErasureCodingCorruption
hadoop.hdfs.TestCrcCorruption
hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA
hadoop.hdfs.server.blockmanagement.TestCorruptionWithFailover
hadoop.hdfs.tools.TestStoragePolicySatisfyAdminCommands
hadoop.hdfs.TestSafeMode
hadoop.hdfs.TestQuotaAllowOwner
hadoop.hdfs.TestModTime
hadoop.hdfs.server.namenode.TestAllowFormat
hadoop.hdfs.server.namenode.TestHAWithInProgressTail
hadoop.hdfs.TestHFlush
hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
hadoop.hdfs.server.datanode.TestIncrementalBrVariations
hadoop.hdfs.TestViewDistributedFileSystem
hadoop.hdfs.TestDatanodeLayoutUpgrade
hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletionGc
hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData
hadoop.fs.TestUrlStreamHandler
hadoop.hdfs.server.datanode.TestDataNodeFaultInjector
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.TestFileCreationDelete
hadoop.hdfs.TestListFilesInFileContext
hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks
hadoop.hdfs.client.impl.TestBlockReaderFactory
hadoop.hdfs.server.namenode.snapshot.TestFileContextSnapshot
hadoop.fs.loadGenerator.TestLoadGenerator
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.fs.contract.hdfs.TestHDFSContractDelete
hadoop.hdfs.tools.TestViewFSStoragePolicyCommands
hadoop.fs.viewfs.TestViewFileSystemHdfs
hadoop.hdfs.web.TestHttpsFileSystem
hadoop.hdfs.server.namenode.TestFSEditLogLoader
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy
hadoop.hdfs.TestLeaseRecoveryStriped
hadoop.hdfs.server.namenode.TestBlockPlacementPolicyRackFaultTolerant
hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.qjournal.TestNNWithQJM
hadoop.hdfs.server.namenode.TestNamenodeCapacityReport
hadoop.hdfs.server.namenode.ha.TestMultiObserverNode
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations
hadoop.hdfs.server.mover.TestStorageMover
hadoop.hdfs.server.namenode.snapshot.TestRenameWithOrderedSnapshotDeletion
hadoop.hdfs.TestParallelShortCircuitReadUnCached
hadoop.hdfs.TestDecommission
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.server.namenode.TestCorrectnessOfQuotaAfterRenameOp
hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage
hadoop.hdfs.TestMultiThreadedHflush
hadoop.hdfs.TestFileAppend4
hadoop.hdfs.TestHdfsAdmin
hadoop.fs.TestFcHdfsCreateMkdir
hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting
hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
hadoop.hdfs.server.namenode.TestGetContentSummaryWithPermission
hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.server.namenode.TestINodeFile
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.server.namenode.TestCommitBlockWithInvalidGenStamp
hadoop.hdfs.TestReplaceDatanodeFailureReplication
hadoop.hdfs.server.namenode.TestAclConfigFlag
hadoop.hdfs.TestErasureCodingPolicies
hadoop.cli.TestAclCLIWithPosixAclInheritance
hadoop.hdfs.server.namenode.TestFileContextXAttr
hadoop.hdfs.TestFetchImage
hadoop.hdfs.TestPersistBlocks
hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA
hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory
hadoop.hdfs.TestDatanodeReport
hadoop.hdfs.crypto.TestHdfsCryptoStreams
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.TestClientReportBadBlock
hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
hadoop.hdfs.TestQuota
hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
hadoop.hdfs.server.namenode.snapshot.TestSnapshotMetrics
hadoop.hdfs.TestExtendedAcls
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.server.datanode.TestDataTransferThrottler
hadoop.hdfs.server.namenode.ha.TestStandbyBlockManagement
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles
hadoop.hdfs.TestGetFileChecksum
hadoop.hdfs.TestDataTransferKeepalive
hadoop.hdfs.TestParallelShortCircuitRead
hadoop.hdfs.TestViewDistributedFileSystemWithMountLinks
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyExcludeSlowNodes
hadoop.hdfs.TestMiniDFSCluster
hadoop.hdfs.TestFileAppendRestart
hadoop.hdfs.server.namenode.TestNameNodeResourceChecker
hadoop.hdfs.TestDFSShellTouch
hadoop.fs.viewfs.TestViewFsWithXAttrs
hadoop.hdfs.server.namenode.TestINodeAttributeProvider
hadoop.hdfs.TestFSInputChecker
hadoop.hdfs.tools.TestViewFileSystemOverloadSchemeWithFSCommands
hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport
hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold
hadoop.security.TestPermission
hadoop.hdfs.server.datanode.fsdataset.impl.TestDatanodeRestart
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.server.datanode.TestDataNodeMetrics
hadoop.hdfs.server.datanode.TestHSync
hadoop.hdfs.server.namenode.ha.TestObserverNode
hadoop.hdfs.server.namenode.TestNamenodeStorageDirectives
hadoop.hdfs.server.namenode.snapshot.TestSnapshottableDirListing
hadoop.hdfs.server.namenode.ha.TestBootstrapStandby
hadoop.fs.contract.hdfs.TestHDFSContractSafeMode
hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy
hadoop.hdfs.TestDatanodeConfig
hadoop.cli.TestXAttrCLI
hadoop.hdfs.server.namenode.TestFileLimit
hadoop.hdfs.TestDFSUpgrade
hadoop.hdfs.server.namenode.ha.TestHAMetrics
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.TestWriteReadStripedFile
hadoop.hdfs.server.datanode.TestBlockScanner
hadoop.hdfs.server.namenode.TestRefreshNamenodeReplicationConfig
hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks
hadoop.hdfs.server.namenode.snapshot.TestSnapshotStatsMXBean
hadoop.hdfs.TestFSOutputSummer
hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA
hadoop.hdfs.server.namenode.TestSecondaryWebUi
hadoop.hdfs.tools.TestDFSAdmin
hadoop.hdfs.TestBalancerBandwidth
hadoop.hdfs.web.TestWebHdfsUrl
hadoop.fs.contract.hdfs.TestHDFSContractOpen
hadoop.fs.contract.hdfs.TestHDFSContractLeaseRecovery
hadoop.hdfs.server.namenode.TestHDFSConcat
hadoop.hdfs.server.blockmanagement.TestSlowDiskTracker
hadoop.hdfs.TestHDFSTrash
hadoop.security.TestRefreshUserMappings
hadoop.hdfs.TestDataTransferProtocol
hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy
hadoop.cli.TestCryptoAdminCLI
hadoop.security.TestPermissionSymlinks
hadoop.hdfs.TestSetTimes
hadoop.hdfs.TestRollingUpgradeDowngrade
hadoop.hdfs.server.datanode.TestStorageReport
hadoop.hdfs.TestBlockTokenWrappingQOP
hadoop.hdfs.server.namenode.sps.TestStoragePolicySatisfierWithStripedFile
hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
hadoop.hdfs.server.namenode.TestGenericJournalConf
hadoop.hdfs.tools.TestDFSAdminWithHA
hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithShortCircuitRead
hadoop.hdfs.TestBlocksScheduledCounter
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureToleration
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles
hadoop.hdfs.TestFileCreationEmpty
hadoop.hdfs.server.datanode.TestCorruptMetadataFile
hadoop.hdfs.server.datanode.TestLargeBlockReport
hadoop.hdfs.TestLease
hadoop.hdfs.server.namenode.ha.TestHAFsck
hadoop.hdfs.TestFileStatusWithDefaultECPolicy
hadoop.hdfs.TestDFSRemove
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain
hadoop.hdfs.TestFileConcurrentReader
hadoop.hdfs.TestDFSInputStream
hadoop.fs.viewfs.TestViewFsDefaultValue
hadoop.fs.TestSymlinkHdfsDisable
hadoop.hdfs.TestEncryptionZonesWithHA
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.TestWriteRead
hadoop.hdfs.tools.TestDFSHAAdminMiniCluster
hadoop.hdfs.server.namenode.TestNameNodeStatusMXBean
hadoop.hdfs.TestAclsEndToEnd
hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot
hadoop.hdfs.TestMaintenanceState
hadoop.hdfs.security.token.block.TestBlockToken
hadoop.hdfs.server.namenode.TestXAttrConfigFlag
hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy
hadoop.hdfs.server.namenode.TestParallelImageWrite
hadoop.fs.viewfs.TestViewFsAtHdfsRoot
hadoop.hdfs.server.datanode.TestDeleteBlockPool
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithNodeGroup
hadoop.hdfs.TestFileLengthOnClusterRestart
hadoop.hdfs.server.namenode.ha.TestBootstrapStandbyWithInProgressTailing
hadoop.hdfs.TestDFSShellGenericOptions
hadoop.hdfs.server.namenode.snapshot.TestSnapshotListing
hadoop.hdfs.server.namenode.TestEditLogRace
hadoop.hdfs.TestReplication
hadoop.hdfs.TestParallelShortCircuitLegacyRead
hadoop.metrics2.sink.TestRollingFileSystemSinkWithHdfs
hadoop.hdfs.TestSetrepIncreasing
hadoop.hdfs.tools.TestECAdmin
hadoop.fs.TestSWebHdfsFileContextMainOperations
hadoop.hdfs.server.namenode.TestLargeDirectoryDelete
hadoop.hdfs.server.blockmanagement.TestBlockManager
hadoop.hdfs.server.namenode.TestNNStorageRetentionFunctional
hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.qjournal.server.TestJournalNodeSync
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.TestPread
hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
hadoop.hdfs.TestDFSPermission
hadoop.hdfs.server.blockmanagement.TestAvailableSpaceRackFaultTolerantBPP
hadoop.hdfs.server.blockmanagement.TestSequentialBlockId
hadoop.hdfs.TestEncryptionZones
hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages
hadoop.hdfs.server.namenode.web.resources.TestWebHdfsDataLocality
hadoop.hdfs.TestParallelShortCircuitReadNoChecksum
hadoop.hdfs.server.namenode.TestSecureNameNode
hadoop.hdfs.TestBatchedListDirectories
hadoop.hdfs.server.datanode.TestBlockReplacement
hadoop.hdfs.server.namenode.TestNestedEncryptionZones
hadoop.hdfs.server.namenode.ha.TestQuotasWithHA
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
hadoop.hdfs.security.TestDelegationTokenForProxyUser
hadoop.hdfs.TestFileAppend
hadoop.hdfs.TestDFSAddressConfig
hadoop.hdfs.TestReplaceDatanodeOnFailure
hadoop.fs.TestSymlinkHdfsFileSystem
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsVolumeList
hadoop.hdfs.server.namenode.TestMalformedURLs
hadoop.hdfs.TestReadWhileWriting
hadoop.hdfs.server.namenode.TestRedudantBlocks
hadoop.hdfs.server.namenode.ha.TestNNHealthCheck
hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy
hadoop.hdfs.TestSecureEncryptionZoneWithKMS
hadoop.hdfs.TestSnapshotCommands
hadoop.hdfs.server.namenode.TestNameNodeRpcServerMethods
hadoop.hdfs.TestDFSStartupVersions
hadoop.hdfs.server.namenode.ha.TestPendingCorruptDnMessages
hadoop.hdfs.server.namenode.TestDefaultBlockPlacementPolicy
hadoop.hdfs.TestEncryptionZonesWithKMS
hadoop.hdfs.TestFileCorruption
hadoop.hdfs.server.datanode.TestTriggerBlockReport
hadoop.hdfs.server.datanode.TestRefreshNamenodes
hadoop.fs.TestSymlinkHdfsFileContext
hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransferExpiredBlockToken
hadoop.fs.contract.hdfs.TestHDFSContractVectoredRead
hadoop.hdfs.tools.TestWebHDFSStoragePolicyCommands
hadoop.hdfs.TestExternalBlockReader
hadoop.hdfs.TestStoragePolicyPermissionSettings
hadoop.hdfs.TestLargeBlock
hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA
hadoop.hdfs.TestClose
hadoop.hdfs.server.namenode.TestSaveNamespace
hadoop.hdfs.server.namenode.snapshot.TestUpdatePipelineWithSnapshots
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.security.TestDelegationToken
hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetCache
hadoop.hdfs.server.datanode.TestDataNodeVolumeMetrics
hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork
hadoop.hdfs.server.namenode.ha.TestInitializeSharedEdits
hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd
hadoop.fs.TestFcHdfsPermission
hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
hadoop.hdfs.server.namenode.TestLeaseManager
hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail
hadoop.hdfs.TestLeaseRecovery
hadoop.hdfs.server.namenode.TestFSNamesystemMBean
hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy
hadoop.TestRefreshCallQueue
hadoop.fs.contract.hdfs.TestHDFSContractConcat
hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
hadoop.hdfs.server.blockmanagement.TestPendingInvalidateBlock
hadoop.hdfs.TestDistributedFileSystemWithECFile
hadoop.hdfs.TestDFSStripedInputStream
hadoop.hdfs.server.diskbalancer.TestConnectors
hadoop.cli.TestErasureCodingCLI
hadoop.hdfs.server.namenode.TestStoragePolicySatisfierWithHA
hadoop.hdfs.TestLocalDFS
hadoop.hdfs.server.namenode.snapshot.TestSetQuotaWithSnapshot
hadoop.hdfs.server.datanode.TestCachingStrategy
hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes
hadoop.hdfs.tools.TestDFSZKFailoverController
hadoop.hdfs.server.namenode.snapshot.TestDiffListBySkipList
hadoop.hdfs.TestIsMethodSupported
hadoop.hdfs.client.impl.TestClientBlockVerification
hadoop.hdfs.server.namenode.TestClusterId
hadoop.hdfs.TestDFSInotifyEventInputStream
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.TestStripedFileAppend
hadoop.hdfs.server.namenode.ha.TestStateTransitionFailure
hadoop.hdfs.TestDFSClientExcludedNodes
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForErasureCodingPolicy
hadoop.hdfs.server.namenode.ha.TestHAAppend
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.TestErasureCodingAddConfig
hadoop.hdfs.server.namenode.TestListOpenFiles
hadoop.hdfs.server.namenode.TestNameNodeXAttr
hadoop.hdfs.server.datanode.TestDataNodeMXBean
hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes
hadoop.hdfs.tools.TestDelegationTokenFetcher
hadoop.hdfs.TestInjectionForSimulatedStorage
hadoop.hdfs.TestBlockStoragePolicy
hadoop.hdfs.server.namenode.TestReconstructStripedBlocks
hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy
hadoop.hdfs.TestReconstructStripedFile
hadoop.hdfs.tools.TestDebugAdmin
hadoop.hdfs.server.namenode.ha.TestHAStateTransitions
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary
hadoop.hdfs.server.namenode.TestDeadDatanode
hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeWithHdfsScheme
hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands
hadoop.cli.TestHDFSCLI
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.TestNameNodeRespectsBindHostKeys
hadoop.metrics2.sink.TestRollingFileSystemSinkWithSecureHdfs
hadoop.hdfs.server.blockmanagement.TestHeartbeatHandling
hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
hadoop.TestGenericRefresh
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.TestProtectedDirectories
hadoop.hdfs.server.datanode.TestBPOfferService
hadoop.hdfs.TestListFilesInDFS
hadoop.hdfs.server.namenode.TestMetaSave
hadoop.hdfs.server.namenode.TestNameNodeAcl
hadoop.hdfs.server.namenode.ha.TestLossyRetryInvocationHandler
hadoop.hdfs.qjournal.TestSecureNNWithQJM
hadoop.hdfs.server.namenode.ha.TestBootstrapAliasmap
hadoop.hdfs.server.namenode.ha.TestEditLogTailer
hadoop.hdfs.TestMissingBlocksAlert
hadoop.hdfs.server.namenode.TestNameNodeMXBean
hadoop.hdfs.server.blockmanagement.TestDatanodeManager
hadoop.hdfs.TestEnclosingRoot
hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy
hadoop.fs.shell.TestHdfsTextCommand
hadoop.hdfs.server.datanode.TestDataNodeInitStorage
hadoop.hdfs.server.namenode.TestCheckpoint
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
hadoop.hdfs.security.token.block.TestUpdateDataNodeCurrentKey
hadoop.hdfs.server.balancer.TestBalancerLongRunningTasks
hadoop.net.TestNetworkTopology
hadoop.fs.contract.hdfs.TestHDFSContractPathHandle
hadoop.hdfs.server.blockmanagement.TestBlockInfoStriped
hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens
hadoop.hdfs.TestDisableConnCache
hadoop.hdfs.server.datanode.TestDataNodeHotSwapVolumes
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.hdfs.tools.TestStoragePolicyCommands
hadoop.hdfs.server.balancer.TestBalancerRPCDelay
hadoop.hdfs.TestEncryptedTransfer
hadoop.fs.TestEnhancedByteBufferAccess
hadoop.fs.viewfs.TestViewFsFileStatusHdfs
hadoop.hdfs.tools.TestViewFileSystemOverloadSchemeWithDFSAdmin
hadoop.hdfs.server.diskbalancer.TestDiskBalancer
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.hdfs.web.TestWebHDFSXAttr
hadoop.hdfs.server.namenode.snapshot.TestGetContentSummaryWithSnapshot
hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs
hadoop.fs.viewfs.TestViewFsLinkFallback
hadoop.hdfs.TestDatanodeRegistration
hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocksWithRandomECPolicy
hadoop.hdfs.TestAppendDifferentChecksum
hadoop.hdfs.TestDFSOutputStream
hadoop.hdfs.TestErasureCodingExerciseAPIs
hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter
hadoop.hdfs.server.namenode.TestTransferFsImage
hadoop.hdfs.TestTrashWithSecureEncryptionZones
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr
hadoop.hdfs.server.namenode.snapshot.TestSnapshotRename
hadoop.fs.TestHDFSFileContextMainOperations
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.TestViewDistributedFileSystemContract
hadoop.hdfs.TestWriteConfigurationToDFS
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
hadoop.hdfs.server.namenode.TestFSNamesystem
hadoop.hdfs.server.namenode.ha.TestStandbyIsHot
hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages
hadoop.hdfs.TestDeadNodeDetection
hadoop.fs.contract.hdfs.TestHDFSContractSetTimes
hadoop.fs.contract.hdfs.TestHDFSContractCreate
hadoop.cli.TestDeleteCLI
hadoop.hdfs.TestStateAlignmentContextWithHA
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.TestParallelUnixDomainRead
hadoop.hdfs.TestDecommissionWithStriped
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.namenode.TestAddBlockRetry
hadoop.hdfs.server.blockmanagement.TestNodeCount
hadoop.hdfs.TestFileAppend2
hadoop.hdfs.server.namenode.ha.TestFailureOfSharedDir
hadoop.hdfs.server.diskbalancer.TestDiskBalancerWithMockMover
hadoop.hdfs.server.namenode.TestFSImageWithAcl
hadoop.hdfs.TestFileCreationClient
hadoop.hdfs.TestSafeModeWithStripedFile
hadoop.hdfs.server.namenode.TestBackupNode
hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus
hadoop.hdfs.server.namenode.ha.TestHarFileSystemWithHA
hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica
hadoop.hdfs.server.datanode.TestDiskError
hadoop.hdfs.TestRestartDFS
hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy
hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC
hadoop.hdfs.TestRenameWhileOpen
hadoop.hdfs.TestHDFSFileSystemContract
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.TestApplyingStoragePolicy
hadoop.hdfs.server.namenode.ha.TestConsistentReadsObserver
hadoop.hdfs.TestDFSStorageStateRecovery
hadoop.hdfs.server.namenode.snapshot.TestSnapshotNameWithInvalidCharacters
hadoop.hdfs.server.namenode.TestReencryptionWithKMS
hadoop.hdfs.TestBlockMissingException
hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead
hadoop.hdfs.server.datanode.TestDataNodeExit
hadoop.hdfs.server.datanode.TestReadOnlySharedStorage
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyConsiderLoad
hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure
hadoop.fs.contract.hdfs.TestHDFSContractUnbuffer
hadoop.hdfs.web.TestWebHdfsTokens
hadoop.hdfs.TestFileStatusWithRandomECPolicy
hadoop.hdfs.server.blockmanagement.TestStorageBlockPoolUsageStdDev
hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation
hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover
hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics
hadoop.hdfs.server.namenode.snapshot.TestSnapshotManager
hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl
hadoop.hdfs.server.namenode.TestNamenodeRetryCache
hadoop.hdfs.server.aliasmap.TestSecureAliasMap
hadoop.hdfs.server.namenode.TestNameNodeReconfigure
hadoop.fs.viewfs.TestViewFileSystemLinkRegex
hadoop.hdfs.TestParallelRead
hadoop.hdfs.server.datanode.TestDataNodeReconfiguration
hadoop.hdfs.TestMaintenanceWithStriped
hadoop.hdfs.server.namenode.snapshot.TestRandomOpsWithSnapshots
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeHdfsFileSystemContract
hadoop.hdfs.server.namenode.ha.TestDNFencing
hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData
hadoop.hdfs.server.datanode.TestBlockHasMultipleReplicasOnSameDN
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.TestErasureCodeBenchmarkThroughput
hadoop.hdfs.TestFileChecksum
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.blockmanagement.TestBlockPlacementPolicyDebugLoggingBuilder
hadoop.hdfs.server.blockmanagement.TestBlockReportLease
hadoop.fs.contract.hdfs.TestHDFSContractMkdir
hadoop.hdfs.server.blockmanagement.TestRedundancyMonitor
hadoop.hdfs.server.balancer.TestBalancerService
hadoop.hdfs.server.datanode.TestIncrementalBlockReports
hadoop.hdfs.server.namenode.TestFileContextAcl
hadoop.fs.viewfs.TestViewFileSystemWithAcls
hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
hadoop.hdfs.TestDFSInputStreamBlockLocations
hadoop.hdfs.server.namenode.TestEditLogJournalFailures
hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade
hadoop.fs.contract.hdfs.TestHDFSContractSeek
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.TestDFSClientSocketSize
hadoop.hdfs.TestHDFSServerPorts
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/2/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux ceb498d8b88b 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 2cd2cb9
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/2/testReport/
Max. process+thread count 5429 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 20s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 37m 54s trunk passed
+1 💚 compile 0m 44s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 0m 36s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 0m 36s trunk passed
+1 💚 mvnsite 0m 45s trunk passed
+1 💚 javadoc 0m 44s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 7s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 1m 53s trunk passed
+1 💚 shadedclient 26m 47s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 39s the patch passed
+1 💚 compile 0m 41s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 0m 41s the patch passed
+1 💚 compile 0m 39s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 0m 39s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 32s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 68 unchanged - 0 fixed = 70 total (was 68)
+1 💚 mvnsite 0m 39s the patch passed
+1 💚 javadoc 0m 36s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 14s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 1m 56s the patch passed
+1 💚 shadedclient 23m 35s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 183m 44s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
-1 ❌ asflicense 0m 27s /results-asflicense.txt The patch generated 15 ASF License warnings.
285m 10s
Reason Tests
Failed junit tests hadoop.hdfs.server.blockmanagement.TestDatanodeManager
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/4/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 131252608e60 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / a276b78
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/4/testReport/
Max. process+thread count 4454 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 44s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 52m 14s trunk passed
+1 💚 compile 1m 36s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 25s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 19s trunk passed
+1 💚 mvnsite 1m 29s trunk passed
+1 💚 javadoc 1m 16s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 50s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 54s trunk passed
+1 💚 shadedclient 45m 49s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 20s the patch passed
+1 💚 compile 1m 25s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 25s the patch passed
+1 💚 compile 1m 19s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 19s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 16s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 68 unchanged - 0 fixed = 71 total (was 68)
+1 💚 mvnsite 1m 35s the patch passed
+1 💚 javadoc 1m 6s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 48s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 55s the patch passed
+1 💚 shadedclient 44m 49s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 267m 55s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
436m 14s
Reason Tests
Failed junit tests hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.blockmanagement.TestDatanodeManager
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/3/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux ccb7331b70b8 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / ac65e6b
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/3/testReport/
Max. process+thread count 2875 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/3/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Last-remote11 Last-remote11 marked this pull request as ready for review July 10, 2024 16:06
@Last-remote11
Copy link
Contributor Author

Last-remote11 commented Jul 10, 2024 •
edited

it seems two unit tests (hadoop.hdfs.TestRollingUpgrade, hadoop.hdfs.server.blockmanagement.TestDatanodeManager) fail because of problem related HDFS-17566.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 46s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 8s trunk passed
+1 💚 compile 1m 24s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 16s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 16s trunk passed
+1 💚 mvnsite 1m 22s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s trunk passed
+1 💚 shadedclient 41m 48s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 13s the patch passed
+1 💚 compile 1m 16s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 16s the patch passed
+1 💚 compile 1m 8s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 8s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 58s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 39s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 17s the patch passed
+1 💚 shadedclient 41m 23s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 257m 26s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 50s The patch does not generate ASF License warnings.
413m 52s
Reason Tests
Failed junit tests hadoop.hdfs.server.blockmanagement.TestDatanodeManager
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/5/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux f44a220e54d6 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / adef667
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/5/testReport/
Max. process+thread count 2791 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/5/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 45s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 54s trunk passed
+1 💚 compile 1m 25s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 16s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 17s trunk passed
+1 💚 mvnsite 1m 22s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 45s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 18s trunk passed
+1 💚 shadedclient 41m 55s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 13s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 10s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 16s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 37s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 22s the patch passed
+1 💚 shadedclient 42m 3s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 256m 37s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 47s The patch does not generate ASF License warnings.
414m 37s
Reason Tests
Failed junit tests hadoop.hdfs.TestRollingUpgrade
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/6/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 89a90f6b4089 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7519ad9
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/6/testReport/
Max. process+thread count 2967 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 13m 32s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 16s trunk passed
+1 💚 compile 1m 37s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 22s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 17s trunk passed
+1 💚 mvnsite 1m 33s trunk passed
+1 💚 javadoc 1m 17s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 53s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 52s trunk passed
+1 💚 shadedclient 42m 28s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 20s the patch passed
+1 💚 compile 1m 24s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 24s the patch passed
+1 💚 compile 1m 13s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 13s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 5s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 68 unchanged - 0 fixed = 69 total (was 68)
+1 💚 mvnsite 1m 23s the patch passed
+1 💚 javadoc 1m 2s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 44s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 43s the patch passed
+1 💚 shadedclient 43m 15s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 283m 22s hadoop-hdfs in the patch passed.
+1 💚 asflicense 1m 2s The patch does not generate ASF License warnings.
457m 2s
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/8/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux e00fcc59701b 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 31fa957
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/8/testReport/
Max. process+thread count 3028 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/8/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 18m 25s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 18s trunk passed
+1 💚 compile 1m 35s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 23s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 16s trunk passed
+1 💚 mvnsite 1m 31s trunk passed
+1 💚 javadoc 1m 17s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 51s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 42s trunk passed
+1 💚 shadedclient 43m 9s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 16s the patch passed
+1 💚 compile 1m 22s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 22s the patch passed
+1 💚 compile 1m 12s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 12s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 6s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 68 unchanged - 0 fixed = 69 total (was 68)
+1 💚 mvnsite 1m 21s the patch passed
+1 💚 javadoc 1m 2s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 42s the patch passed
+1 💚 shadedclient 45m 11s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 284m 49s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 55s The patch does not generate ASF License warnings.
465m 41s
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/7/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 6f5f2ee333ad 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 31fa957
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/7/testReport/
Max. process+thread count 3010 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/7/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 46s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 7s trunk passed
+1 💚 compile 1m 26s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 22s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 17s trunk passed
+1 💚 mvnsite 1m 24s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 22s trunk passed
+1 💚 shadedclient 41m 48s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 10s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 16s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 39s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 22s the patch passed
+1 💚 shadedclient 42m 16s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 257m 47s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 45s The patch does not generate ASF License warnings.
415m 11s
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/9/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 7f7d9ac1191d 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / c8ef243
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/9/testReport/
Max. process+thread count 2837 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/9/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Last-remote11 Last-remote11 changed the title HDFS-17573. Add test code for FSImage parallelization and compression HDFS-17573. Allow turn on both FSImage parallelization and compression Jul 17, 2024
@Last-remote11
Copy link
Contributor Author

@sodonnel @Hexiaoqiao Hello, may i request review on this?

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 6m 47s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 32m 29s trunk passed
+1 💚 compile 0m 41s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 0m 40s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 0m 37s trunk passed
+1 💚 mvnsite 0m 42s trunk passed
+1 💚 javadoc 0m 40s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 10s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 1m 41s trunk passed
+1 💚 shadedclient 23m 16s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 0m 41s the patch passed
+1 💚 compile 0m 38s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 0m 38s the patch passed
+1 💚 compile 0m 38s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 0m 38s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 34s the patch passed
+1 💚 mvnsite 0m 38s the patch passed
+1 💚 javadoc 0m 33s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 4s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 1m 43s the patch passed
+1 💚 shadedclient 21m 18s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 191m 34s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 30s The patch does not generate ASF License warnings.
287m 51s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
Subsystem Report/Notes
Docker ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/10/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 9ed02b65c53d 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / bb72aae
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/10/testReport/
Max. process+thread count 4401 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/10/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 46s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 56m 46s trunk passed
+1 💚 compile 1m 26s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 20s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 14s trunk passed
+1 💚 mvnsite 1m 23s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 45s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s trunk passed
+1 💚 shadedclient 41m 38s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 13s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 10s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 14s the patch passed
+1 💚 javadoc 0m 58s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 35s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s the patch passed
+1 💚 shadedclient 41m 20s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 262m 2s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
424m 47s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/11/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 8090ab218a29 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 32226b1
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/11/testReport/
Max. process+thread count 2949 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/11/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 47s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 9s trunk passed
+1 💚 compile 1m 30s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 16s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 15s trunk passed
+1 💚 mvnsite 1m 24s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s trunk passed
+1 💚 shadedclient 41m 35s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 14s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 10s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 58s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 38s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 20s the patch passed
+1 💚 shadedclient 41m 30s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 257m 24s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
413m 45s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.TestRollingUpgrade
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/12/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 92f0a7e7d399 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / fbcb79a
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/12/testReport/
Max. process+thread count 2834 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/12/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 46s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 49m 18s trunk passed
+1 💚 compile 1m 27s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 15s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 15s trunk passed
+1 💚 mvnsite 1m 23s trunk passed
+1 💚 javadoc 1m 11s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 20s trunk passed
+1 💚 shadedclient 42m 15s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 15s the patch passed
+1 💚 compile 1m 19s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 19s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 3s the patch passed
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 34s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 20s the patch passed
+1 💚 shadedclient 41m 18s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 264m 33s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
420m 29s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/13/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 71feea083a69 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / cf2e165
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/13/testReport/
Max. process+thread count 2970 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/13/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 49s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 50m 14s trunk passed
+1 💚 compile 1m 38s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 37s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 30s trunk passed
+1 💚 mvnsite 2m 6s trunk passed
+1 💚 javadoc 1m 33s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 2m 1s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 4m 14s trunk passed
+1 💚 shadedclient 43m 49s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 15s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 4s the patch passed
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 38s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 22s the patch passed
+1 💚 shadedclient 41m 14s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 264m 34s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 47s The patch does not generate ASF License warnings.
425m 17s
Reason Tests
Failed junit tests hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/14/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 2f8e6b7eb03f 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 79e4008
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/14/testReport/
Max. process+thread count 2855 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/14/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Hexiaoqiao
Hexiaoqiao reviewed Jul 28, 2024
View reviewed changes
Copy link
Contributor

@Hexiaoqiao Hexiaoqiao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Leave some nit comments inline. PFYI.

.../hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatProtobuf.java Show resolved Hide resolved
.../java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshotParallelAndCompress.java Outdated Show resolved Hide resolved
.../java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshotParallelAndCompress.java Outdated Show resolved Hide resolved
.../java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshotParallelAndCompress.java Outdated Show resolved Hide resolved
...adoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java Outdated Show resolved Hide resolved
@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 21m 3s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 3 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 51m 26s trunk passed
+1 💚 compile 1m 26s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 compile 1m 17s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 checkstyle 1m 14s trunk passed
+1 💚 mvnsite 1m 25s trunk passed
+1 💚 javadoc 1m 12s trunk passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 46s trunk passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 19s trunk passed
+1 💚 shadedclient 41m 22s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 15s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 4s the patch passed
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 57s the patch passed with JDK Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2
+1 💚 javadoc 1m 41s the patch passed with JDK Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
+1 💚 spotbugs 3m 20s the patch passed
+1 💚 shadedclient 41m 23s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 261m 42s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 49s The patch does not generate ASF License warnings.
439m 22s
Subsystem Report/Notes
Docker ClientAPI=1.46 ServerAPI=1.46 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/15/artifact/out/Dockerfile
GITHUB PR #6929
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 40a56dc6728f 5.15.0-107-generic #117-Ubuntu SMP Fri Apr 26 12:26:49 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 0df56b2
Default Java Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.23+9-post-Ubuntu-1ubuntu120.04.2 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_412-8u412-ga-1~20.04.1-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/15/testReport/
Max. process+thread count 2977 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6929/15/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Last-remote11
Copy link
Contributor Author

@Hexiaoqiao @sodonnel
Please help to merge, if there's no more review or comment.
thank you!

Hexiaoqiao
Hexiaoqiao approved these changes Aug 18, 2024
View reviewed changes
Copy link
Contributor

@Hexiaoqiao Hexiaoqiao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. +1 from my side. Will try to checkin if no more other comments while waiting two work days.

@Last-remote11
Copy link
Contributor Author

@Hexiaoqiao Thanks a lot for reviewing!

@Hexiaoqiao Hexiaoqiao merged commit 89e38f0 into apache:trunk Aug 25, 2024
4 checks passed
@Hexiaoqiao
Copy link
Contributor

Committed to trunk. Thanks @Last-remote11 for your works!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Hexiaoqiao Hexiaoqiao Hexiaoqiao approved these changes

Assignees
No one assigned
Labels
HDFS trunk
Projects
None yet
Milestone
No milestone
3 participants
@Last-remote11 @hadoop-yetus @Hexiaoqiao