Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest failure - time out, unexpected exit code #106206

Closed
elinor-fung opened this issue Aug 9, 2024 · 3 comments · Fixed by #106408
Closed

System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest failure - time out, unexpected exit code #106206

elinor-fung opened this issue Aug 9, 2024 · 3 comments · Fixed by #106408
Assignees
@kouvel
Labels
area-System.Threading blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' blocking-clean-ci-optional Blocking optional rolling runs in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab

Comments

@elinor-fung
Copy link
Member

elinor-fung commented Aug 9, 2024 •
edited by build-analysis bot
Loading

From log:

System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest(ioCompletionPortCount: 6) [FAIL]
  Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Half-way through waiting for remote process.
  Memory load: 14
  
  Image Name                     PID Services                                    
  ========================= ======== ============================================
  svchost.exe                    772 BrokerInfrastructure, DcomLaunch, LSM,      
                                      PlugPlay, Power, SystemEventsBroker         
  svchost.exe                    832 RpcEptMapper, RpcSs                         
  svchost.exe                    936 Appinfo, CertPropSvc, DsmSvc, gpsvc,        
                                      iphlpsvc, lfsvc, ProfSvc, sacsvr, Schedule, 
                                      SENS, SessionEnv, ShellHWDetection, Themes, 
                                      UserManager, Winmgmt, WpnService, wuauserv  
  svchost.exe                    952 TermService                                 
  svchost.exe                    996 Dhcp, EventLog, lmhosts, TimeBrokerSvc,     
                                      vmictimesync                                
  svchost.exe                    332 NcbService, PcaSvc, TrkWks, UALSVC,         
                                      UmRdpService, vmickvpexchange,              
                                      vmicshutdown, WdiSystemHost                 
  svchost.exe                    792 CDPSvc, EventSystem, FontCache, netprofm,   
                                      nsi, W32Time, WinHttpAutoProxySvc           
  svchost.exe                    816 vmicheartbeat                               
  svchost.exe                   1284 CryptSvc, Dnscache, LanmanWorkstation,      
                                      NlaSvc, WinRM                               
  svchost.exe                   1320 BFE, CoreMessagingRegistrar, DPS, MpsSvc,   
                                      pla                                         
  svchost.exe                   1360 Wcmsvc                                      
  svchost.exe                   1264 DiagTrack                                   
  svchost.exe                   1724 AppHostSvc                                  
  svchost.exe                   2084 W3SVC, WAS                                  
  svchost.exe                   2100 StateRepository, tiledatamodelsvc           
  svchost.exe                   2216 LanmanServer                                
  svchost.exe                   3160 CDPUserSvc_45e69, OneSyncSvc_45e69          
  svchost.exe                   3620 AppReadiness                                
  svchost.exe                  25896 AppIDSvc                                    
  Timed out at 8/9/2024 5:38:09 PM after 60000ms waiting for remote process.
  Wrote mini dump to: C:\h\w\A8AB097F\w\B6370A31\uploads\15680.qyfbmorz.fpq.dmp
    Process ID: 15680
    Handle: 1516
    Name: dotnet
    MainModule: C:\h\w\A8AB097F\p\dotnet.exe
    StartTime: 8/9/2024 5:37:09 PM
    TotalProcessorTime: 00:00:06.1875000
    Threads:
      Thread #1 (OS 0x3D3C)   [MTA]
        [HelperMethodFrame] (System.Threading.WaitHandle.WaitOneCore)
        System.Threading.WaitHandle.WaitOneNoCheck(Int32, Boolean, System.Object, WaitHandleWaitSourceMap)
        System.Threading.WaitHandle.WaitOne(Int32)
        System.Diagnostics.Process.WaitForExitCore(Int32)
        System.Diagnostics.Process.WaitForExit(Int32)
        Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean)
        Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
        System.Threading.ThreadPools.Tests.ThreadPoolTests+<>c.<IOCompletionPortCountConfigVarTest>b__47_0(System.String)
        [HelperMethodFrame_PROTECTOBJ] (System.RuntimeMethodHandle.InvokeMethod)
        System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(System.Object, IntPtr*)
        System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(System.Object, System.Span`1<System.Object>, System.Reflection.BindingFlags)
        System.Reflection.MethodBaseInvoker.InvokeWithOneArg(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
        System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
        System.Reflection.MethodBase.Invoke(System.Object, System.Object[])
        Microsoft.DotNet.RemoteExecutor.Program.Main(System.String[])
      Thread #2 (OS 0x44CC) [Finalizer] [Background] 
        [DebuggerU2MCatchHandlerFrame]
  
  Stack Trace:
    /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(225,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing)
    /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(55,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
    /_/src/libraries/System.Threading.ThreadPool/tests/ThreadPoolTests.cs(1348,0): at System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest(Int32 ioCompletionPortCount)
        at InvokeStub_ThreadPoolTests.IOCompletionPortCountConfigVarTest(Object, Span`1)
    /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs(95,0): at System.Reflection.MethodBaseInvoker.InvokeWithOneArg(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest(ioCompletionPortCount: 7) [FAIL]
  Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Remote process failed with an unhandled exception.
  Stack Trace:
    
    Child exception:
      Microsoft.DotNet.RemoteExecutor.RemoteExecutionException: Exit code was -532462766 but it should have been 42
    /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(242,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose(Boolean disposing)
    /_/src/Microsoft.DotNet.RemoteExecutor/src/RemoteInvokeHandle.cs(55,0): at Microsoft.DotNet.RemoteExecutor.RemoteInvokeHandle.Dispose()
    /_/src/libraries/System.Threading.ThreadPool/tests/ThreadPoolTests.cs(1364,0): at System.Threading.ThreadPools.Tests.ThreadPoolTests.<>c.<IOCompletionPortCountConfigVarTest>b__47_0(String ioCompletionPortCountStr)
        at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
    /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs(36,0): at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
    /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs(174,0): at System.Reflection.MethodBaseInvoker.InvokeDirectByRefWithFewArgs(Object obj, Span`1 copyOfArgs, BindingFlags invokeAttr)
    
    Child process:
      System.Threading.ThreadPool.Tests, Version=9.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51 System.Threading.ThreadPools.Tests.ThreadPoolTests+<>c Void <IOCompletionPortCountConfigVarTest>b__47_0(System.String)
    
    Child arguments:
    7

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=771124
Build error leg or test failing: System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
Pull request: #106103

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Half-way through waiting for remote process.", "IOCompletionPortCountConfigVarTest"],
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=771124
Error message validated: [Microsoft.DotNet.RemoteExecutor.RemoteExecutionException : Half-way through waiting for remote process. IOCompletionPortCountConfigVarTest]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 8/9/2024 6:29:38 PM UTC

Report

Build Definition Test Pull Request
775987 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106409
775886 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106184
775734 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #100272
775730 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106397
775540 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106387
775460 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106334
775455 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106309
775360 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
775343 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #103713
775327 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106317
775142 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106290
775094 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106374
774956 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106358
774981 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106333
774926 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106369
774776 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106368
774752 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
774632 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106362
774609 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106358
774428 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106335
774360 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105030
774266 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106332
774234 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106328
774203 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106273
774030 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105737
774146 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106314
774036 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106224
773812 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106309
773753 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106238
773525 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106299
773445 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106099
773451 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106164
773397 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106295
773200 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106290
773348 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
773224 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106091
773230 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106291
773092 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106218
772028 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106037
773192 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106164
773104 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105965
773060 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106167
772955 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106125
772782 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106267
772593 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106257
772461 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
772390 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106048
772299 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
772220 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105288
772131 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
771996 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106231
771965 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106229
771962 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #104393
771959 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106224
771890 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105206
771897 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106224
771887 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106085
771854 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106226
771814 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
771752 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106218
771694 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106218
771634 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #105771
771654 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106213
771366 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106166
771612 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106169
771517 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106185
2512106 dotnet-runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest
771303 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106072
771203 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106196
771124 dotnet/runtime System.Threading.ThreadPools.Tests.ThreadPoolTests.IOCompletionPortCountConfigVarTest #106103

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
17 70 70
@elinor-fung elinor-fung added area-System.Threading blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels Aug 9, 2024
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Aug 9, 2024
@dotnet-policy-service Dotnet Policy Service
Copy link
Contributor

Tagging subscribers to this area: @mangod9
See info in area-owners.md if you want to be subscribed.

@elinor-fung
Copy link
Member Author

cc @kouvel
Test was added in #105145

@JulieLeeMSFT JulieLeeMSFT added the blocking-clean-ci-optional Blocking optional rolling runs label Aug 13, 2024
@JulieLeeMSFT
Copy link
Member

Failed for below legs in runtime-coreclr libraries-pgo/20240811.1

net9.0-windows-Release-x86-fullpgo-Windows.10.Amd64.Open
net9.0-windows-Release-x64-fullpgo_random_gdv_edge-Windows.10.Amd64.Open
net9.0-windows-Release-x64-jitosr_stress-Windows.10.Amd64.Open
net9.0-windows-Release-x86-syntheticpgo-Windows.10.Amd64.Open
net9.0-windows-Release-x86-jitosr_stress_random-Windows.10.Amd64.Open

kouvel added a commit to kouvel/runtime that referenced this issue Aug 14, 2024
@kouvel
Fix the IOCP count config var test
919f060 
Fixed to use any available port instead of a specific port.

Fixes dotnet#106206
@kouvel kouvel mentioned this issue Aug 14, 2024
Merged
@dotnet-policy-service dotnet-policy-service bot added the in-pr There is an active PR which will close this issue when it is merged label Aug 14, 2024
@kouvel kouvel closed this as completed in addaa3b Aug 14, 2024
@dotnet-policy-service dotnet-policy-service bot removed the untriaged New issue has not been triaged by the area owner label Aug 14, 2024
@elinor-fung elinor-fung mentioned this issue Aug 15, 2024
Merged
@github-actions github-actions bot locked and limited conversation to collaborators Sep 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@kouvel kouvel

Labels
area-System.Threading blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' blocking-clean-ci-optional Blocking optional rolling runs in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix the IOCP count config var test kouvel/runtime
3 participants
@kouvel @elinor-fung @JulieLeeMSFT