Failed to gracefully shutdown application (IIS Hang)

[FlorianRainer]

on application pool recycle (automatic by duration) and under high load i often get the following entry in event log Failed to gracefully shutdown application 'MACHINE/WEBROOT/APPHOST/WEBNAME'.

this was already happen in 2.1 with outproc, but now i've updated to 2.2 with hostingModel="InProcess", but i get a additional eventlog entry:

CoreCLR Version: 4.6.27207.3
Description: The process was terminated due to an unhandled exception.
Exception Info: System.IO.IOException: The handle is invalid
   at System.ConsolePal.WindowsConsoleStream.Write(Byte[] buffer, Int32 offset, Int32 count)
   at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
   at System.IO.StreamWriter.WriteLine(String value)
   at System.IO.SyncTextWriter.WriteLine(String value)
   at System.Console.WriteLine(String value)
   at Microsoft.AspNetCore.Hosting.WebHostExtensions.<>c__DisplayClass6_0.<AttachCtrlcSigtermShutdown>g__Shutdown|0()
   at Microsoft.AspNetCore.Hosting.WebHostExtensions.<>c__DisplayClass6_0.<AttachCtrlcSigtermShutdown>b__1(Object sender, EventArgs eventArgs)
   at System.EventHandler.Invoke(Object sender, EventArgs e)
   at System.AppContext.OnProcessExit(Object sender, EventArgs e)

I use overlapped recycling, the new process is already stated, but i need to recycle manualy else the IIS is not processing requests anymore, they just timed out.

Setup:

• Windows Server 2012 R2
• IIS 8.5
• .net core runtime and hosting bundle 2.2.1
• overlapped recycling enabled
• web: preload enabled = true
• application pool: start mode always running
• 32bit application

any idea why this exception happens?
the related code should be this https://github.com/aspnet/Hosting/blob/master/src/Microsoft.AspNetCore.Hosting/WebHostExtensions.cs#L142 (this Console.Log)

[serenata-keith-mifsud]

this is happening to us as well. we are load balanced, and as soon as one instance fails from this, the others shortly fail as well. This issue is happening during high traffic hours

[shram2k]

I am also facing the same issue. I have hosted Asp.Net Core 2.2 API project InProcess (IIS) and frequently getting "Failed to gracefully shutdown process". Any solution?

[shram2k]

I am also facing the same issue. I have hosted Asp.Net Core 2.2 API project InProcess (IIS) and frequently getting "Failed to gracefully shutdown process". Any solution?

Any update?

[FlorianRainer]

We have managed to avoid this Problem by optimizing the http response time.

The main reason for the problem (in my case) was a quite long request queue in IIS, and some long running requests ~30sec.

If the IIS Worker triggered the app pool to recycle, the process will try to conclude all requests in queue, if this will not be able until the IIS recycle timeout value is reached the process will get in this state (and this exception appears).

If the request processing is fast enougth, it would be no problem, but i think the Problem should be resolved in a proper way, even if we have long queues

[muratg]

Looks similar to our other test failures

[muratg]

This isn't likely to be an issue in 3.0. We've moved to logger from Console.WriteLine in the new generic host

[analogrelay]

We believe we've made significant improvements on shutdown in preview4. If you're still hitting this after preview 4 is released (and you've updated), let us know.