I am trying to debug an issue where when I try to save and publish, I get
SQL timeout error. I'm noticing that every time I save and publish, Umbraco restarts. I have never seen logs mentioning Overwhelming Change Notification and sutting down everytime xml file is saved. Any ideas?
2021-02-25 11:00:39,208 [P21496/D8/T287] INFO Umbraco.Core.CoreBootManager - Umbraco 7.15.5 application starting on DESKTOP-0HE7UN5
2021-02-25 11:00:39,234 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Determining hash of code files on disk
2021-02-25 11:00:39,246 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Hash determined (took 12ms)
2021-02-25 11:00:39,307 [P21496/D8/T287] INFO Umbraco.Core.MainDom - Acquiring MainDom...
2021-02-25 11:00:39,310 [P21496/D8/T287] INFO Umbraco.Core.MainDom - Acquired MainDom.
2021-02-25 11:00:39,311 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:39,352 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 41ms)
2021-02-25 11:00:39,352 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IApplicationStartupHandler
2021-02-25 11:00:39,353 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IApplicationStartupHandler (took 1ms)
2021-02-25 11:00:39,385 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:39,386 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 1ms)
2021-02-25 11:00:39,386 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter
2021-02-25 11:00:39,388 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter (took 0ms)
2021-02-25 11:00:39,388 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:39,388 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:39,388 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Core.PropertyEditors.IPropertyValueConverter
2021-02-25 11:00:39,389 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Core.PropertyEditors.IPropertyValueConverter (took 1ms)
2021-02-25 11:00:39,408 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:39,408 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:39,408 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Web.Mvc.SurfaceController
2021-02-25 11:00:39,408 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Web.Mvc.SurfaceController (took 0ms)
2021-02-25 11:00:39,408 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:39,410 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:39,410 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Web.WebApi.UmbracoApiController
2021-02-25 11:00:39,411 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Web.WebApi.UmbracoApiController (took 0ms)
2021-02-25 11:00:41,389 [P21496/D8/T287] INFO Umbraco.Core.DatabaseContext - CanConnect = True
2021-02-25 11:00:41,697 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Core.Models.PublishedContent.PublishedContentModel
2021-02-25 11:00:41,697 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Core.Models.PublishedContent.PublishedContentModel (took 0ms)
2021-02-25 11:00:41,709 [P21496/D8/T287] INFO Global - Umbraco Server Roles
2021-02-25 11:00:41,802 [P21496/D8/T287] INFO Umbraco.Web.Cache.CacheRefresherEventHandler - Initializing Umbraco internal event handlers for cache refreshing
2021-02-25 11:00:42,159 [P21496/D8/T287] INFO Umbraco.Web.Search.ExamineEvents - Initializing Examine and binding to business logic events
2021-02-25 11:00:42,159 [P21496/D8/T287] INFO Umbraco.Web.Search.ExamineEvents - Adding examine event handlers for index providers: 5
2021-02-25 11:00:42,407 [P21496/D8/T287] INFO umbraco.content - Load Xml from file...
2021-02-25 11:00:43,923 [P21496/D8/T287] INFO umbraco.content - Loaded Xml from file.
2021-02-25 11:00:43,939 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:43,939 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:43,940 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving [umbraco.businesslogic.ApplicationAttribute]umbraco.interfaces.IApplication
2021-02-25 11:00:43,940 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved [umbraco.businesslogic.ApplicationAttribute]umbraco.interfaces.IApplication (took 0ms)
2021-02-25 11:00:43,977 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:43,977 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:43,977 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving [Umbraco.Core.Persistence.Mappers.MapperForAttribute]Umbraco.Core.Persistence.Mappers.BaseMapper
2021-02-25 11:00:43,978 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved [Umbraco.Core.Persistence.Mappers.MapperForAttribute]Umbraco.Core.Persistence.Mappers.BaseMapper (took 0ms)
2021-02-25 11:00:46,131 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:00:46,132 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:00:46,132 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolving Umbraco.Core.PropertyEditors.IParameterEditor
2021-02-25 11:00:46,133 [P21496/D8/T287] INFO Umbraco.Core.PluginManager - Resolved Umbraco.Core.PropertyEditors.IParameterEditor (took 0ms)
2021-02-25 11:00:46,493 [P21496/D8/T287] INFO Umbraco.Core.CoreBootManager - Umbraco application startup complete (took 7375ms)
2021-02-25 11:00:46,925 [P21496/D8/T186] INFO Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected: http://local.fee-dev.org:80/umbraco
2021-02-25 11:00:46,926 [P21496/D8/T186] INFO Umbraco.Core.Sync.ApplicationUrlHelper - ApplicationUrl: http://local.fee-dev.org/umbraco (using web.routing/@umbracoApplicationUrl)
2021-02-25 11:02:29,887 [P21496/D8/T190] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
2021-02-25 11:02:29,888 [P21496/D8/T190] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
2021-02-25 11:02:29,888 [P21496/D8/T190] INFO Umbraco.Core.PluginManager - Resolving umbraco.interfaces.ICacheRefresher
2021-02-25 11:02:29,888 [P21496/D8/T190] INFO Umbraco.Core.PluginManager - Resolved umbraco.interfaces.ICacheRefresher (took 0ms)
2021-02-25 11:02:35,065 [P21496/D8/T248] INFO umbraco.content - Save Xml to file...
2021-02-25 11:02:35,502 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [LogScrubber] Terminating
2021-02-25 11:02:35,502 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [LogScrubber] Waiting for tasks to complete
2021-02-25 11:02:35,515 [P21496/D8/T169] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [LogScrubber] Tasks completed, terminated
2021-02-25 11:02:35,515 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledTasks] Terminating
2021-02-25 11:02:35,516 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledTasks] Waiting for tasks to complete
2021-02-25 11:02:35,516 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [KeepAlive] Terminating
2021-02-25 11:02:35,516 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [KeepAlive] Waiting for tasks to complete
2021-02-25 11:02:35,516 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Terminating
2021-02-25 11:02:35,517 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Waiting for tasks to complete
2021-02-25 11:02:35,517 [P21496/D8/T169] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledTasks] Tasks completed, terminated
2021-02-25 11:02:35,517 [P21496/D8/T284] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [KeepAlive] Tasks completed, terminated
2021-02-25 11:02:35,517 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledPublishing] Terminating
2021-02-25 11:02:35,518 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledPublishing] Waiting for tasks to complete
2021-02-25 11:02:35,518 [P21496/D8/T284] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledPublishing] Tasks completed, terminated
2021-02-25 11:02:35,518 [P21496/D8/T268] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Tasks completed, terminated
2021-02-25 11:02:35,522 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [HealthCheckNotifier] Terminating
2021-02-25 11:02:35,523 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [HealthCheckNotifier] Waiting for tasks to complete
2021-02-25 11:02:35,523 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [HealthCheckNotifier] Tasks completed, terminated
2021-02-25 11:02:35,523 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [Umbraco.Web.Scheduling.IBackgroundTask] Terminating
2021-02-25 11:02:35,523 [P21496/D8/T190] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [Umbraco.Web.Scheduling.IBackgroundTask] Waiting for tasks to complete
2021-02-25 11:02:35,524 [P21496/D8/T268] INFO Umbraco.Web.Scheduling.BackgroundTaskRunner - [Umbraco.Web.Scheduling.IBackgroundTask] Tasks completed, terminated
2021-02-25 11:02:35,526 [P21496/D8/T190] INFO Umbraco.Core.MainDom - Stopping...
2021-02-25 11:02:38,272 [P21496/D8/T248] INFO umbraco.content - Saved Xml to file.
2021-02-25 11:02:38,274 [P21496/D8/T190] INFO Umbraco.Web.ExamineStartup - Examine shutting down
2021-02-25 11:02:38,306 [P21496/D8/T190] INFO Umbraco.Web.ExamineStartup - Complete (took 31ms)
2021-02-25 11:02:38,306 [P21496/D8/T190] INFO Umbraco.Core.MainDom - Released MainDom.
2021-02-25 11:02:38,309 [P21496/D8/T190] INFO Umbraco.Core.UmbracoApplicationBase - Application shutdown. Details: ConfigurationChange
_shutDownMessage=CONFIG change
HostingEnvironment initiated shutdown
CONFIG change
CONFIG change
CONFIG change
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_LocalResources
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_WebReferences
CONFIG change
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_GlobalResources
Overwhelming Change Notification in C:\fee-cms\Source\FEE\FEE.Web
CONFIG change
CONFIG change
CONFIG change
CONFIG change
CONFIG change
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_Browsers
CONFIG change
CONFIG change
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_LocalResources
Overwhelming Change Notification in
CONFIG change
Change Notification for critical directories.
Overwhelming Change Notification in App_Code
Change Notification for critical directories.
Overwhelming Change Notification in App_LocalResources
Change Notification for critical directories.
Overwhelming Change Notification in bin
CONFIG change
CONFIG change
CONFIG change
User code called UnloadAppDomain
User code called UnloadAppDomain
HostingEnvironment caused shutdown
_shutDownStack= at System.Environment.GetStackTrace(Exception e, Boolean needFileInfo)
at System.Environment.get_StackTrace()
at System.Web.Hosting.HostingEnvironment.InitiateShutdownInternal()
at System.Web.Hosting.HostingEnvironment.InitiateShutdownWithoutDemand()
at System.Web.HttpRuntime.ShutdownAppDomain(String stackTrace)
at System.Web.Configuration.HttpConfigurationSystem.OnConfigurationChanged(Object sender, InternalConfigEventArgs e)
at System.Configuration.Internal.InternalConfigRoot.OnConfigChanged(InternalConfigEventArgs e)
at System.Configuration.BaseConfigurationRecord.OnStreamChanged(String streamname)
at System.Web.DirectoryMonitor.FireNotifications()
at System.Web.Util.WorkItem.CallCallbackWithAssert(WorkItemCallback callback)
at System.Web.Util.WorkItem.OnQueueUserWorkItemCompletion(Object state)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()
at System.Threading.ThreadPoolWorkQueue.Dispatch()
When a file changes inside your Web Application, a File Notification Change message is raised. For example, changing a setting in .config file, you want the application to notice your change and recompile...
... but if this setting was changing every few seconds, this would trigger tons of notification requests, and when that happens the application will restart, in the hope of correcting the cause of the notifications.
It will be interesting to see, and to perhaps bring some immediate relief if you were to set fcnmode="disabled" on your httpruntime element inside the web.config.
This basically turns off the notifications, and should stop them overwhelming the application.
However this also means any changes to views etc in the backoffice won't be realised each time they are changed until the application is restarted.,,
The real interest is, what is writing to the AppLocalResources, AppGlobalResources, AppBrowsers and AppWebReferences folders when a publish event occurs? do you have any .resx resource files in the application?
Have seen this with Modelsbuilder triggering the shutdown due to files generated at startup, and ImageProcessor too, but not the folders you mention in your post, which makes me think there may be something in your implementation related to these folders, and it's working out what is causing it to 'change'?
Application keeps restarting every time umbraco.config file changes v7.15.5
I am trying to debug an issue where when I try to save and publish, I get
SQL timeout error. I'm noticing that every time I save and publish, Umbraco restarts. I have never seen logs mentioning Overwhelming Change Notification and sutting down everytime xml file is saved. Any ideas?
Hi Riadul
When a file changes inside your Web Application, a File Notification Change message is raised. For example, changing a setting in .config file, you want the application to notice your change and recompile...
... but if this setting was changing every few seconds, this would trigger tons of notification requests, and when that happens the application will restart, in the hope of correcting the cause of the notifications.
It will be interesting to see, and to perhaps bring some immediate relief if you were to set fcnmode="disabled" on your httpruntime element inside the web.config.
This basically turns off the notifications, and should stop them overwhelming the application.
However this also means any changes to views etc in the backoffice won't be realised each time they are changed until the application is restarted.,,
The real interest is, what is writing to the AppLocalResources, AppGlobalResources, AppBrowsers and AppWebReferences folders when a publish event occurs? do you have any .resx resource files in the application?
Have seen this with Modelsbuilder triggering the shutdown due to files generated at startup, and ImageProcessor too, but not the folders you mention in your post, which makes me think there may be something in your implementation related to these folders, and it's working out what is causing it to 'change'?
Shannon wrote an article about fcn mode here: https://shazwazza.com/post/all-about-aspnet-file-change-notification-fcn/ but most of the issues this talks about were resolve in 7.6+...
regards
Marc
is working on a reply...