Frequent restarts of Umbraco - out of memory exception (sometimes)
Frequent restarts of Umbraco
Summary
Azure hosted umbraco site. The slave portal will often lock up or take a very long time to restart. Often there is nothing in the log to explain why the portal restarted just the fact the portal is starting up but sometimes there is this message:
[..] ERROR Umbraco.Core.UmbracoApplicationBase - An unhandled exception occurred React.Exceptions.BabelException: Insufficient memory to continue the execution of the program. ---> System.OutOfMemoryException: Insufficient memory to continue the execution of the program.
However when you look at the server metrics it still has over 10gigs free of available memory. There is no consistency of when the lock up will occur. It does not seem to correlate to peak loads on the server. Restarts can occur when there is little no traffic on the site.
The illusion is the site is working and delivering pages but in reality its going up and down like a yo yo.
Specs
Umbraco Version: 7.15.6
2 x Azure web apps (P3V3)
Although the config setup is for load balance scale out there is only a single slave instance.
Application insights Version: 2.16.0
Further details
When there is no shutdown message and I see "Umbraco 7.15.6 application starting on PC00244D07A4C7" does mean the application terminated unexpectedly and restart is occurring?
2020-12-10 00:18:33,286 [P21788/D2/T1] INFO
Umbraco.Core.CoreBootManager - Umbraco 7.15.6 application starting on
PC00244D07A4C7 2020-12-10 00:18:33,379 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Determining hash of code files on disk
2020-12-10 00:18:33,395 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Hash determined (took 17ms) 2020-12-10
00:18:33,473 [P21788/D2/T1] INFO Umbraco.Core.MainDom - Acquiring
MainDom... 2020-12-10 00:18:33,473 [P21788/D2/T1] INFO
Umbraco.Core.MainDom - Acquired MainDom. 2020-12-10 00:18:33,489
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:18:36,582
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 3108ms) 2020-12-10
00:18:36,598 [P21788/D2/T1] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IApplicationStartupHandler 2020-12-10
00:18:36,598 [P21788/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved umbraco.interfaces.IApplicationStartupHandler (took 4ms)
2020-12-10 00:18:36,629 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:18:36,629
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:18:36,629
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter 2020-12-10
00:18:36,629 [P21788/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter
(took 3ms) 2020-12-10 00:18:36,629 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:18:36,629
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:18:36,629
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyValueConverter 2020-12-10
00:18:36,629 [P21788/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.PropertyEditors.IPropertyValueConverter (took
4ms) 2020-12-10 00:18:36,661 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.Mvc.SurfaceController 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.Mvc.SurfaceController (took 3ms) 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:18:36,661
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.WebApi.UmbracoApiController 2020-12-10 00:18:36,676
[P21788/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.WebApi.UmbracoApiController (took 3ms) 2020-12-10
00:18:39,582 [P21788/D2/T1] INFO Umbraco.Core.DatabaseContext -
CanConnect = True 2020-12-10 00:18:39,989 [P21788/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
Umbraco.Core.Models.PublishedContent.PublishedContentModel 2020-12-10
00:18:39,989 [P21788/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.Models.PublishedContent.PublishedContentModel
(took 9ms) 2020-12-10 00:18:40,317 [P21788/D2/T1] INFO
Umbraco.Web.Cache.CacheRefresherEventHandler - Initializing Umbraco
internal event handlers for cache refreshing 2020-12-10 00:18:40,551
[P21788/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Initializing
Examine and binding to business logic events 2020-12-10 00:18:40,567
[P21788/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Adding examine
event handlers for index providers: 3 2020-12-10 00:18:40,598
[P21788/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Initializing
uSync 73 2020-12-10 00:18:40,598 [P21788/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Firing up uSync
2020-12-10 00:18:41,098 [P21788/D2/T1] INFO
Jumoo.uSync.Core.uSyncCoreContext - Loading Context (158ms)
2020-12-10 00:18:41,145 [P21788/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncBackOfficeContext - Loading up Sync
Handlers : 20 2020-12-10 00:18:41,161 [P21788/D2/T1] INFO
Jumoo.uSync.Content.ContentTemplateHandler - Content Handler Enabled =
True 2020-12-10 00:18:41,192 [P21788/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncAction - ### uSync.BackOffice Processed 0
items with 0 changes ### 2020-12-10 00:18:41,192 [P21788/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - uSync Complete
(587ms) 2020-12-10 00:18:42,098 [P21788/D2/T1] INFO umbraco.content
- Load Xml from file... 2020-12-10 00:18:48,254 [P21788/D2/T1] INFO umbraco.content - Loaded Xml from file. 2020-12-10 00:18:49,208
[P21788/D2/T1] INFO Umbraco.Core.CoreBootManager - Umbraco
application startup complete (took 16069ms) 2020-12-10 00:18:52,898
[P21788/D2/T10] INFO Umbraco.Core.Sync.ApplicationUrlHelper - New
ApplicationUrl detected: http://localhost:80/umbraco 2020-12-10
00:18:52,898 [P21788/D2/T10] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - ApplicationUrl:
http://localhost:80/umbraco (UmbracoModule request) 2020-12-10
00:18:55,851 [P21788/D2/T10] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:18:55,851
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:18:55,867
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IParameterEditor 2020-12-10 00:18:55,867
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.PropertyEditors.IParameterEditor (took 4ms) 2020-12-10
00:18:56,132 [P21788/D2/T10] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:18:56,132
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:18:56,132
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.Deploy.IServiceConnector 2020-12-10 00:18:56,132
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.Deploy.IServiceConnector (took 3ms) 2020-12-10
00:19:08,369 [P21788/D2/T10] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected:
http://www.something.com/umbraco 2020-12-10 00:19:08,369
[P21788/D2/T10] INFO Umbraco.Core.Sync.ApplicationUrlHelper -
ApplicationUrl: http://www.something.com/umbraco (UmbracoModule
request) 2020-12-10 00:19:09,543 [P21788/D2/T10] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:19:09,543
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:19:09,543
[P21788/D2/T10] INFO Umbraco.Core.PluginManager - Resolving
Lecoati.LeBlender.Extension.Controllers.LeBlenderController
2020-12-10 00:19:09,543 [P21788/D2/T10] INFO
Umbraco.Core.PluginManager - Resolved
Lecoati.LeBlender.Extension.Controllers.LeBlenderController (took 3ms)
2020-12-10 00:19:15,356 [P21788/D2/T7] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected:
http://www.something.com:80/umbraco 2020-12-10 00:19:15,372
[P21788/D2/T7] INFO Umbraco.Core.Sync.ApplicationUrlHelper -
ApplicationUrl: http://www.something.com:80/umbraco (UmbracoModule
request) 2020-12-10 00:20:10,986 [P21788/D2/T72] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:20:10,986
[P21788/D2/T72] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:20:10,986
[P21788/D2/T72] INFO Umbraco.Core.PluginManager - Resolving
Lecoati.LeBlender.Extension.Controllers.LeBlenderController
2020-12-10 00:20:11,017 [P21788/D2/T72] INFO
Umbraco.Core.PluginManager - Resolved
Lecoati.LeBlender.Extension.Controllers.LeBlenderController (took
26ms) 2020-12-10 00:20:52,621 [P8032/D2/T1] INFO
Umbraco.Core.CoreBootManager - Umbraco 7.15.6 application starting on
PC00244D07A4C7 2020-12-10 00:20:52,715 [P8032/D2/T1] INFO
Umbraco.Core.PluginManager - Determining hash of code files on disk
2020-12-10 00:20:52,730 [P8032/D2/T1] INFO Umbraco.Core.PluginManager
- Hash determined (took 17ms) 2020-12-10 00:20:52,808 [P8032/D2/T1] INFO Umbraco.Core.MainDom - Acquiring MainDom... 2020-12-10
00:20:52,808 [P8032/D2/T1] INFO Umbraco.Core.MainDom - Acquired
MainDom. 2020-12-10 00:20:52,808 [P8032/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:20:55,824
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 3011ms) 2020-12-10
00:20:55,824 [P8032/D2/T1] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IApplicationStartupHandler 2020-12-10
00:20:55,840 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IApplicationStartupHandler (took 4ms) 2020-12-10
00:20:55,855 [P8032/D2/T1] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:20:55,855
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:20:55,855
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter 2020-12-10
00:20:55,871 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter (took 3ms)
2020-12-10 00:20:55,871 [P8032/D2/T1] INFO Umbraco.Core.PluginManager
- Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:20:55,871 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:20:55,871
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyValueConverter 2020-12-10
00:20:55,871 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.PropertyEditors.IPropertyValueConverter (took 3ms)
2020-12-10 00:20:55,887 [P8032/D2/T1] INFO Umbraco.Core.PluginManager
- Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:20:55,902 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.Mvc.SurfaceController 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.Mvc.SurfaceController (took 3ms) 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.WebApi.UmbracoApiController 2020-12-10 00:20:55,902
[P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.WebApi.UmbracoApiController (took 3ms) 2020-12-10
00:20:58,730 [P8032/D2/T1] INFO Umbraco.Core.DatabaseContext -
CanConnect = True 2020-12-10 00:20:59,137 [P8032/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
Umbraco.Core.Models.PublishedContent.PublishedContentModel 2020-12-10
00:20:59,137 [P8032/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.Models.PublishedContent.PublishedContentModel (took 8ms)
2020-12-10 00:20:59,449 [P8032/D2/T1] INFO
Umbraco.Web.Cache.CacheRefresherEventHandler - Initializing Umbraco
internal event handlers for cache refreshing 2020-12-10 00:20:59,683
[P8032/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Initializing
Examine and binding to business logic events 2020-12-10 00:20:59,683
[P8032/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Adding examine
event handlers for index providers: 3 2020-12-10 00:20:59,715
[P8032/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Initializing
uSync 73 2020-12-10 00:20:59,730 [P8032/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Firing up uSync
2020-12-10 00:21:00,215 [P8032/D2/T1] INFO
Jumoo.uSync.Core.uSyncCoreContext - Loading Context (161ms)
2020-12-10 00:21:00,262 [P8032/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncBackOfficeContext - Loading up Sync
Handlers : 20 2020-12-10 00:21:00,277 [P8032/D2/T1] INFO
Jumoo.uSync.Content.ContentTemplateHandler - Content Handler Enabled =
True 2020-12-10 00:21:00,308 [P8032/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncAction - ### uSync.BackOffice Processed 0
items with 0 changes ### 2020-12-10 00:21:00,308 [P8032/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - uSync Complete
(577ms) 2020-12-10 00:21:01,355 [P8032/D2/T1] INFO umbraco.content -
Load Xml from file... 2020-12-10 00:21:07,324 [P8032/D2/T1] INFO
umbraco.content - Loaded Xml from file. 2020-12-10 00:21:08,168
[P8032/D2/T1] INFO Umbraco.Core.CoreBootManager - Umbraco application
startup complete (took 15686ms) 2020-12-10 00:21:11,715
[P8032/D2/T14] INFO Umbraco.Core.Sync.ApplicationUrlHelper - New
ApplicationUrl detected: http://localhost:80/umbraco 2020-12-10
00:21:11,715 [P8032/D2/T14] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - ApplicationUrl:
http://localhost:80/umbraco (UmbracoModule request) 2020-12-10
00:21:15,091 [P8032/D2/T14] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:21:15,091
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:21:15,091
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IParameterEditor 2020-12-10 00:21:15,091
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.PropertyEditors.IParameterEditor (took 4ms) 2020-12-10
00:21:15,341 [P8032/D2/T14] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IDiscoverable 2020-12-10 00:21:15,341
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:21:15,341
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.Deploy.IServiceConnector 2020-12-10 00:21:15,341
[P8032/D2/T14] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Core.Deploy.IServiceConnector (took 3ms) 2020-12-10
00:21:27,544 [P8032/D2/T26] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected:
http://www.something.com/umbraco 2020-12-10 00:21:27,544
[P8032/D2/T26] INFO Umbraco.Core.Sync.ApplicationUrlHelper -
ApplicationUrl: http://www.something.com/umbraco (UmbracoModule
request) 2020-12-10 00:21:30,263 [P8032/D2/T42] INFO
Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected:
http://www.something.com:80/umbraco 2020-12-10 00:21:30,263
[P8032/D2/T42] INFO Umbraco.Core.Sync.ApplicationUrlHelper -
ApplicationUrl: http://www.something.com:80/umbraco (UmbracoModule
request) 2020-12-10 00:21:33,122 [P8032/D2/T26] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:21:33,122
[P8032/D2/T26] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:21:33,122
[P8032/D2/T26] INFO Umbraco.Core.PluginManager - Resolving
Lecoati.LeBlender.Extension.Controllers.LeBlenderController
2020-12-10 00:21:33,122 [P8032/D2/T26] INFO
Umbraco.Core.PluginManager - Resolved
Lecoati.LeBlender.Extension.Controllers.LeBlenderController (took 3ms)
2020-12-10 00:23:09,397 [P28600/D2/T1] INFO
Umbraco.Core.CoreBootManager - Umbraco 7.15.6 application starting on
PC00244D07A4C7 2020-12-10 00:23:09,490 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Determining hash of code files on disk
2020-12-10 00:23:09,506 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Hash determined (took 19ms) 2020-12-10
00:23:09,584 [P28600/D2/T1] INFO Umbraco.Core.MainDom - Acquiring
MainDom... 2020-12-10 00:23:09,600 [P28600/D2/T1] INFO
Umbraco.Core.MainDom - Acquired MainDom. 2020-12-10 00:23:09,600
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:23:12,663
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 3066ms) 2020-12-10
00:23:12,663 [P28600/D2/T1] INFO Umbraco.Core.PluginManager -
Resolving umbraco.interfaces.IApplicationStartupHandler 2020-12-10
00:23:12,663 [P28600/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved umbraco.interfaces.IApplicationStartupHandler (took 3ms)
2020-12-10 00:23:12,695 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:23:12,695
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:23:12,695
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter 2020-12-10
00:23:12,695 [P28600/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.PropertyEditors.IPropertyEditorValueConverter
(took 3ms) 2020-12-10 00:23:12,695 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:23:12,695
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:23:12,710
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Core.PropertyEditors.IPropertyValueConverter 2020-12-10
00:23:12,710 [P28600/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.PropertyEditors.IPropertyValueConverter (took
4ms) 2020-12-10 00:23:12,726 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:23:12,726
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 1ms) 2020-12-10 00:23:12,726
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.Mvc.SurfaceController 2020-12-10 00:23:12,726
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.Mvc.SurfaceController (took 3ms) 2020-12-10 00:23:12,742
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
umbraco.interfaces.IDiscoverable 2020-12-10 00:23:12,742
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
umbraco.interfaces.IDiscoverable (took 0ms) 2020-12-10 00:23:12,742
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolving
Umbraco.Web.WebApi.UmbracoApiController 2020-12-10 00:23:12,742
[P28600/D2/T1] INFO Umbraco.Core.PluginManager - Resolved
Umbraco.Web.WebApi.UmbracoApiController (took 3ms) 2020-12-10
00:23:15,663 [P28600/D2/T1] INFO Umbraco.Core.DatabaseContext -
CanConnect = True 2020-12-10 00:23:16,101 [P28600/D2/T1] INFO
Umbraco.Core.PluginManager - Resolving
Umbraco.Core.Models.PublishedContent.PublishedContentModel 2020-12-10
00:23:16,101 [P28600/D2/T1] INFO Umbraco.Core.PluginManager -
Resolved Umbraco.Core.Models.PublishedContent.PublishedContentModel
(took 8ms) 2020-12-10 00:23:16,413 [P28600/D2/T1] INFO
Umbraco.Web.Cache.CacheRefresherEventHandler - Initializing Umbraco
internal event handlers for cache refreshing 2020-12-10 00:23:16,648
[P28600/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Initializing
Examine and binding to business logic events 2020-12-10 00:23:16,648
[P28600/D2/T1] INFO Umbraco.Web.Search.ExamineEvents - Adding examine
event handlers for index providers: 3 2020-12-10 00:23:16,679
[P28600/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Initializing
uSync 73 2020-12-10 00:23:16,695 [P28600/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Firing up uSync
2020-12-10 00:23:17,148 [P28600/D2/T1] INFO
Jumoo.uSync.Core.uSyncCoreContext - Loading Context (141ms)
2020-12-10 00:23:17,195 [P28600/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncBackOfficeContext - Loading up Sync
Handlers : 20 2020-12-10 00:23:17,226 [P28600/D2/T1] INFO
Jumoo.uSync.Content.ContentTemplateHandler - Content Handler Enabled =
True 2020-12-10 00:23:17,242 [P28600/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncAction - ### uSync.BackOffice Processed 0
items with 0 changes ### 2020-12-10 00:23:17,242 [P28600/D2/T1] INFO
Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - uSync Complete
(548ms) 2020-12-10 00:23:18,101 [P28600/D2/T1] INFO umbraco.content
- Load Xml from file... 2020-12-10 00:23:24,070 [P28600/D2/T1] INFO umbraco.content - Loaded Xml from file. 2020-12-10 00:23:24,867
[P28600/D2/T1] INFO Umbraco.Core.CoreBootManager - Umbraco
application startup complete (took 15617ms)
....
2020-12-10 00:25:18,425 [P28600/D2/T104] ERROR
Umbraco.Core.UmbracoApplicationBase - An unhandled exception occurred
React.Exceptions.BabelException: Insufficient memory to continue the
execution of the program. ---> System.OutOfMemoryException:
Insufficient memory to continue the execution of the program. at
System.Runtime.InteropServices.Marshal.StringToHGlobalUni(String s)
Azure
Application insights normally captures exceptions (status code 500) when they occur. I have never seen the System.OutOfMemoryException in the AI logs. When I am monitoring the azure live metrics for the slave I can often see the CPU go over 100% and is above 40% most of the time.
I have reviewed the various pieces of documentation for Umbraco 7 and Azure Web Apps and checked the portals configuration which matches the guides recommendations.
Site Lock Ups
I believe occurs when the site has crashed to many times and the examine indexes become corrupt and it takes a long time to rebuild them. During this time the site servers no pages. This can even lock up the master portal.
Other threads
I have seen this thread which matches or is very similar to this issue. Sadly they never confirm what was found to resolve the issue.
For us this appears to have been Micrsoft Web Optimisation, ScriptBundle vs BabelBundle. A single non react JS file of less than 1mb consumed over 300mb plus of memory. Switching it to ScriptBundle has stopped the constant restarts and the strange memory consumption.
Frequent restarts of Umbraco - out of memory exception (sometimes)
Frequent restarts of Umbraco
Summary
Azure hosted umbraco site. The slave portal will often lock up or take a very long time to restart. Often there is nothing in the log to explain why the portal restarted just the fact the portal is starting up but sometimes there is this message:
[..] ERROR Umbraco.Core.UmbracoApplicationBase - An unhandled exception occurred React.Exceptions.BabelException: Insufficient memory to continue the execution of the program. ---> System.OutOfMemoryException: Insufficient memory to continue the execution of the program.
However when you look at the server metrics it still has over 10gigs free of available memory. There is no consistency of when the lock up will occur. It does not seem to correlate to peak loads on the server. Restarts can occur when there is little no traffic on the site.
The illusion is the site is working and delivering pages but in reality its going up and down like a yo yo.
Specs
Umbraco Version: 7.15.6 2 x Azure web apps (P3V3) Although the config setup is for load balance scale out there is only a single slave instance. Application insights Version: 2.16.0
Further details
When there is no shutdown message and I see "Umbraco 7.15.6 application starting on PC00244D07A4C7" does mean the application terminated unexpectedly and restart is occurring?
Azure
Application insights normally captures exceptions (status code 500) when they occur. I have never seen the System.OutOfMemoryException in the AI logs. When I am monitoring the azure live metrics for the slave I can often see the CPU go over 100% and is above 40% most of the time.
I have reviewed the various pieces of documentation for Umbraco 7 and Azure Web Apps and checked the portals configuration which matches the guides recommendations.
Site Lock Ups
I believe occurs when the site has crashed to many times and the examine indexes become corrupt and it takes a long time to rebuild them. During this time the site servers no pages. This can even lock up the master portal.
Other threads
I have seen this thread which matches or is very similar to this issue. Sadly they never confirm what was found to resolve the issue.
https://our.umbraco.com/forum/using-umbraco-and-getting-started/95368-azure-app-service-suddenly-started-crashing-daily
Dev
In local development environment I do not see the same restart behaviour.
I would appreciate any insights or thoughts on this issue.
Hi
Here is an example of the frequency of restarts:
For us this appears to have been Micrsoft Web Optimisation, ScriptBundle vs BabelBundle. A single non react JS file of less than 1mb consumed over 300mb plus of memory. Switching it to ScriptBundle has stopped the constant restarts and the strange memory consumption.
is working on a reply...