When running usync to pull or push content, or when importing big content packages it fails.
For example our media contains 5GB of media files, even if we pull in batches of 700MB it stops. It claims it gets a service unavailable response.
Calculate steps seems ok, export as well but it fails on fetch at a different point each time. Is there any setting I can tweak? Or run it as a job instead of online and possibly having to face http timeouts?
This is on Umbraco 10.3.1 with Usync (complete) 10.3
if you are pushing / pulling between sites with publisher its in a slightly different place and there is a MediaPageSize setting (defaults to 5). so you can tweak that right down should you have large media.
Not sure if I am misunderstanding, but I don't have the feeling it is pushing media item by item with this setting.
I waited over half an hour for it to calculate and export, and now while packing after a few minutes it fails. Still have the feeling it is trying to do it all in one go, all 1500 media files
I will double check, but it really should be in batches.
was there more detail to the error,(if you clicked on view details on the right?)
if you have very large media files there is a good chance you are hitting the MaxAllowedContentLength settings for the site. (this default to around 50mb,)
I have the maxallowedcontentlength set. No difference.
The reported error is:
Method:
Trace:
<!DOCTYPE html PUBLIC '-//W3C//DTD XHTML 1.0 Transitional//EN' 'http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd'><html xmlns='http://www.w3.org/1999/xhtml'><head><meta content='text/html; charset=utf-8' http-equiv='content-type'/><style type='text/css'>body {font-family:Arial; margin-left:40px; }img { border:0 none; }#content { margin-left: auto; margin-right: auto }#message h2 { font-size: 20px; font-weight: normal; color: #000000; margin: 34px 0px 0px 0px }#message p { font-size: 13px; color: #000000; margin: 7px 0px 0px0px}#errorref { font-size: 11px; color: #737373; margin-top: 41px }</style><title>Service unavailable</title></head><body><div id='content'><div id='message'><h2>Our services aren't available right now</h2><p>We're working to restore all services as soon as possible. Please check back soon.</p></div><div id='errorref'><span>08TEMZQAAAACL8bRH1buJSJqKSS2r5UejQlJVMzBFREdFMTAwOAA4YzNkNzZlMS1mZmM3LTQzOGYtOWU1NC1iMjQyMmNlMTdhNjI=</span></div></div></body></html>
Which seems like the generic screw you Azure error. But I do not see this error in the logs or stuff that explains it on the receiving end of the push.
Usync timeout on Azure app service
When running usync to pull or push content, or when importing big content packages it fails. For example our media contains 5GB of media files, even if we pull in batches of 700MB it stops. It claims it gets a service unavailable response.
Calculate steps seems ok, export as well but it fails on fetch at a different point each time. Is there any setting I can tweak? Or run it as a job instead of online and possibly having to face http timeouts?
This is on Umbraco 10.3.1 with Usync (complete) 10.3
Yes - you can change the 'batch' size for the processing .
If you are using Exporter you can tweak the pagesize setting (default is 50) https://docs.jumoo.co.uk/usync/10.x/complete/Introduction/exporter#exporter-settings
if you are pushing / pulling between sites with publisher its in a slightly different place and there is a
MediaPageSize
setting (defaults to 5). so you can tweak that right down should you have large media.e.g
Not sure if I am misunderstanding, but I don't have the feeling it is pushing media item by item with this setting.
I waited over half an hour for it to calculate and export, and now while packing after a few minutes it fails. Still have the feeling it is trying to do it all in one go, all 1500 media files
I will double check, but it really should be in batches.
was there more detail to the error,(if you clicked on view details on the right?)
if you have very large media files there is a good chance you are hitting the
MaxAllowedContentLength
settings for the site. (this default to around 50mb,)some docs on how to change that setting just for uSync (although you can also do it site wide if you need too) https://docs.jumoo.co.uk/usync/8.x/complete/publisher/upload
I have the maxallowedcontentlength set. No difference.
The reported error is:
Which seems like the generic screw you Azure error. But I do not see this error in the logs or stuff that explains it on the receiving end of the push.
:( any chance you are hitting azure usage limits (I've seen this if you're testing on the free tier.
nope, very much paid subscription by our customer. Any chance of enabling some kind of diagnostic logging? I don't see anything from usync in my logs.
yes you can go debug or verbose (verbose mainly logs the handshake for debugging the auth).
https://docs.jumoo.co.uk/usync/uSync/guides/debugging
this will give you more of what is going on,
Not sure where the issue was, but upgrading Azure instance from S2 to S3 fixed it. Maybe it was nr of connections.
is working on a reply...