We have installed and been using for a couple months the CMSImport V1.0.3 and just uploaded 1.0.4 to try and fix the problem we came across today. On our live production website, anytime I import a file large or small record amount, it kicks back the error below. This only happens on our live production website and not on our internal development website. The records are imported just fine on the dev.
To get the records to import on the live website, I can only import less than 10 at a time for them to be processed without the server timing out with an error. We can't seem to find out what this means or how to fix it so we can import files again using the CMSImport. Please advise. Thank you.
Error Message:
Event code: 4005
Event message: Forms authentication failed for the request. Reason: The ticket supplied has expired.
Event time: 9/13/2010 1:24:18 PM
Event time (UTC): 9/13/2010 6:24:18 PM
Event ID: 832cfba4432a40f3a9e714418cc51401
Event sequence: 3
Event occurrence: 1
Event detail code: 50202
Process information:
Process ID: 1424
Process name: w3wp.exe
Account name: NT AUTHORITY\NETWORK SERVICE
Request information:
Request URL: http://www.ecompressedair.com/umbraco/plugins/CMSImport/Pages/wizard.aspx
Request path: /umbraco/plugins/CMSImport/Pages/wizard.aspx
User host address: 10.26.0.107
User:
Is authenticated: False
Authentication Type:
Thread account name: NT AUTHORITY\NETWORK SERVICE
Name to authenticate:
Custom event details:
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.EventType clr20r3, P1 w3wp.exe, P2 6.0.3790.3959, P3 45d6968e, P4 lucene.net, P5 2.0.0.4, P6 45f31baa, P7 893, P8 0, P9 system.nullreferenceexception, P10 NIL.
An unhandled exception occurred and the process was terminated.
Application ID: /LM/W3SVC/1/ROOT
Process ID: 1504
Exception: System.NullReferenceException
Message: Object reference not set to an instance of an object.
StackTrace: at Lucene.Net.Store.FSIndexOutput.Finalize()
Very weird. If I search on the real error which is related to Lucene. It could be that this is because of locking. I've created a DLLwhich you can download here that disables the Lucene Lock. Just put it in the Bin folder and see if it helps.
We dropped the DisableLucene.dll into this bin (D:\Inetpub\wwwroot\bin) is that the correct place? There is a file in there called Lucene.Net.dll, does this need to be removed? Will the DisableLucene.dll alter anything else in the Umbraco website? I'm not sure what the file is used for.
I tested a list to import and it gave the same error message. It only had 56 records, and only 11 would upload before the server timed out again. We've never had any problems previously using this software, always has worked great. This is our Umbraco version (umbraco v
4.0.4.1 (Assembly version: 1.0.3793.17632)
That was the correct place and you didn;t needed to remove anything it only disables the locking. To bad it didn't work because this was the easy the easy way. You might want to restart iis before you investigate further. I've did a google search on the error description and google came up with these results not really helpful.
Nothing else happened on the site lately? You might want to check all security on the folders also. I haven't had any customer with the same issue that you describe and most of them are using the same setup as you have so I don't have an easy answer.
What happens when you reinstall 1.0.3 of CMSImport?
So after messing around with everything we came up with trying to removing the Lucene.Net.dll from the bin folder. This ended up allowing us to import records just fine like before up to 220 records. We tried multiple things throughout the day, all the folder settings we're exactly the same as our development and we restarted the IIS and still wouldn't work. It still doesn't make sense of why we can import records with no problem on our development servers which have all of the same files as the live website.
Do you know if the Lucene.Net.dll will cause any problems being removed from the bin folder or what that does or what it can affect?
Also how would we go about purchasing the Pro version of the import. We want to change content that is already imported into Umbraco and don't have a good way to do it through SQL, so it's manually changing things right now. We have things in mass that we want to change. Would the Pro version be able to do this in the content? How does the content update process work?
We will add the lucene.net.dll back in right away, thank you for the heads up.
We have 50 nodes under the header of Oil Filters,
which you can see at the link below or the image attached. The 50 nodes are category nodes of manufacturers and then
under each one there are a product pages, some have 1 products, and some have
220 product pages.
The image shows the overview page of the 50 nodes. It's 3
levels in from the homepage. I first imported about 30 of the manufacturer's
nodes using the import file. Then I import each manufacturer's individual
products under the node. There were
about 950 product pages in total that we’re added under the Oil Filter category
as a whole.
You can download the import excel file that I use and the field mappings. It's the same as all the other ones we've done and have no problems before getting these errors. I use the .xlxs and then save as a .csv to import.
Thanks for sharing the info. My guess is that you don't have this many nodes on your development machine? Or that your dev machine doesn't have much load. The problem is that you're having a lot of nodes and now the Umbraco API (which gets slower with a lot of nodes) gets in the way.
You've already devided products by category so that's good. I would do 2 things:
1. Umbraco has a setting that in always updates the cache on every action. You find this setting in the UmbracoSettings file. It's called ContinouslyUpdateXmlDiskCache. Set it to False
2. Doing a publish on every document is also taking the performance down. It still needs to write the Umbraco.config file to disk every time you do that
Because both of these issues causing a lot of DISK IO I think this could be the cause of your issues. BTW This also applies for the Pro version. Only difference is that I can determine updates based on Id for you and you can schedule the imports.
Thank you for the ideas. I wondering if sending to publish on them all could be the problem. But I realize under the menu I can right-click on the category node and then send to publish and send all the pages in the node to publish as well. I'll try to do smaller batch uploads over a longer period of time throughout the day instead of all at once.
For the PRO version to update content would be we able to update things? For example I uploaded 2000 product pages in a similar area under individual manufacturer's nodes and it has a misspelling in the document and instead of manually fixing all 2000 we're trying to find a way to change it in the mass. Could the pro version do this?
Yes with a lot of nodes this will always be an issue, loads of database calls and disk IO so yes keep the batch as small as possible.
With the Prop version it's indeed possible to handle updates. When importing using the Pro version you will be asked to assign the key field of your datasource (I think in your case productId) When you uppdate the csv file and use the same product id's CMSImport knows that it already imported that product and you can choose update the document in Umbrao or skip it.
Is there anyway to test the Pro version to see if it
will work? Like a license available for a couple days and then expires?
Below is an example of a product page that needs to
be updated. In the long description box there is a misspelling with the word moister,
should be moisture and ruining should be ruin. So if I made a CSV file to
update this page I could put in the exact code for the correct long description
paragraph along with what fields to identify where in Umbraco to make that
update too?
You mentioned the Product ID's I'm not sure what
field that is that relates to find the Umbraco page to update. Each product on
the website has a unique Part# that is a custom field we created, not the
actual Umbraco PageID. Is that what we would use to identify the page in the
CMSImport? And can we update this in mass if I have all of the original files
to update with all of the Part#s? So I can do each category one at a time so
it's each manufacturer at a time.
Email me richard [at] soetemansoftware.nl for a license that you can use to try the pro version.. The Pro version can only track changes when the initial import was done with the pro version also. Because then it will add a relation between the Part Number and Umbraco Page Id in the database. You don't have to do anything for that. It will all happen automatically.
Downside for you is that you have to reimport the existing part data again because at the moment there is no relation stored between part number and Umbraco page ID and CMSIMport can't determine if it needs to insert or update the record. Or you could manually update the Mapping table of CMSImport Pro. Maybe that's better if I tell you how to do it?
CMSImport Event Error Code 4005 - Forms authentication failed for the request. Reason: The ticket supplied has expired.
We have installed and been using for a couple months the CMSImport V1.0.3 and just uploaded 1.0.4 to try and fix the problem we came across today. On our live production website, anytime I import a file large or small record amount, it kicks back the error below. This only happens on our live production website and not on our internal development website. The records are imported just fine on the dev.
To get the records to import on the live website, I can only import less than 10 at a time for them to be processed without the server timing out with an error. We can't seem to find out what this means or how to fix it so we can import files again using the CMSImport. Please advise. Thank you.
Error Message:
Event code: 4005
Event message: Forms authentication failed for the request. Reason: The ticket supplied has expired.
Event time: 9/13/2010 1:24:18 PM
Event time (UTC): 9/13/2010 6:24:18 PM
Event ID: 832cfba4432a40f3a9e714418cc51401
Event sequence: 3
Event occurrence: 1
Event detail code: 50202
Application information:
Application domain: /LM/W3SVC/1/ROOT-2-129288758514051805
Trust level: Full
Application Virtual Path: /
Application Path: d:\inetpub\wwwroot\
Machine name: HVIDRWEB
Process information:
Process ID: 1424
Process name: w3wp.exe
Account name: NT AUTHORITY\NETWORK SERVICE
Request information:
Request URL: http://www.ecompressedair.com/umbraco/plugins/CMSImport/Pages/wizard.aspx
Request path: /umbraco/plugins/CMSImport/Pages/wizard.aspx
User host address: 10.26.0.107
User:
Is authenticated: False
Authentication Type:
Thread account name: NT AUTHORITY\NETWORK SERVICE
Name to authenticate:
Custom event details:
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.EventType clr20r3, P1 w3wp.exe, P2 6.0.3790.3959, P3 45d6968e, P4 lucene.net, P5 2.0.0.4, P6 45f31baa, P7 893, P8 0, P9 system.nullreferenceexception, P10 NIL.
An unhandled exception occurred and the process was terminated.
Application ID: /LM/W3SVC/1/ROOT
Process ID: 1504
Exception: System.NullReferenceException
Message: Object reference not set to an instance of an object.
StackTrace: at Lucene.Net.Store.FSIndexOutput.Finalize()
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Hi,
Very weird. If I search on the real error which is related to Lucene. It could be that this is because of locking. I've created a DLLwhich you can download here that disables the Lucene Lock. Just put it in the Bin folder and see if it helps.
Cheers,
Richard
Thank you Richard. We'll try this and then let you know if it works.
We dropped the DisableLucene.dll into this bin (D:\Inetpub\wwwroot\bin) is that the correct place? There is a file in there called Lucene.Net.dll, does this need to be removed? Will the DisableLucene.dll alter anything else in the Umbraco website? I'm not sure what the file is used for.
I tested a list to import and it gave the same error message. It only had 56 records, and only 11 would upload before the server timed out again. We've never had any problems previously using this software, always has worked great. This is our Umbraco version (umbraco v 4.0.4.1 (Assembly version: 1.0.3793.17632)
Any ideas?
Thank you for your help.
Katy Small
Hi Katy,
That was the correct place and you didn;t needed to remove anything it only disables the locking. To bad it didn't work because this was the easy the easy way. You might want to restart iis before you investigate further. I've did a google search on the error description and google came up with these results not really helpful.
Nothing else happened on the site lately? You might want to check all security on the folders also. I haven't had any customer with the same issue that you describe and most of them are using the same setup as you have so I don't have an easy answer.
What happens when you reinstall 1.0.3 of CMSImport?
Hi Richard,
So after messing around with everything we came up with trying to removing the Lucene.Net.dll from the bin folder. This ended up allowing us to import records just fine like before up to 220 records. We tried multiple things throughout the day, all the folder settings we're exactly the same as our development and we restarted the IIS and still wouldn't work.
It still doesn't make sense of why we can import records with no problem on our development servers which have all of the same files as the live website.
Do you know if the Lucene.Net.dll will cause any problems being removed from the bin folder or what that does or what it can affect?
Also how would we go about purchasing the Pro version of the import. We want to change content that is already imported into Umbraco and don't have a good way to do it through SQL, so it's manually changing things right now. We have things in mass that we want to change. Would the Pro version be able to do this in the content? How does the content update process work?
Richard,
There were more errors, not sure of any of these could help figure out why it wouldn't import.
EventType clr20r3, P1 w3wp.exe, P2 6.0.3790.3959, P3 45d6968e, P4 lucene.net, P5 2.0.0.4, P6 45f31baa, P7 893, P8 0, P9 system.nullreferenceexception, P10 NIL.
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
An unhandled exception occurred and the process was terminated.
Application ID: /LM/W3SVC/1/ROOT
Process ID: 3072
Exception: System.NullReferenceException
Message: Object reference not set to an instance of an object.
StackTrace: at Lucene.Net.Store.FSIndexOutput.Finalize()
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Richard,
There were more errors, not sure of any of these could help figure out why it wouldn't import.
EventType clr20r3, P1 w3wp.exe, P2 6.0.3790.3959, P3 45d6968e, P4 lucene.net, P5 2.0.0.4, P6 45f31baa, P7 893, P8 0, P9 system.nullreferenceexception, P10 NIL.
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
An unhandled exception occurred and the process was terminated.
Application ID: /LM/W3SVC/1/ROOT
Process ID: 3072
Exception: System.NullReferenceException
Message: Object reference not set to an instance of an object.
StackTrace: at Lucene.Net.Store.FSIndexOutput.Finalize()
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
Hi Katy,
Your update question triggered me. How many nodes are currently in the folder? And please don't remove the lucene dll that will cause other issues.
Thanks,
Richard
We will add the lucene.net.dll back in right away, thank you for the heads up.
We have 50 nodes under the header of Oil Filters, which you can see at the link below or the image attached. The 50 nodes are category nodes of manufacturers and then under each one there are a product pages, some have 1 products, and some have 220 product pages.
The import file I set up to have in navigation (field value = 1) and then auto-publish. Then the product page is hidden from the overview manufacturer’s page (ex: http://www.ecompressedair.com/filtration/filter-elements/oil-filter-elements/abac.aspx) and then if you click on a product you don’t see all of the products under that node shown in the left side navigation, just the category node overview. (ex http://www.ecompressedair.com/filtration/filter-elements/oil-filter-elements/abac/abac-9056113-spin-on-oil-filter-replacement-.aspx)
The image shows the overview page of the 50 nodes. It's 3 levels in from the homepage. I first imported about 30 of the manufacturer's nodes using the import file. Then I import each manufacturer's individual products under the node. There were about 950 product pages in total that we’re added under the Oil Filter category as a whole.
Live Website Link: http://www.ecompressedair.com/filtration/filter-elements/oil-filter-elements.aspx
You can download the import excel file that I use and the field mappings. It's the same as all the other ones we've done and have no problems before getting these errors. I use the .xlxs and then save as a .csv to import.
Import File Download: www.ecompressedair.com/images/oil-filters-import-example.xlsx
Hi Katy,
Thanks for sharing the info. My guess is that you don't have this many nodes on your development machine? Or that your dev machine doesn't have much load. The problem is that you're having a lot of nodes and now the Umbraco API (which gets slower with a lot of nodes) gets in the way.
You've already devided products by category so that's good. I would do 2 things:
1. Umbraco has a setting that in always updates the cache on every action. You find this setting in the UmbracoSettings file. It's called ContinouslyUpdateXmlDiskCache. Set it to False
2. Doing a publish on every document is also taking the performance down. It still needs to write the Umbraco.config file to disk every time you do that
Because both of these issues causing a lot of DISK IO I think this could be the cause of your issues. BTW This also applies for the Pro version. Only difference is that I can determine updates based on Id for you and you can schedule the imports.
Cheers,
Richard
Thank you for the ideas. I wondering if sending to publish on them all could be the problem. But I realize under the menu I can right-click on the category node and then send to publish and send all the pages in the node to publish as well. I'll try to do smaller batch uploads over a longer period of time throughout the day instead of all at once.
For the PRO version to update content would be we able to update things? For example I uploaded 2000 product pages in a similar area under individual manufacturer's nodes and it has a misspelling in the document and instead of manually fixing all 2000 we're trying to find a way to change it in the mass. Could the pro version do this?
Thanks,
Katy
Yes with a lot of nodes this will always be an issue, loads of database calls and disk IO so yes keep the batch as small as possible.
With the Prop version it's indeed possible to handle updates. When importing using the Pro version you will be asked to assign the key field of your datasource (I think in your case productId) When you uppdate the csv file and use the same product id's CMSImport knows that it already imported that product and you can choose update the document in Umbrao or skip it.
Cheers,
Richard
Is there anyway to test the Pro version to see if it will work? Like a license available for a couple days and then expires?
Below is an example of a product page that needs to be updated. In the long description box there is a misspelling with the word moister, should be moisture and ruining should be ruin. So if I made a CSV file to update this page I could put in the exact code for the correct long description paragraph along with what fields to identify where in Umbraco to make that update too?
You mentioned the Product ID's I'm not sure what field that is that relates to find the Umbraco page to update. Each product on the website has a unique Part# that is a custom field we created, not the actual Umbraco PageID. Is that what we would use to identify the page in the CMSImport? And can we update this in mass if I have all of the original files to update with all of the Part#s? So I can do each category one at a time so it's each manufacturer at a time.
URL: http://www.ecompressedair.com/filtration/filter-elements/coalescer-filter-elements/pioneer/pioneer-ec100-coalescer-filter-replacement.aspx
Part#: EC100
Umbraco Page ID: 18236
Thank you for your help. We've been trying to find something that can update content in the website in a mass without using custom API if possible.
Hi Katy,
Email me richard [at] soetemansoftware.nl for a license that you can use to try the pro version.. The Pro version can only track changes when the initial import was done with the pro version also. Because then it will add a relation between the Part Number and Umbraco Page Id in the database. You don't have to do anything for that. It will all happen automatically.
Downside for you is that you have to reimport the existing part data again because at the moment there is no relation stored between part number and Umbraco page ID and CMSIMport can't determine if it needs to insert or update the record. Or you could manually update the Mapping table of CMSImport Pro. Maybe that's better if I tell you how to do it?
Best,
Richard
is working on a reply...