Hi Heather,

I haven't seen that before. It seems like there are two data types with the same name on one of the sites. I didn't think that was possible, but that's what the error is indicating.

If you can't see anything obvious then I'll add some extra logging and release a new version.

Stuart.

Hi Stuart, Thanks for your reply.

Amazingly, I found two datatypes in the source site with the same name. (So, I guess it's possible after all.) I added "2" to the end of one of each to makes the names unique.

This is a v7.6.3 site which I have only now started working with, for this migration. There is a lot of cruft which needs to get cleaned up, but I was hoping to push it all into v8 before dealing with the cleanup effort.

Originally, I was trying to get it directly into the existing v8 site, but then figured perhaps that was too much complexity for Converge to deal with, and set up a fresh, empty v8.14.0 site to "import" into first - then I could perhaps pull it from that temp v8 site into the final destination site.

Also, I thought it might make sense to "upgrade" the 7.6.3 site to 7.15.7 via regular Umbraco methods before attempting the Converge transfer (That was when I got the error message posted above). After I got that message, I wondered if the result would be better if I instead rolled back to the original 7.6.3 version and used the Converge API-only on that site.

After fixing the names of the Datatypes, I ran it again, but now the red error is:

Converge Error: Could not get the site details from the remote site. Please try again or try using 'Browser Fetch' (or a service like ngrok) for non-public sites, e.g. localhost.

As mentioned, these are both running on Local, with their own hostnames.

The detailed exception mentioned the real reason:

System.Net.WebException: The operation has timed out
   at System.Net.WebClient.UploadDataInternal(Uri address, String method, Byte[] data, WebRequest& request)
   at System.Net.WebClient.UploadString(Uri address, String method, String data)
   at Com.StuartMullinger.Converge.Controllers.ConvergeProcessor.CompareContentServerFetch(RemoteSiteDetails details, String localUrl)

So I updated the "Timeout" config in the destination site to "5000". It's now running again. It's made it to the "Comparing sites..." stage, so I am hopeful.

Glad you're making progress, and thanks for introducing me to the word "cruft" :)

Ouch, 40 minutes, that sounds like a big site. I've never seen it take more than a couple of minutes.

Looks like it's a problem with a data type that uses the "Umbraco.UploadField" property editor - probably the "Upload" data type, unless you have created any others. Are any of the rows "ErrorMerging", highlighted in red?

Think I've spotted it, looks like the new Media Picker has caused some changes to the Upload data type in v8.14. I'll take a look at updating Converge.

As the compare takes so long it may be worth doing the merge gradually, setting each section to "Ignore" and then merging one at a time. This is the order you should try.

Templates Data Types Document Types Media Types Content Content Templates Media Dictionary Items Macros Media Files Update References Delete Content Delete Content Templates Delete Media Delete Document Types Delete Media Types Delete Data Types Delete Templates Delete Dictionary Items Delete Macros

• Templates
• Data Types
• Document Types
• Media Types
• Content
• Content Templates
• Media
• Dictionary Items
• Macros
• Media Files
• Update References
• Delete Content
• Delete Content Templates
• Delete Media
• Delete Document Types
• Delete Media Types
• Delete Data Types
• Delete Templates
• Delete Dictionary Items
• Delete Macros

(hopefully clearer!)

Thanks for the tip!

Yes, - a lot were listed as "MergeError". I might try to clear some of the junk from the v7 site before attempting the import.

In order to keep moving forward with this, I set up a new empty v8.13.1 site as the "destination" for the imported data.

This seems to be working better - I am able to connect and do some merging.

As per your recommendation, I started working with individual categories of entities. I was able to merge in all the DataTypes without issue (the resulting list is all white), but then if I compare again, leaving the "DataTypes" showing, I now see several reddish "Difference" lines in the DataTypes list. It appears to be Content and Media pickers which are now showing "Difference" (specifically it shows the "Configuration" text as different)

Also, checking the log, I saw a bunch of exceptions related to MacroPartials:

Error reading file: "~/Views/MacroPartials/SomeFile.cshtml"

Exception
System.ArgumentNullException: Value cannot be null.
Parameter name: stream
   at System.IO.StreamReader..ctor(Stream stream, Encoding encoding, Boolean detectEncodingFromByteOrderMarks, Int32 bufferSize, Boolean leaveOpen)
   at System.IO.StreamReader..ctor(Stream stream)
   at Com.StuartMullinger.Converge.Helpers.ContentAnalyser.GetMacros()

I copied the entire Views folder over to the new site, since it seems that some files were missing (perhaps "Macros" should be near the top of the list for order of import?)

All the Doc Types and Media Types are displaying white, but when I try to merge in the Content, every item is showing "ErrorMerging"

Converge error when merging content.

Exception
System.InvalidOperationException: No PropertyType exists with the supplied alias "hideBottomNavigation".
   at Umbraco.Core.Models.ContentBase.SetValue(String propertyTypeAlias, Object value, String culture, String segment)
   at Com.StuartMullinger.Converge.Comparers.ContentComparer.SetValue(ContentModel remoteContent, PropertyModel remoteProperty, PropertyValue remotePropertyValue, IContent umbracoContent, MergeResult result)
   at Com.StuartMullinger.Converge.Comparers.ContentComparer.MergeContent(ContentModel remoteContent, String key, Int32 currentUserId)
   at Com.StuartMullinger.Converge.Controllers.ConvergeProcessor.MergeContent(MergeParameters keys)

A spot check shows that there ARE Doctypes with that property... some more details about which Content item or specific Doctype is causing the failure would be helpful. Also, considering that the Doctypes are Equal between sites, the only thing I can figure is that at some point a certain Doctype HAD that property, then it got deleted from the DocType, but the Content still has reference to the property data in the database?

Just working on the media picker changes for 8.14.0 now. Last full test I ran was on 8.13.0. Can you copy the "Configuration" text (both remote and local) and post here. I'd be interested in seeing what the actual differences are.

For the Macros, the files should get created at the same time as they are created on the database. That looks like they can't be found during the compare. Are they "Equal" now that you've copied them manually? Does the "File Content" show when you expand one?

Suspect you are right with your reasoning on the hideBottomNavigation error. I'll add some more refined logging to the 8.14.0 update and catch that particular error to make sure.

On the macros, in looks like the ScriptPath is null on one of the macros, which throws the error and then stops the processing for the rest.

This is the "MVC Partial view" field in the Macro editor in the back office (or XSLT if that is populated). It is valid to leave it blank, and in my tests this has always returned an empty string, which didn't cause this problem.

I have added a fix so it will treat null as the empty string, which will be in the next release.

In the meantime you could either remove the macro(s) concerned, or give them a script.

For the content and media pickers, I think the start node is causing the difference. Rather than compare the StartNodeIds directly Converge looks up the path and name and compares them. This allows the guids to differ, even if they represent the same content/image.

As the content/media doesn't yet exist locally it is showing the difference. When the content and media are created (we can hope!) then the data types will be considered equal.

Hi again, Stuart,

I got the Macro issue fixed, and those all finished importing corerectly.

I was able to delete about 50% of the source site's Content nodes which were no longer needed, but that issue with the "hideBottomNavigation" is still preventing any import of Content nodes...

Yep, have been testing the new release which will fix that (or at least tell you the name of the problem content). It'll also resolve the Media Picker issues for v8.14.0. Should get it out this weekend.

Hi again Heather,

That's v8.0.11 of Converge available now, with the fixes as discussed. Let me know how you get on.

Stuart.

Glad you've made progress Heather, thanks for persevering. I can see that export would be useful - I'll add it to my to-do list.

Hi Stuart, I wanted to update you on my progress.

I was able to get almost all of the the large v7 data imported into an empty v8.13.1 site. There were some MergeErrors - but it might be due to corruption or other issues. It's enough for my satisfaction, since we can manually check/fix those relatively few.

The next portion of the import is to get that data imported into a smaller already-existing v 8.14.0 site. Running converge from inside the existing v8 site, I was able to do the Compare, and import the "schema" items (DataTypes/Doctypes/Macros/Templates, etc.) But when I set it to import the Content and Media, it ran for quite some time, but then the progress message stopped updating - it seemed to be stuck on a single Content item for several hours. I stopped it and checked the "Content" area - I saw that some of the Content nodes were imported (they were displaying as unpublished), but not all. I tried running it again, and it got stalled on a different Content item.

I then thought perhaps it would be more expedient to attempt to import the smaller dataset into the larger (upgraded) database, so I ran Converge from the other site, pulling in the data from the "existing" site. That has been running for over an hour now, and the progress message says "Merging document types..." and has said that for a long time. I'm not sure if it is still working or if it has frozen.

Checking the log (in a different tab, so the Converge screen is still active), I see entries every few seconds being logged in pairs:

"Loading content from database"
"Completed." 
"Loading media from database"
"Completed."
... etc.

These messages are coming from Umbraco.Web.PublishedCache.NuCache.PublishedSnapshotService

So... I guess it's still running. Perhaps the UI is just not updating for some reason.

For the SQLCE lockout issue, Converge is just using the Umbraco API to create the content and media, so I can't update that code. If you want to try the connection string updates then it is just the umbracoDbDSN connection string in Web.config. I suspect it's all just a bit too much for SQLCE as it is bombarding it with SaveAndPublish requests one after the other.

In the future I'd quite like to add a "create content as unpublished" setting as I think that is a lot less work. You'd then need to manually publish the content afterwards.

For the Json reader error, it looks like the converter I introduced for the new Media Picker isn't doing its job.

What value do you see for the remote property in Converge after the compare (expand the content)?

I'd expect to see something like this:

[{"mediaKey":"a7856d78-3c9d-4841-ac52-4f9ad58b372a","crops":[],"focalPoint":{"left":0.5,"top":0.5}}]

(or blank where no media has been selected).

Ah, that sounds like it. I'll take a look tomorrow.

is working on a reply...