I am noticing this issue, the importer is only running for 20 minutes give or take and then the following error is thrown and no more data is inputted. I tried researching on this error in general but it didn't get me anywhere.
Please note that I am running the latest version of CMSImport. Also this is a scheduled import.
Thanks for your help
Error below:
CMSImport:Error during import
MySql.Data.MySqlClient.MySqlException (0x80004005): Fatal error encountered during data read. ---> MySql.Data.MySqlClient.MySqlException (0x80004005): Reading from the stream has failed. ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host. ---> System.Net.Sockets.SocketException: An existing connection was forcibly closed by the remote host
at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
--- End of inner exception stack trace ---
at MySql.Data.Common.MyNetworkStream.HandleOrRethrowException(Exception e)
at MySql.Data.Common.MyNetworkStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at MySql.Data.MySqlClient.TimedStream.Read(Byte[] buffer, Int32 offset, Int32 count)
at System.IO.BufferedStream.Read(Byte[] array, Int32 offset, Int32 count)
at MySql.Data.MySqlClient.MySqlStream.ReadFully(Stream stream, Byte[] buffer, Int32 offset, Int32 count)
at MySql.Data.MySqlClient.MySqlStream.LoadPacket()
at MySql.Data.MySqlClient.MySqlStream.LoadPacket()
at MySql.Data.MySqlClient.MySqlStream.ReadPacket()
at MySql.Data.MySqlClient.NativeDriver.FetchDataRow(Int32 statementId, Int32 columns)
at MySql.Data.MySqlClient.ResultSet.GetNextRow()
at MySql.Data.MySqlClient.ResultSet.NextRow(CommandBehavior behavior)
at MySql.Data.MySqlClient.MySqlDataReader.Read()
at MySql.Data.MySqlClient.MySqlDataReader.Read()
at CMSImportLibrary.Providers.ImportProviders.Content.ContentImportProvider.(ImportState , Int32 , ImportStatistics , String )
at CMSImportLibrary.Providers.ImportProviders.Content.ContentImportProvider.Import(ImportState state, ImportOptions importOptions, ImportStatistics importStatistics)
at CMSImportLibrary.Import.ImportProviders.(ImportState , ImportOptions , ImportStatistics , DataProvider )
Thanks for your fast reply really appreciate it. Do you have a clue how long the timeout should be? I have about 9000 records to import.
Also, I was talking to my college and he had the same issue and after talking with you, you did something like changing the data reader so that everything is imported at once and not batch by batch? Is this doable on the newest version of CMSImport?
To be honest I don't know which option is better between changing the timeout or changing the data reader. My fear is that if I increase the timeout it will still not be enough and the same error happens again.
I was not refering to the timeout option but to the option of the data reader importing everything at once and not batch by batch as said in my previous comments. Isn't that something from the cmsimport side, i.e. how it works? To my collegue you had given him another version of the cmsimport and mysqlprovider to install, but I don't know if such changes were carried over to the latest version of cmsimport.
It would be great if you could give more info on this.
Thanks for your quick reply. So theoratically if I install that, since this latest version works a bit different I should not have the error mentioned in my first comment?
The thing is I have installed the latest version of cmsimport including the mysqlprovider from nuget two weeks ago, but I don't know if the packages on nuget are the latest version ones. Can you please confirm? If they are not can you please update it, since I prefer to install any packages through nuget rather than umbraco.
Let me know accordingly please.
For the millionth time thanks a lot for you support, appreciate it :)
Yes I have understood that and didn't question it. Have you seen my latest comment by any chance?
Basically what I have asked in it, is if the nuget packages are updated to the latest version? Especially the one of the mysqlprovider.
Because if I am understanding right if I have the latest version installed I should not be encountering such error, since in such latest version you should have changed how the data reader works, i.e. by importing everything all at once rather than batch by batch, (something along these lines). The thing is I have installed the latest version of cmsimport including the mysqlprovider from nuget two weeks ago, but I don't know if the packages on nuget are the latest version ones. Can you please confirm? If they are not can you please update it, since I prefer to install any packages through nuget rather than umbraco.
Let me know accordingly please.
For the millionth time thanks a lot for you support, appreciate it :)
That is an option, but since I have it already installed through nuget, that would mean that first I will have to uninstall it, thus I will loose all the import definitions that I have already created and basically start from scratch. To be honest I was trying to avoid that. But if it fixes the issue I will see what I can do.
My question is if I have the latest version installed correctly, since this latest version works a bit different, theoratically I should not have the error mentioned in my very first comment. Am I correct or I am asuming wrong?
ERROR - Reading from the stream has failed
Hi Everyone,
I am noticing this issue, the importer is only running for 20 minutes give or take and then the following error is thrown and no more data is inputted. I tried researching on this error in general but it didn't get me anywhere.
Please note that I am running the latest version of CMSImport. Also this is a scheduled import.
Thanks for your help
Error below:
CMSImport:Error during import MySql.Data.MySqlClient.MySqlException (0x80004005): Fatal error encountered during data read. ---> MySql.Data.MySqlClient.MySqlException (0x80004005): Reading from the stream has failed. ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host. ---> System.Net.Sockets.SocketException: An existing connection was forcibly closed by the remote host at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags) at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size) --- End of inner exception stack trace --- at MySql.Data.Common.MyNetworkStream.HandleOrRethrowException(Exception e) at MySql.Data.Common.MyNetworkStream.Read(Byte[] buffer, Int32 offset, Int32 count) at MySql.Data.MySqlClient.TimedStream.Read(Byte[] buffer, Int32 offset, Int32 count) at System.IO.BufferedStream.Read(Byte[] array, Int32 offset, Int32 count) at MySql.Data.MySqlClient.MySqlStream.ReadFully(Stream stream, Byte[] buffer, Int32 offset, Int32 count) at MySql.Data.MySqlClient.MySqlStream.LoadPacket() at MySql.Data.MySqlClient.MySqlStream.LoadPacket() at MySql.Data.MySqlClient.MySqlStream.ReadPacket() at MySql.Data.MySqlClient.NativeDriver.FetchDataRow(Int32 statementId, Int32 columns) at MySql.Data.MySqlClient.ResultSet.GetNextRow() at MySql.Data.MySqlClient.ResultSet.NextRow(CommandBehavior behavior) at MySql.Data.MySqlClient.MySqlDataReader.Read() at MySql.Data.MySqlClient.MySqlDataReader.Read() at CMSImportLibrary.Providers.ImportProviders.Content.ContentImportProvider.(ImportState , Int32 , ImportStatistics , String ) at CMSImportLibrary.Providers.ImportProviders.Content.ContentImportProvider.Import(ImportState state, ImportOptions importOptions, ImportStatistics importStatistics) at CMSImportLibrary.Import.ImportProviders.(ImportState , ImportOptions , ImportStatistics , DataProvider )
Hi Fabian
Connection is closed to MySql server. Increase timeout please
Best,
Richard
Hi Richard,
Thanks for your fast reply really appreciate it. Do you have a clue how long the timeout should be? I have about 9000 records to import.
Also, I was talking to my college and he had the same issue and after talking with you, you did something like changing the data reader so that everything is imported at once and not batch by batch? Is this doable on the newest version of CMSImport?
To be honest I don't know which option is better between changing the timeout or changing the data reader. My fear is that if I increase the timeout it will still not be enough and the same error happens again.
What do you think please?
Thanks
That option is implemented in the latest versions of the MySql provider. Not sure how much you need to increase since I'm not a MySql pro.
But try and see how it works out?
Best,
Richard
Hi Richard,
How do you enable that option if I may ask? I went through the settings and couldn't find such option.
Thanks
Hi Richard,
Any news on the above please?
Thanks
I don't know MySql that good but should be somewhere. best to ask google :)
Hi Richard,
I was not refering to the timeout option but to the option of the data reader importing everything at once and not batch by batch as said in my previous comments. Isn't that something from the cmsimport side, i.e. how it works? To my collegue you had given him another version of the cmsimport and mysqlprovider to install, but I don't know if such changes were carried over to the latest version of cmsimport.
It would be great if you could give more info on this.
Thanks
There is no option for that. It's in the latest MySql provider which can be foudn at http://soetemansoftware.nl/cmsimport/downloads
Best,
Richard
Hi Richard,
Thanks for your quick reply. So theoratically if I install that, since this latest version works a bit different I should not have the error mentioned in my first comment?
The thing is I have installed the latest version of cmsimport including the mysqlprovider from nuget two weeks ago, but I don't know if the packages on nuget are the latest version ones. Can you please confirm? If they are not can you please update it, since I prefer to install any packages through nuget rather than umbraco.
Let me know accordingly please.
For the millionth time thanks a lot for you support, appreciate it :)
Any news on the above Richard please?
Thanks
Hi Richard,
Sorry to bother you again, but would love to see what are your thoughts on my previous comment.
Thank you very much
See my last answer, there is no option.
Hi Richard,
Yes I have understood that and didn't question it. Have you seen my latest comment by any chance?
Basically what I have asked in it, is if the nuget packages are updated to the latest version? Especially the one of the mysqlprovider.
Because if I am understanding right if I have the latest version installed I should not be encountering such error, since in such latest version you should have changed how the data reader works, i.e. by importing everything all at once rather than batch by batch, (something along these lines). The thing is I have installed the latest version of cmsimport including the mysqlprovider from nuget two weeks ago, but I don't know if the packages on nuget are the latest version ones. Can you please confirm? If they are not can you please update it, since I prefer to install any packages through nuget rather than umbraco.
Let me know accordingly please.
For the millionth time thanks a lot for you support, appreciate it :)
Can you just install the normal Umbraco package? i think Nuget is updated but then i',m sure
That is an option, but since I have it already installed through nuget, that would mean that first I will have to uninstall it, thus I will loose all the import definitions that I have already created and basically start from scratch. To be honest I was trying to avoid that. But if it fixes the issue I will see what I can do.
My question is if I have the latest version installed correctly, since this latest version works a bit different, theoratically I should not have the error mentioned in my very first comment. Am I correct or I am asuming wrong?
You don't need to uninstall, just install on top and it's just to check.
Ok Richard, let me give it a try and see if the same error occurs, will let you know accordingly, thanks.
It didn't work unfortunately Richard, same error, I am going to try and increase the timeout and see if that works...
is working on a reply...