Slow scanning

No more questions - please go to http://www.syncovery.com/forum instead

Moderator: SuperFlexible Administrators

Slow scanning

Postby Dpeach on Wed Feb 15, 2012 9:16 am

I have a exact mirror job set up for a storage migration project. I am have ben running it nightly for a couple of weeks now. The folder contains user home shares and has about 900,000 files and about 700GB of data.

The nightly incremental run copies on average 100GB of data and moves about 1000 files. It takes between 6 and 8 hours to complete, regardless of the amount of data to be moved. I need to find a way to get the time down to a couple of hours so that we can do a final synch on cutover night without taking the file server down for 8+ hours. (I have several other file shares on the host that get synched as well.). i am running the SFFS on the fileserver with SAN based storage and copying to a CIFS share destination on another SAN on the same fabric.

Any suggestions on speeding up the file scanning process? I have looked at the suggestions in the FAQ and all of the suggested options that are applicible are configured already.
Dpeach
 
Posts: 2
Joined: Wed Feb 15, 2012 8:34 am

Re: Slow scanning

Postby superflexible on Wed Feb 15, 2012 9:22 am

Try to turn off "Cache Destination File List" on the Special tab sheet. For local copying, it can slow down rather than speed up.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: Slow scanning

Postby Dpeach on Mon Feb 20, 2012 4:04 pm

That got the duration of the Users Home share synch to about 4 hours. Is there anything else I can do to speed up the file scanning process?

Thanks
Dpeach
 
Posts: 2
Joined: Wed Feb 15, 2012 8:34 am

Re: Slow scanning

Postby superflexible on Wed Feb 22, 2012 4:20 am

That is quite unusual. Either the SAN is not up to speed, or something else is slowing it down.

Try not using any checkmarks on the "Special" tab sheet.

In addition, under Comparison->More, try not having any checkmarks there.

Finally, if you could break up the job into a few parts, these could run in parallel and maybe that would save time. You can use the "Save As" button to duplicate the job. Use different base folders for each part, or use "Selected Subfolders". Note however, that a subfolder selection will not automatically include new folders on the top level. Future subfolders of selected folders will be included, but future folders on the same level where folders have been deselected will not be included.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm


Return to Windows Support * new forum: www.syncovery.com/forum

cron