performance question SFFS.listing files

No more questions - please go to http://www.syncovery.com/forum instead

Moderator: SuperFlexible Administrators

performance question SFFS.listing files

Postby lafath on Fri Jul 23, 2010 9:23 am

Hello,

I'm synchronizing two servers on different offices, connected by a vpn. Both sides have a 5000/500 kbit/sec adsl link, so the upload speeds are not very fast and are the bottlenecks.
I'm using the ExtremeSync Remote Service to build the file list on the remote side to try to speed up the "Building File Lists" step. What I'm noticing is that, on the remote side, the ExtremeSync service creates a SFFS.listing.$$$.xxxxxxxxxx file which has a size of almost 18 MB (250'000 files).
The "Progress Builing File Lists" window freezes after 20 seconds during the process in which it is waiting for remote listing and, sometimes, a "not responding" appears in the title bar.
Due to the size of the SFFS.listing.$$$ file and the link speed it takes around 6:15 minutes to transfer it, and then another 3-4 minutes to Build File List (on a 8-core Xeon server with 6 GB ram, most of it unused), after that I finally get the comparison window (working in attended mode). All in all it takes around 10 minutes to get the comparison Window).
Question: is there a way to compress the SFFS.listing file on the remote side before getting it to the SFFS running side? I simply zipped it and it went from 18 MB to 3MB, this means 6 times less to transfer it.
I don't want to enable compression for all the files, just for the listing ones, is it possible?

Many thanks,
Athos
lafath
 
Posts: 7
Joined: Fri Jul 16, 2010 5:11 am

Re: performance question SFFS.listing files

Postby superflexible on Sat Jul 24, 2010 12:35 pm

not yet but a good idea
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: performance question SFFS.listing files

Postby syncing_feeling on Sun Aug 01, 2010 12:45 pm

I don't think my listing files are nearly as big (mine are more in the 3-8MB range), but I'm interested in anything that helps with transmission times over WAN. So I too would be interested in this feature some day (ie, compressing listing files for transfer).

:D
syncing_feeling
 
Posts: 33
Joined: Wed May 05, 2010 9:14 am

Re: performance question SFFS.listing files

Postby syncing_feeling on Thu Feb 17, 2011 9:21 am

Thanks for implementing this in version 5.35. Excited to have this feature!
:D
syncing_feeling
 
Posts: 33
Joined: Wed May 05, 2010 9:14 am

Re: performance question SFFS.listing files

Postby meckerle on Tue Apr 05, 2011 2:48 am

cannot find this option in release 5.41a on windows. Where to enable ?
thx
meckerle
 
Posts: 1
Joined: Tue Apr 05, 2011 2:43 am

Re: performance question SFFS.listing files

Postby superflexible on Tue Apr 05, 2011 2:58 am

It is not an option. Listing files are always zipped if you install the new Remote Service and the new main software.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm


Return to Windows Support * new forum: www.syncovery.com/forum

cron