Large Amount of Data 75GB

No more questions - please go to http://www.syncovery.com/forum instead

Moderator: SuperFlexible Administrators

Large Amount of Data 75GB

Postby DukeOfAwesome on Fri Jan 14, 2011 9:16 am

Hi,

The Super Flexible File Synchronizer looks as though it's exactly what we're after, but I can't find any information about extreme amounts of data like 75GB being off site.

What we are trying to do is pretty simple and that is have a copy of our data offsite at another location but obviously don't want to sync 75GB over an ADSL connection.

I was wondering whether we can make a copy of the data on a hard disk, take it to the other location and save it to a machine on the network. Will the Super Flexible Software see that the sync location has a copy of the data or will it try and still copy the whole 75GB across?

I hope I've explained myself well... :)

Any help would be most appreciated...

Duke
DukeOfAwesome
 
Posts: 2
Joined: Fri Jan 14, 2011 9:09 am

Re: Large Amount of Data 75GB

Postby superflexible on Fri Jan 14, 2011 9:37 am

Yes that can be done. The program always gets the list of files from source and destination and compares it before copying anything.

Depending on the type of connection, such as VPN or FTP, there can be ways to speed up the building of the file list. This may be necessary if you have a lot of folders. With FTP, the latest versions of the program will try to get a recursive listing. With normal Windows networking over a VPN, you can install the "ExtremeSync Remote Service" on the remote end to help generate a fast file listing.

See also http://www.superflexible.com/docs.htm.

If you are using FTP or other Internet protocols, you also need to test if keeping the uploaded files' modification dates works. Some servers do not allow it, in which case you may have to resort to Filename Encoding (see the Versioning tab sheet).

You can save some bandwidth by turning on the Zipping functionality. For mirroring purposes, please choose "ZIP Each File Individually". You can also copy several files in parallel. Over the Internet, between 3 and 10 files in parallel may be OK depending on the protocol used. The number can be specified on the Files tab sheet.

Finally, as an alternative to the last paragraph, you could use "ZIP Packages" with several files in each zip file, and have them unpacked on the destination machine with the ExtremeSync Remote Service. Then you can only copy 1 in parallel. See also http://www.superflexible.com/remoteservice.htm.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: Large Amount of Data 75GB

Postby DukeOfAwesome on Fri Jan 14, 2011 10:04 am

Thanks for the quick reply.

One other question. Do I need a copy of the application at both sides, eg, one at the source and one at the destination or do I need just one copy at the source?

Thanks in advance...

Duke
DukeOfAwesome
 
Posts: 2
Joined: Fri Jan 14, 2011 9:09 am

Re: Large Amount of Data 75GB

Postby superflexible on Fri Jan 14, 2011 10:24 am

Only one at the source.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: Large Amount of Data 75GB

Postby d033e22ae348aeb5660fc2140aec35850c4da997 on Wed Jan 19, 2011 2:43 pm

We have several customers that have transferred over 100 gb of data. Depending on the speed it took between 1 to 2 weeks. We copy it over ssh so you are limited by the protocol itself but it is very secure. We use the remote service and copy 3 files at a time and it does complete the job very smoothly.

I have one customer that has Comcast internet and 60 gb took 4 days only.
User avatar
d033e22ae348aeb5660fc2140aec35850c4da997
Site Admin
 
Posts: 28
Joined: Mon Dec 15, 2008 2:47 pm
Location: Chicago, IL


Return to Windows Support * new forum: www.syncovery.com/forum

cron