Real-time sync with remote storage - optimal settings

No more questions - please go to http://www.syncovery.com/forum instead

Moderator: SuperFlexible Administrators

Real-time sync with remote storage - optimal settings

Postby Alexander on Mon Feb 06, 2012 4:56 pm

Hello!

I sync a lot of data with remote storage (initially tried Google Docs but due to its limitations switched to Amazon S3).

The desired behavior is:
1. To sync any changes in local (or network) folder with remote storage in realtime, incl. deletions. No changes on remote side need to be monitored though, as the only program that modifies data there is SFFS itself.
2. To preserve last modification times of all files.
3. To reduce the amount of requests to Amazon S3 (as there is a fee for requests, and though it is very small, re-reading thousands of folders on every sync might cost quite a bit of money).
4. To resume sync gracefully if access to local folder or remote storage is interrupted. I run SFSS on my laptop, and most synced folders are on removable ot network drives which are not always available, as well as Internet access.
Basically, I want SFSS to act as a Dropbox replacement with S3 storage & multiple folder support.

In order to achieve this result, I set the settings shown in the attached screenshots (I combined 15 screenshots in 3 PDF files for convenience).
However, the following problems persist:
1. The files are not deleted from the remote side. Never.
2. If I make changes to the source folder while the profile is already running (after building file list & before finishing sync), these changes are not reflected in remote storage until I manually run the profile.
3. Moved files within the source folder are not detected and are uploaded once again instead, although their last modification times hadn't changed after moving.

Please help me, what setting did I miss or set incorrectly, and how can I achieve the desired sync behvior?
Thanks in advance, I understand that examining 15 screenshots is a very time consuming task, but I tried a dozen of settings before writing here with no success so far.
Attachments
ssfs3.pdf
(176.61 KiB) Downloaded 100 times
ssfs2.pdf
(254.25 KiB) Downloaded 84 times
ssfs1.pdf
(225.2 KiB) Downloaded 85 times
Alexander
 
Posts: 28
Joined: Fri Nov 04, 2011 2:39 am

Re: Real-time sync with remote storage - optimal settings

Postby superflexible on Wed Mar 07, 2012 3:41 pm

The settings are pretty good! Except under Safety->Unattended Mode, I recommend to also select "Overwrite Larger Files With Smaller Ones If File Dates Require It".

The file deletions are delayed by 10 minutes due to the Safety Delay on the Real-Time Settings dialog. But after 10 minutes, they should occur.

To analyze which real-time events have been received and how they are processed, we need to take a look at log files. For example, if you can make a controlled test for one of these issues and then immediately look at the last few logs, then you can see what the program does and why. You can also send logs to support@superflexible.com so I can take a look.

It could be that the deletions work better without the safety delay. Many customers set it to 0 on the Real-Time Settings dialog.

In addition to real-time, you also need a regular schedule such as every 1 hour or once during the night in order to verify if any changes habe been missed in real-time.
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: Real-time sync with remote storage - optimal settings

Postby Alexander on Wed Mar 07, 2012 11:09 pm

Thanks a lot for your advice. Combining real-time sync with regular schedule especially looks like a solution to my problem with "missed" changes. I'll try everything you pointed out.
Alexander
 
Posts: 28
Joined: Fri Nov 04, 2011 2:39 am


Return to Windows Support * new forum: www.syncovery.com/forum

cron