S3/FTP Real Time Sync

[Luc23]

Hey Tobias!

I'm having some difficulties figuring out the best way to make SFFS 4.89 do what I need it to. I have an S3 bucket that I need synced with a local folder on my file server. Actually I need SFFS to look for changes in S3 and copy/delete or move them locally. The thing is that I want this running 24/7 real time.

As you know, SFFS barks at me when I set this up with real time sync and it only looks for changes when I manually start the profile. I could also make this work via FTP by attaching the S3 bucket to an EC2 instance, but it has the same problem with FTP as it does with S3.

Is there a way to get around this? If not, is there another way I can get close to what I need? Maybe running multiple profiles or something.

Thanks!

[superflexible]

Hello,

currently the only way to get changes from S3 or FTP is by specifying a regular schedule. For example, you could schedule it to run every X minutes to get a near real-time performance.

[Luc23]

That should work good enough for now. Do you think real time sync for S3 is something that might be implemented down the road?

And thank you for developing and supporting such a great app! I can't believe how much value it has built in it!

[superflexible]

Hello,

yes I will look into real-time features for S3, but they will have to involve regular polling of the S3 server. But not full scans like it is now.

[Luc23]

One question on scheduling every X minutes. If I have it set to run every 5 minutes, I asusme that the clock starts ticking for the next cycle at the completion of the last job, right? I just don't want it piggy-backing on itself if it takes longer than 5 minutes to run.

BTW, nice job on getting your software in mupromo.com! I wish I knew about this when I bought my software. Could have saved 20 bucks on a Windows license. How does a combo license work anyways? You still can only have it running on 1 machine, right? Or does it allow you to run on 1 Windows box and 1 Mac box?

[superflexible]

Hello,

I had to correct this reply - yes on Windows, you can see that the color of the tray icon changes when a job runs, as well as get a balloon info. You can turn off the balloons by right-clicking the tray icon.

With the Combo license, theoretically you should use it only on one machine/operating system at a time but I'm not too strict about that.

[Luc23]

Well Tobias, its still not working quite right. I am trying to run this profile every 5 minutes, but it doesn't seem to look for changes. I can manually make the profile run Unattended or Attended, but it will just work correctly that first time. It will then show that its going to check every 5 minutes. It indeed seems to actually do that, but it never moves any additional files after it ran manually.

I've tried the Run in Background thing too. Any ideas?

[superflexible]

Hello,

you need to go to the Scheduler tab sheet and start the scheduler. Then you need to watch what it does. You should see that it runs the job every 5 minutes. In fact since you are on Windows you may see a balloon pop up in the tray. You can turn that off by right-clicking the tray icon.

[Luc23]

I've had the scheduler running. All it does when it is time to run is just update the Next Run time to 5 minutes later. It never syncs new data unless I have it run in Attended/Unattended mode. -Edit- I should also say that the profile shows that it was Last Run the last time I manually started it. This field is not updated. I suppose I'll try recreating this profile from scratch and deleting this one.

And it also seems to leave 1 folder behind when I do have it run in unattended/attended mode. How do I make it move everything?

[superflexible]

You need to look at log files. Logging can be activated on the Program Settings dialog. I don't know if you can make it clear everything on the source side. If a folder already exists on the destination, it might be left on the source. But make sure you click "Configure" for the Move Files mode and choose the second radio button in the pop-up dialog.

On the Folders tab sheet, make sure to check "Remove Folders That Were Emptied".