How to synchronize download of web content without FTP...

No more questions - please go to http://www.syncovery.com/forum instead

Moderator: SuperFlexible Administrators

How to synchronize download of web content without FTP...

Postby tamayok on Sun Jan 11, 2015 12:02 pm

Hi.

I've tried to execute a simple Profile but have not had success.

I am very familiar with setting up FTP-based profiles in Syncovery where typical paths and user credentials are required. However, this job cannot be executed with FTP (or other variants) because the user/workstation is blocked from doing such things.

The user/workstation CAN manually download public-non-password-requiring files from the target HTTP site unto the local computer. But, depending how I set Syncovery Profile, it either insists in requiring User/Password (which is inapplicable here) OR it simply finds 'no files to download' even if they are there. The problem is NOT related to file types or extensions because there are files on the site of various types.

I even tried simple 1 by 1 download profiles where I specified a single file instead of hoping it would download (all) the available sites in the web path/folder but that also failed.

###

For example, let's say I need the profile to download the non-public file below unto a folder at the local computer:

https://s.yimg.com/cd/resizer/2.0/FIT_T ... f28f20.jpg

or better yet, download (all) the files on the path:

https://s.yimg.com/cd/resizer/2.0/FIT_TO_WIDTH-w1200/
tamayok
 
Posts: 3
Joined: Sun Jan 11, 2015 11:04 am

Re: How to synchronize download of web content without FTP...

Postby superflexible on Sun Jan 11, 2015 12:26 pm

Hello,
the URL https://s.yimg.com/cd/resizer/2.0/FIT_T ... f28f20.jpg can be downloaded using the HTTP protocol and specifying https://s.yimg.com/cd/resizer/2.0/FIT_TO_WIDTH-w1200 as folder and the filename as inclusion mask: c16f72081adeca0648db179a7bf3645e73f28f20.jpg. You can specify several filenames in the inclusion masks on separate lines.

You cannot download the folder without specifying the file names, because the folder returns an 404 error:
https://s.yimg.com/cd/resizer/2.0/FIT_TO_WIDTH-w1200/
User avatar
superflexible
Site Admin
 
Posts: 2478
Joined: Thu Dec 31, 2009 3:08 pm

Re: How to synchronize download of web content without FTP...

Postby tamayok on Sun Jan 11, 2015 11:06 pm

superflexible,

Thank you VERY MUCH..!! Of course, your solution works...!!! Very happy here.
tamayok
 
Posts: 3
Joined: Sun Jan 11, 2015 11:04 am


Return to Windows Support * new forum: www.syncovery.com/forum

cron