#1  
Old 19th February 2008, 16:29
bschultz bschultz is offline
Senior Member
 
Join Date: Jul 2006
Posts: 224
Thanks: 11
Thanked 10 Times in 10 Posts
Default wget question

I've got two questions on automating a bunch of mp3 downloads. I need to download five mp3's per week. The problem is the files are placed in a directory based on the week of the year. So, for this week, the wget syntax would be

Code:
wget ftp://username:password@domain.com/week0807/*mp3
Next week, it will be:

Code:
ftp://username:password@domain.com/week0808/*mp3
Is there a way to get the directory to change in my cronjob based on what week it is?

For the second part...and I have no idea how to do this...the files I'll download all have the same name (file1.mp3, file2.mp3...) each week and I don't want to overwrite the old file. Right now, I'm renaming the files to file1.mp3.old and file2.mp3.old, and then downloading the new files.

Is there a way to only rename the old files if the server can connect to the remote FTP site? Right now (not very often, but occasionally) the files get renamed, but then my server can't connect to the remote FTP server, resulting in broken links until I can connect to the remote site.

Thanks.

Brian
Reply With Quote
Sponsored Links
  #2  
Old 19th February 2008, 17:11
topdog topdog is offline
Senior Member
 
Join Date: Jan 2008
Location: South Africa
Posts: 1,352
Thanks: 0
Thanked 154 Times in 151 Posts
Default

You should be able to write a script that keeps a counter or sentry value in a file and increments it each week after the download.

For the second part wget does not overwrite the current file unless you use the -O option, which means on download the file created will be file1.mp3.1 so your script can check that and move the old file file1.mp3 to a different name and then rename file1.mp3.1 to file1.mp3 if the download does not happen then you still have your old file1.mp3.

I have not tested this so YMMV.
__________________
----
http://www.topdog.za.net - Got Linux problems ? - I can help.
http://www.baruwa.org - Try it.
Reply With Quote
The Following User Says Thank You to topdog For This Useful Post:
bschultz (19th February 2008)
  #3  
Old 19th February 2008, 17:46
bschultz bschultz is offline
Senior Member
 
Join Date: Jul 2006
Posts: 224
Thanks: 11
Thanked 10 Times in 10 Posts
Default

Thanks for the help. Chalk one up for the stupid MAC, but I can't get wget to work on my company's OSX server. It logs in to the remote server, but can't find the mp3. I can however, use curl.

I did notice, though, that curl doesn't rename the file to file.mp3.1...so do you have any ideas for curl instead of wget?

Thanks again!
Reply With Quote
  #4  
Old 19th February 2008, 17:57
topdog topdog is offline
Senior Member
 
Join Date: Jan 2008
Location: South Africa
Posts: 1,352
Thanks: 0
Thanked 154 Times in 151 Posts
Default

Have you tried wget with --no-passive-ftp i have not used curl itself much just the php extention but i will take a look.
__________________
----
http://www.topdog.za.net - Got Linux problems ? - I can help.
http://www.baruwa.org - Try it.
Reply With Quote
  #5  
Old 19th February 2008, 18:04
topdog topdog is offline
Senior Member
 
Join Date: Jan 2008
Location: South Africa
Posts: 1,352
Thanks: 0
Thanked 154 Times in 151 Posts
Default

Actually with curl you can get funky, use a temp directory in /tmp to download the stuff then check the curl return value if its an error then don't move the files from the temp location to the actual location, if there is no error condition then move the old files out and move new from the temp location.

For inspiration you can look at the script for sanesecurity updates it uses the same logic. http://www.sanesecurity.co.uk/clamav...nesecurity.txt
__________________
----
http://www.topdog.za.net - Got Linux problems ? - I can help.
http://www.baruwa.org - Try it.
Reply With Quote
  #6  
Old 19th February 2008, 18:11
bschultz bschultz is offline
Senior Member
 
Join Date: Jul 2006
Posts: 224
Thanks: 11
Thanked 10 Times in 10 Posts
Default

no passive didn't work...still couldn't find the file. I'll look into the file you linked...THANKS!
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Wget on CentOS doesn't work correctly. webking HOWTO-Related Questions 0 5th December 2007 03:29
Question from a newbie: can't login on proftpd Chris_elmp Installation/Configuration 2 24th August 2007 22:36
Odd question for Falko Randy Installation/Configuration 1 16th October 2006 15:58
sendmail config question westb Server Operation 1 1st September 2006 18:00
Really Basic Question !!! brainz Installation/Configuration 7 14th March 2006 00:20


All times are GMT +2. The time now is 02:21.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2014, vBulletin Solutions, Inc.