l i n u x - u s e r s - g r o u p - o f - d a v i s
Next Meeting:
July 7: Social gathering
Next Installfest:
Latest News:
Jun. 14: June LUGOD meeting cancelled
Page last updated:
2001 Dec 30 16:58

The following is an archive of a post made to our 'vox-tech mailing list' by one of its subscribers.

Report this post as spam:

(Enter your email address)
Re: [vox-tech] wget question
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [vox-tech] wget question

  • Subject: Re: [vox-tech] wget question
  • From: Ted Deppner <ted@MAPSpsyber.com>
  • Date: Sun, 12 Nov 2000 10:09:47 -0800
  • References: Pine.LNX.4.21.0011110845010.1445-100000@belial.ucdavis.edu

On Sat, Nov 11, 2000 at 08:53:24AM -0800, Peter Jay Salzman wrote:
> i tried:
>       wget -r http://www.quakeiii.com/files/ftp.cgi?dir=maps
>       wget -r http://www.quakeiii.com/files/file.cgi?file=maps
> which doesn't work, and i suppose it shouldn't since it's expecting
> arguments to a cgi program, not URLS, and wget only gets URLS.

wget will get anything.  by default, it only follows straight URLs.  You
can turn on behavior to follow things that look like cgi.

I automated mp3.com grabbing to grab all the mp3s for an artist.  Through
lots of perl regexs and the like, I send the following url to wget, and it
works just fine.


Note that this results in a 302 redirect from mp3.com, which wget handles

quakeiii.com may also be checking for a "valid" user client...  so turning
on the option to look like a Mozilla browser may be necessary.

wget -m (mirror behavior) may also help.

Ted Deppner

LUGOD Group on LinkedIn
Sign up for LUGOD event announcements
Your email address:
LUGOD Group on Facebook
'Like' LUGOD on Facebook:

Hosting provided by:
Sunset Systems
Sunset Systems offers preconfigured Linux systems, remote system administration and custom software development.

LUGOD: Linux Users' Group of Davis
PO Box 2082, Davis, CA 95617
Contact Us

LUGOD is a 501(c)7 non-profit organization
based in Davis, California
and serving the Sacramento area.
"Linux" is a trademark of Linus Torvalds.

Sponsored in part by:
Sunset Systems
Who graciously hosts our website & mailing lists!