wget for Mac OS X Leopard
July 30th, 2008Three years ago I compiled a version of the ‘wget’ utility so that it would run under Mac OS X and uploaded it to Status-Q. It’s had an amazing number of downloads, and I felt it was probably time to update it!
So here is a shiny new wget.zip, which contains the following:
- the wget binary
- the wget.1 man page
- the default wgetrc configuration file
- A README file telling you a bit more.
The main changes from the original version are:
- it’s a universal binary
- it’s the latest version of wget (1.11.4)
- it’s compiled on 10.5.4 and may possibly not work on older versions - please let me know in the comments if it does!
Hope it’s useful! Here’s some more of my Apple-related posts, or you could always just subscribe to the blog - here’s the RSS feed !
July 30th, 2008 at 11:25 pm
Most people know the simple use of wget:
wget [url]
to download whatever’s at [url]
But Jeff Veen’s post gives a nice example of just how powerful it can be…
http://www.veen.com/jeff/archives/000573.html
July 31st, 2008 at 8:51 am
It does not work on 10.4.11. Error message recieved is:
—
$ wget
dyld: Symbol not found: _fnmatch$UNIX2003
Referenced from: /usr/local/bin/wget
Expected in: /usr/lib/libSystem.B.dylib
Trace/BPT trap
—
Guess I’ll have to run this over on my Leopard machine…
July 31st, 2008 at 4:29 pm
Thanks for the download. (I suppose the traffic will be high today because there are all kinds of links to your site going on right now.)
August 3rd, 2008 at 9:38 pm
Newb alert! Everything installed OK, but I can’t seem to find a way to create an executable script to call wget commands in mac. I could do a batch script for wget in windows, but I’m blind on my new mac.
I tried to have Automator do this but no luck:
do shell script “wget htttp://thisismydesiredurl.com”
Terminal responds to manually typing in “wget htttp://thisismydesiredurl.com”, but I am in search of a way to launch the command via GUI/Finder as AppleScript or clickable file. What am I missing?
August 5th, 2008 at 9:05 pm
Awesome! thanks for porting this over to mac
August 5th, 2008 at 9:40 pm
Great job! thanks
August 6th, 2008 at 5:44 pm
[...] Oh und damit ich’s nicht vergesse, downloaden kann man sich das nette Progamm hier. [...]
August 8th, 2008 at 3:04 pm
Thanks!
August 23rd, 2008 at 5:27 pm
Thank you for sharing this distribution of the wget code for mac os X
Regards Snoop1990
August 30th, 2008 at 6:57 pm
Have the same issue with Tiger -
dyld: Symbol not found: _fnmatch$UNIX2003
Referenced from: /usr/local/bin/wget
Expected in: /usr/lib/libSystem.B.dylib
for those of us who aren’t going to move to Leopard in the very near .. (might do just to get wget working hah!) would it be possible to provide a patch?
August 31st, 2008 at 4:13 pm
Nick - a quick note - my previous binary will work fine on all versions of Mac OS X - see the link to ‘the original version’ above.
I’m afraid I can’t easily build an up-to-date version for older versions of OS X at present, but I’ll try and get my hand on an older machine, or a disk on which I can install an older version, at some point!
September 5th, 2008 at 12:28 am
[...] The missing tool in Mac OS X is most likely wget. Here’s a (universal) port. [...]
September 5th, 2008 at 2:25 pm
$>man curl
September 10th, 2008 at 7:05 pm
Great!!! Thank you so very much!
September 15th, 2008 at 8:02 pm
Thanks, works great. Just what I need.
September 18th, 2008 at 7:28 pm
thx, it’s just ok on 10.5.5!!!
September 19th, 2008 at 6:04 pm
Thanks very much, i can’t find wget like powerful download utility for macosx. There are too many stupid only-interface tool, speeddownload, leech. all stupid.
i need just this :
wget -c -t 0 –http-user=myuser –http-passwd=mypass -i rapidshare_download_links.txt
September 22nd, 2008 at 11:55 pm
Nice! Works perfectly.
September 24th, 2008 at 6:06 pm
Great job! I simply made a /usr/local/etc dir, moved the binary to /usr/bin, moved the man page to /usr/share/man/man1/ and moved the conf file to /usr/local/etc/
Worked like a charm on 10.5.5
October 1st, 2008 at 1:38 pm
Hi, thank you very much. It works on 10.5.5
Bye
moamahi
October 6th, 2008 at 2:42 pm
Thx man worked great on 10.5.5!
October 8th, 2008 at 5:11 pm
Nice! just works fine, and wget is very usefull
October 30th, 2008 at 6:07 pm
Thanks, you saved my day with this latest port!
PS: Works fine with 10.5.5!
November 6th, 2008 at 3:09 pm
Thanks again!!!
November 22nd, 2008 at 7:56 am
[...] I downloaded it for my machine from here [...]
November 27th, 2008 at 3:06 pm
Thanks very much, appreciate it.
December 18th, 2008 at 4:37 pm
Thanks for this. Why does Apple make simple stuff some complicated?
December 24th, 2008 at 10:45 pm
> Why does Apple make simple stuff some complicated?
Because “You don’t need this” (c) Apple
December 29th, 2008 at 3:01 pm
This is perfect! Thank you for sharing it with all of us.
January 4th, 2009 at 6:56 am
Thanks for providing this!
I’m trying to compile wget 1.11.4 on OS X 10.5.6 (I have XCode/Developer tools installed.)
‘./configure’ goes fine, but ‘make’ dies with this error:
make[1]: Nothing to be done for `all’.
cd windows && make CC=’gcc’ CPPFLAGS=” DEFS=’-DHAVE_CONFIG_H -DSYSTEM_WGETRC=\”/usr/etc/wgetrc\” -DLOCALEDIR=\”/usr/share/locale\”‘ CFLAGS=’-O2 -Wall’ LDFLAGS=” LIBS=’-ldl /usr/lib/libssl.dylib /usr/lib/libcrypto.dylib ‘ DESTDIR=” prefix=’/usr’ exec_prefix=’/usr’ bindir=’/usr/bin’ infodir=’/usr/share/info’ mandir=’/usr/share/man’ manext=’1′
make[1]: Nothing to be done for `all’.
Any idea why?
Thanks in advance!
January 4th, 2009 at 8:53 am
Josh - that doesn’t look like an error - more that there’s just nothing to be done in that directory, either because it’s already built there or because the Makefile in that directory doesn’t specify any rules to be built. I note that it’s a directory called ‘windows’!
Are you sure it didn’t complete successfully leaving the resulting binaries in another directory? Don’t have the makefile here to look at, I’m afraid.
January 4th, 2009 at 6:29 pm
D’oh! You’re right! The compiled wget binary was in ./src.
I didn’t even notice the directory name of “windows” in the message I pasted here! I had assumed the build was breaking because it spent an extremely short time compiling and then spat out a whole bunch of ‘make[1]: Nothing to be done for `all’.’ messages for various directories. The combination of short compile time and lots of notifications made me think something was wrong.
Thanks for steering me in the right direction!
Josh
January 15th, 2009 at 10:01 pm
Hi,
I’m really new to Macs - so hopefully am not embarrassing myself with this question!
I was able to easily find and download the wget binary for Mac OS X 10.5.
I’m stuck on this though -
The Read Me file says this:
———————————————————————————————
Copy:
wget into /usr/local/bin
wget.1 into /usr/local/man/man1
wgetrc into /usr/local/etc
You may need to create those directories if they don’t already exist, and add /usr/local/bin to your PATH if it isn’t already there. If you’d rather not modify your PATH you can:
* call wget explicitly using /usr/local/bin/wget
* put it somewhere that is on your PATH, like /usr/bin.
This binary will, however, look for the system-wide configuration file wgetrc in /usr/local/etc, so it’s a good idea to have that in place if you can.
———————————————————————————————
When I tried to create the directory structure suggested above by going to the /usr directory and entering
> mkdir local
I got a “Permission Denied” message
When I go up a level and try to give myself permssions (I’m logged in as an administrator fyi) and type
> chmod 777 usr
I also get a “Permission Denied” message
When I try the alternate suggestion above and just go to the directory where the files were downloaded to and try to move them to the user directory by typing:
> move w* /usr/bin
I also get a “Permission Denied” message
Do you have any suggestions for helping me get unstuck? For example how do I change directory permissions on a Mac? – or any other suggestions?
Thanks!
Gerald
January 16th, 2009 at 11:39 pm
Gerald -
You’re doing the right things except that the /usr directory can only be modified by somebody with root (administrator) privileges. If you’re doing it at the command line, you need to prefix your commands with ’sudo’ (which means ‘do as superuser’).
So you really want
sudo mkdir -p /usr/local/bin
sudo mkdir -p /usr/local/etc
sudo mkdir -p /usr/local/man/man1
sudo cp wget /usr/local/bin
sudo cp wget.1 /usr/local/man/man1
sudo cp wgetrc /usr/local/etc
The first ’sudo’ will prompt you for your password, which will confirm that it really is you, the administrative user, sitting at the keyboard.
Hope this helps!
Quentin
February 11th, 2009 at 6:33 pm
Handy tool, not sure why this is not part of standard OS X release.
February 13th, 2009 at 4:53 pm
Hi Quentin,
Thanks, you’re always a useful place to look for this kind of thing. Hope this finds you and the family well.
~Matt
February 15th, 2009 at 1:57 pm
Similiar to 10.4.1 users, I’m using 10.3.9 still –
dyld: /usr/local/bin/wget Undefined symbols:
/usr/local/bin/wget undefined reference to ___stderrp expected to be defined in /usr/lib/libSystem.B.dylib
/usr/local/bin/wget undefined reference to ___stdinp expected to be defined in /usr/lib/libSystem.B.dylib
/usr/local/bin/wget undefined reference to ___stdoutp expected to be defined in /usr/lib/libSystem.B.dylib
Trace/BPT trap
February 16th, 2009 at 4:05 am
Thank you for this.
March 11th, 2009 at 4:19 pm
I was having issues with the man page - Kripto’s solution worked like a charm:
“moved the binary to /usr/bin, moved the man page to /usr/share/man/man1/ and moved the conf file to /usr/local/etc/”
Great little utility.
March 12th, 2009 at 5:17 pm
Thanks a bunch!!
Like others, had to move the man page to /usr/share/man/man1.
Was a little surprised to find that my Mac had no wget, sigh…
March 12th, 2009 at 9:19 pm
AWESOME!!! THANKS!!
March 15th, 2009 at 10:38 am
Thank you!
Been using wget on Linux for years. Now getting comfortable with Leopard.
Your instructions in README worked perfectly.
March 27th, 2009 at 3:25 pm
>> Why does Apple make simple stuff some complicated?
>
> Because “You don’t need this” (c) Apple
Because for most here, “curl” is all they’ll need. http://thatha.org/blog/wget-for-mac-os-x/
April 2nd, 2009 at 1:29 pm
Hey, this is awesome, I am so used to Linux, and thought MAC is built on UNIX I should be easily familiar with it, not realizing 1/2 of the functionality of UNIX is not available. But this makes biting the bullet less painful. Thank a bunch.
April 15th, 2009 at 3:19 am
[...] for more info). Wget is a non-interactive network downloader. Mac users can try to get a binary here. Wget is a very powerful tool for many reasons, but it can be quite useful if you want to download [...]
May 3rd, 2009 at 4:23 pm
[...] So for this time, download the source code. Here’s a cleaned-up copy of my session when compiling MySQL. If you want to follow my steps verbatim, follow this instruction to install wget for Mac OS X. [...]
May 6th, 2009 at 1:29 am
thank you mr. quentin!
for those with megaupload premium , I use this command
wget –no-cookies –header “Cookie: user=5ea034xxxxxxxxxxxxx” –user-agent=”Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1″ -i /Users/rob/Downloads/mu-list.txt -o /Users/rob/Downloads/mu-log.txt -P /Users/rob/Downloads/ -b
you can check your megaupload cookie, login into your account using firefox
-i is a plain txt link list, -o logs download progress, -P is my files repository and -b stands for background
May 6th, 2009 at 6:49 pm
[...] I really missed this one… wget for mac os x leopard can be found in Quentin Stafford-Fraser’s blog. [...]
May 14th, 2009 at 5:05 am
Thanks you are brilliant!
May 20th, 2009 at 5:20 pm
Thanks
May 31st, 2009 at 1:54 pm
Works in 10.5.2
June 4th, 2009 at 5:26 am
Perhaps I missed it, but I don’t see a reason why you should use this when wget is available through the Mac OS X Ports package. Installing it is as simple as “port install wget”.
June 4th, 2009 at 10:21 am
Israel -
I use Ports too, but a lot of people don’t, and if you just want wget, this saves you installing all that other stuff, changing your path, etc.
That’s the only reason, really.
Quentin
[WORDPRESS HASHCASH] The poster sent us ‘0 which is not a hashcash value.
June 11th, 2009 at 3:52 pm
Nice it works like a charm. Thanks a bunch.
June 22nd, 2009 at 7:19 pm
Thanks a lot for this binary, works fine on 10.5.7. I’d like to not download macports or smth to make wget working, and this binary is perfect for this
June 23rd, 2009 at 8:19 am
Works fine on 10.5.2
July 1st, 2009 at 2:23 am
Or just call me by my physical state: frontallabotomy… I seem to have installed wget OK: files are where they should be. I ran the line wget http://www.epscor.hawaii.edu/ but all I got was the one index file and (of course) I was expecting the entire site. Any suggestions? Thanks, dk