GrabURL 2.0 - Selective URL fetching utility Copyright (C) 1996-97 Serge Emond See license below Table of Contents ~~~~~~~~~~~~~~~~~ 1. License 2. About this document 3. What is GrabURL 4. Compilation & Installation 5. The Author 1. License ~~~~~~~~~~ This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. 2. About this document ~~~~~~~~~~~~~~~~~~~~~~ Well, I dont have much time and interest in writing this thing so it's quick-writing. I assume you are familiar with terms like url, HTTP and HTML. Please note that English is not my native language. 3. About GrabURL and myself ~~~~~~~~~~~~~~~~~~~~~~~~~~~ GrabURL is a small program that can download files using HTTP. It maintains an internal list of urls and can scan HTML files downloaded to add urls recursively. It can use regular expression patterns to be matched to add an URL, saves progress to a "workfile" to continue later (ie after a break with CTRL-C), etc... GrabURL 2.0 is a rewrite of the Amiga-only 1.0 version. It is NOT finished, and most of the features I had in mind when I made this code are not (and won't be) implemented. This version fits my needs very well and I dont have the time and will to finish it. Half the functions haven't been really tested so it might contain quite a load of bugs. This version only exists because I almost only use linux on a pentium now and booting the amiga to download some documents was becoming annoying. I release this only because I think there are people in the world that might have some use for it without having the time to create a similar program and that this one is the only one of it's kind on linux. 4. Compilation & installation ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Type "make" and select the best match to your computer. With Linux/m68k, I had to remove the use of htons(), dont know why, but it crashes, so if you experiment crashes at hostname lookup time, try compiling with -DNO_HTONS, assuming your computer have the correct net byte order (680x0 processors do). Then you can optionally type "strip graburl" to remove debug information and make the executable smaller. Then you copy it somewhere in your path, like /usr/local/bin. The next step is to make a configuration file. The search order is: 1- Config file given as an argument 2- ".graburlrc" in your home directory 3- /etc/graburlrc You NEED a config file to run. Take a look at the default config file named "graburlrc.example". After all this, it should work! :) You really should read GrabURL.txt to see how to use it. 5. The Author ~~~~~~~~~~~~~ Because I don't plan to work on GrabURL doesn't means you can't send bug reports or comments! email: Serge Emond Serge Emond smail: Serge Emond 3392 des Anemones Jonquiere, Quebec Canada, G7S 5V4 You can also check the official GrabURL web page: http://pages.infinit.net/greyl/graburl/ It doesn't contains much but you can download graburl from there.