Software/Spider

From ThorstensHome
(Redirected from Spider)
Jump to: navigation, search

Spider is software that shows all links in a given html file.

Contents

Download

Download version for KDE 4

Installation

Here I describe the installation for a default SUSE 11.1 distribution:

tar xvf spider4.tar
cd spider
zast -i libtidy-devel
cmake . && make -j4 && make install

Usage

itchy:~/repos/spider # ./spider example.htm 2>/dev/null
http://www.linuxintro.org

Example

# wget www.staerk.de/thorsten 2>/dev/null; spider Main_Page 2>/dev/null
#column-one
#searchInput
/thorsten/index.php/C_Programming_Tutorial
http://www.linuxintro.org/wiki/umts
http://www.linuxintro.org/wiki/bluetooth
/thorsten/index.php/My_Tutorials
/thorsten/index.php/Html2mediawiki
/thorsten/index.php/Dospath
/thorsten/index.php/Software
/thorsten/index.php/What_I_always_wanted_to_say
/thorsten/index.php/About_this_site
/thorsten/index.php/Image:Walschaerts_motion.gif
http://en.wikipedia.org/wiki/Image:Walschaerts_motion.gif
http://www.staerk.de/thorsten/index.php/Main_Page
/thorsten/index.php/Main_Page
/thorsten/index.php?title=Talk:Main_Page&action=edit
/thorsten/index.php?title=Main_Page&action=edit
/thorsten/index.php?title=Main_Page&action=history
/thorsten/index.php?title=Special:Userlogin&returnto=Main_Page
/thorsten/index.php/Main_Page
/thorsten/index.php/Special:Recentchanges
/thorsten/index.php/Special:Random
/thorsten/index.php/Help:Contents
/thorsten/index.php/Special:Whatlinkshere/Main_Page
/thorsten/index.php/Special:Recentchangeslinked/Main_Page
/thorsten/index.php/Special:Upload
/thorsten/index.php/Special:Specialpages
/thorsten/index.php?title=Main_Page&printable=yes
/thorsten/index.php?title=Main_Page&oldid=1534
http://www.mediawiki.org/
http://www.gnu.org/copyleft/fdl.html
http://www.gnu.org/copyleft/fdl.html
/thorsten/index.php/ThorstensHome:Privacy_policy
/thorsten/index.php/ThorstensHome:About
/thorsten/index.php/ThorstensHome:General_disclaimer

See also